Novel real-time 3D radiological mapping solution for ALARA maximization, D and D assessments and radiological management

International Nuclear Information System (INIS)

Dubart, Philippe; Hautot, Felix; Morichi, Massimo; Abou-Khalil, Roger

2015-01-01

Good management of dismantling and decontamination (D and D) operations and activities is requiring safety, time saving and perfect radiological knowledge of the contaminated environment as well as optimization for personnel dose and minimization of waste volume. In the same time, Fukushima accident has imposed a stretch to the nuclear measurement operational approach requiring in such emergency situation: fast deployment and intervention, quick analysis and fast scenario definition. AREVA, as return of experience from his activities carried out at Fukushima and D and D sites has developed a novel multi-sensor solution as part of his D and D research, approach and method, a system with real-time 3D photo-realistic spatial radiation distribution cartography of contaminated premises. The system may be hand-held or mounted on a mobile device (robot, drone, e.g). In this paper, we will present our current development based on a SLAM technology (Simultaneous Localization And Mapping) and integrated sensors and detectors allowing simultaneous topographic and radiological (dose rate and/or spectroscopy) data acquisitions. This enabling technology permits 3D gamma activity cartography in real-time. (authors)

A real-time 3D scanning system for pavement distortion inspection

International Nuclear Information System (INIS)

Li, Qingguang; Yao, Ming; Yao, Xun; Xu, Bugao

2010-01-01

Pavement distortions, such as rutting and shoving, are the common pavement distress problems that need to be inspected and repaired in a timely manner to ensure ride quality and traffic safety. This paper introduces a real-time, low-cost inspection system devoted to detecting these distress features using high-speed 3D transverse scanning techniques. The detection principle is the dynamic generation and characterization of the 3D pavement profile based on structured light triangulation. To improve the accuracy of the system, a multi-view coplanar scheme is employed in the calibration procedure so that more feature points can be used and distributed across the field of view of the camera. A sub-pixel line extraction method is applied for the laser stripe location, which includes filtering, edge detection and spline interpolation. The pavement transverse profile is then generated from the laser stripe curve and approximated by line segments. The second-order derivatives of the segment endpoints are used to identify the feature points of possible distortions. The system can output the real-time measurements and 3D visualization of rutting and shoving distress in a scanned pavement

A Comparison of Iterative 2D-3D Pose Estimation Methods for Real-Time Applications

DEFF Research Database (Denmark)

Grest, Daniel; Krüger, Volker; Petersen, Thomas

2009-01-01

This work compares iterative 2D-3D Pose Estimation methods for use in real-time applications. The compared methods are available for public as C++ code. One method is part of the openCV library, namely POSIT. Because POSIT is not applicable for planar 3Dpoint congurations, we include the planar P...

Perceptual Real-Time 2D-to-3D Conversion Using Cue Fusion.

Science.gov (United States)

Leimkuhler, Thomas; Kellnhofer, Petr; Ritschel, Tobias; Myszkowski, Karol; Seidel, Hans-Peter

2018-06-01

We propose a system to infer binocular disparity from a monocular video stream in real-time. Different from classic reconstruction of physical depth in computer vision, we compute perceptually plausible disparity, that is numerically inaccurate, but results in a very similar overall depth impression with plausible overall layout, sharp edges, fine details and agreement between luminance and disparity. We use several simple monocular cues to estimate disparity maps and confidence maps of low spatial and temporal resolution in real-time. These are complemented by spatially-varying, appearance-dependent and class-specific disparity prior maps, learned from example stereo images. Scene classification selects this prior at runtime. Fusion of prior and cues is done by means of robust MAP inference on a dense spatio-temporal conditional random field with high spatial and temporal resolution. Using normal distributions allows this in constant-time, parallel per-pixel work. We compare our approach to previous 2D-to-3D conversion systems in terms of different metrics, as well as a user study and validate our notion of perceptually plausible disparity.

Real-time Stereoscopic 3D for E-Robotics Learning

Directory of Open Access Journals (Sweden)

Richard Y. Chiou

2011-02-01

Full Text Available Following the design and testing of a successful 3-Dimensional surveillance system, this 3D scheme has been implemented into online robotics learning at Drexel University. A real-time application, utilizing robot controllers, programmable logic controllers and sensors, has been developed in the “MET 205 Robotics and Mechatronics” class to provide the students with a better robotic education. The integration of the 3D system allows the students to precisely program the robot and execute functions remotely. Upon the students’ recommendation, polarization has been chosen to be the main platform behind the 3D robotic system. Stereoscopic calculations are carried out for calibration purposes to display the images with the highest possible comfort-level and 3D effect. The calculations are further validated by comparing the results with students’ evaluations. Due to the Internet-based feature, multiple clients have the opportunity to perform the online automation development. In the future, students, in different universities, will be able to cross-control robotic components of different types around the world. With the development of this 3D ERobotics interface, automation resources and robotic learning can be shared and enriched regardless of location.

Real-Time 3D Motion capture by monocular vision and virtual rendering

OpenAIRE

Gomez Jauregui , David Antonio; Horain , Patrick

2012-01-01

International audience; Avatars in networked 3D virtual environments allow users to interact over the Internet and to get some feeling of virtual telepresence. However, avatar control may be tedious. Motion capture systems based on 3D sensors have recently reached the consumer market, but webcams and camera-phones are more widespread and cheaper. The proposed demonstration aims at animating a user's avatar from real time 3D motion capture by monoscopic computer vision, thus allowing virtual t...

An active robot vision system for real-time 3-D structure recovery

Energy Technology Data Exchange (ETDEWEB)

Juvin, D. [CEA Centre d`Etudes de Saclay, 91 - Gif-sur-Yvette (France). Dept. d`Electronique et d`Instrumentation Nucleaire; Boukir, S.; Chaumette, F.; Bouthemy, P. [Rennes-1 Univ., 35 (France)

1993-10-01

This paper presents an active approach for the task of computing the 3-D structure of a nuclear plant environment from an image sequence, more precisely the recovery of the 3-D structure of cylindrical objects. Active vision is considered by computing adequate camera motions using image-based control laws. This approach requires a real-time tracking of the limbs of the cylinders. Therefore, an original matching approach, which relies on an algorithm for determining moving edges, is proposed. This method is distinguished by its robustness and its easiness to implement. This method has been implemented on a parallel image processing board and real-time performance has been achieved. The whole scheme has been successfully validated in an experimental set-up.

An active robot vision system for real-time 3-D structure recovery

International Nuclear Information System (INIS)

Juvin, D.

1993-01-01

This paper presents an active approach for the task of computing the 3-D structure of a nuclear plant environment from an image sequence, more precisely the recovery of the 3-D structure of cylindrical objects. Active vision is considered by computing adequate camera motions using image-based control laws. This approach requires a real-time tracking of the limbs of the cylinders. Therefore, an original matching approach, which relies on an algorithm for determining moving edges, is proposed. This method is distinguished by its robustness and its easiness to implement. This method has been implemented on a parallel image processing board and real-time performance has been achieved. The whole scheme has been successfully validated in an experimental set-up

Real time 3D structural and Doppler OCT imaging on graphics processing units

Science.gov (United States)

Sylwestrzak, Marcin; Szlag, Daniel; Szkulmowski, Maciej; Gorczyńska, Iwona; Bukowska, Danuta; Wojtkowski, Maciej; Targowski, Piotr

2013-03-01

In this report the application of graphics processing unit (GPU) programming for real-time 3D Fourier domain Optical Coherence Tomography (FdOCT) imaging with implementation of Doppler algorithms for visualization of the flows in capillary vessels is presented. Generally, the time of the data processing of the FdOCT data on the main processor of the computer (CPU) constitute a main limitation for real-time imaging. Employing additional algorithms, such as Doppler OCT analysis, makes this processing even more time consuming. Lately developed GPUs, which offers a very high computational power, give a solution to this problem. Taking advantages of them for massively parallel data processing, allow for real-time imaging in FdOCT. The presented software for structural and Doppler OCT allow for the whole processing with visualization of 2D data consisting of 2000 A-scans generated from 2048 pixels spectra with frame rate about 120 fps. The 3D imaging in the same mode of the volume data build of 220 × 100 A-scans is performed at a rate of about 8 frames per second. In this paper a software architecture, organization of the threads and optimization applied is shown. For illustration the screen shots recorded during real time imaging of the phantom (homogeneous water solution of Intralipid in glass capillary) and the human eye in-vivo is presented.

Multithreaded real-time 3D image processing software architecture and implementation

Science.gov (United States)

Ramachandra, Vikas; Atanassov, Kalin; Aleksic, Milivoje; Goma, Sergio R.

2011-03-01

Recently, 3D displays and videos have generated a lot of interest in the consumer electronics industry. To make 3D capture and playback popular and practical, a user friendly playback interface is desirable. Towards this end, we built a real time software 3D video player. The 3D video player displays user captured 3D videos, provides for various 3D specific image processing functions and ensures a pleasant viewing experience. Moreover, the player enables user interactivity by providing digital zoom and pan functionalities. This real time 3D player was implemented on the GPU using CUDA and OpenGL. The player provides user interactive 3D video playback. Stereo images are first read by the player from a fast drive and rectified. Further processing of the images determines the optimal convergence point in the 3D scene to reduce eye strain. The rationale for this convergence point selection takes into account scene depth and display geometry. The first step in this processing chain is identifying keypoints by detecting vertical edges within the left image. Regions surrounding reliable keypoints are then located on the right image through the use of block matching. The difference in the positions between the corresponding regions in the left and right images are then used to calculate disparity. The extrema of the disparity histogram gives the scene disparity range. The left and right images are shifted based upon the calculated range, in order to place the desired region of the 3D scene at convergence. All the above computations are performed on one CPU thread which calls CUDA functions. Image upsampling and shifting is performed in response to user zoom and pan. The player also consists of a CPU display thread, which uses OpenGL rendering (quad buffers). This also gathers user input for digital zoom and pan and sends them to the processing thread.

V-Man Generation for 3-D Real Time Animation. Chapter 5

Science.gov (United States)

Nebel, Jean-Christophe; Sibiryakov, Alexander; Ju, Xiangyang

2007-01-01

The V-Man project has developed an intuitive authoring and intelligent system to create, animate, control and interact in real-time with a new generation of 3D virtual characters: The V-Men. It combines several innovative algorithms coming from Virtual Reality, Physical Simulation, Computer Vision, Robotics and Artificial Intelligence. Given a high-level task like "walk to that spot" or "get that object", a V-Man generates the complete animation required to accomplish the task. V-Men synthesise motion at runtime according to their environment, their task and their physical parameters, drawing upon its unique set of skills manufactured during the character creation. The key to the system is the automated creation of realistic V-Men, not requiring the expertise of an animator. It is based on real human data captured by 3D static and dynamic body scanners, which is then processed to generate firstly animatable body meshes, secondly 3D garments and finally skinned body meshes.

Real-Time 3d Reconstruction from Images Taken from AN Uav

Science.gov (United States)

Zingoni, A.; Diani, M.; Corsini, G.; Masini, A.

2015-08-01

We designed a method for creating 3D models of objects and areas from two aerial images acquired from an UAV. The models are generated automatically and in real-time, and consist in dense and true-colour reconstructions of the considered areas, which give the impression to the operator to be physically present within the scene. The proposed method only needs a cheap compact camera, mounted on a small UAV. No additional instrumentation is necessary, so that the costs are very limited. The method consists of two main parts: the design of the acquisition system and the 3D reconstruction algorithm. In the first part, the choices for the acquisition geometry and for the camera parameters are optimized, in order to yield the best performance. In the second part, a reconstruction algorithm extracts the 3D model from the two acquired images, maximizing the accuracy under the real-time constraint. A test was performed in monitoring a construction yard, obtaining very promising results. Highly realistic and easy-to-interpret 3D models of objects and areas of interest were produced in less than one second, with an accuracy of about 0.5m. For its characteristics, the designed method is suitable for video-surveillance, remote sensing and monitoring, especially in those applications that require intuitive and reliable information quickly, as disasters monitoring, search and rescue and area surveillance.

Strain measurement of abdominal aortic aneurysm with real-time 3D ultrasound speckle tracking.

Science.gov (United States)

Bihari, P; Shelke, A; Nwe, T H; Mularczyk, M; Nelson, K; Schmandra, T; Knez, P; Schmitz-Rixen, T

2013-04-01

Abdominal aortic aneurysm rupture is caused by mechanical vascular tissue failure. Although mechanical properties within the aneurysm vary, currently available ultrasound methods assess only one cross-sectional segment of the aorta. This study aims to establish real-time 3-dimensional (3D) speckle tracking ultrasound to explore local displacement and strain parameters of the whole abdominal aortic aneurysm. Validation was performed on a silicone aneurysm model, perfused in a pulsatile artificial circulatory system. Wall motion of the silicone model was measured simultaneously with a commercial real-time 3D speckle tracking ultrasound system and either with laser-scan micrometry or with video photogrammetry. After validation, 3D ultrasound data were collected from abdominal aortic aneurysms of five patients and displacement and strain parameters were analysed. Displacement parameters measured in vitro by 3D ultrasound and laser scan micrometer or video analysis were significantly correlated at pulse pressures between 40 and 80 mmHg. Strong local differences in displacement and strain were identified within the aortic aneurysms of patients. Local wall strain of the whole abdominal aortic aneurysm can be analysed in vivo with real-time 3D ultrasound speckle tracking imaging, offering the prospect of individual non-invasive rupture risk analysis of abdominal aortic aneurysms. Copyright © 2013 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

D Model Visualization Enhancements in Real-Time Game Engines

Science.gov (United States)

Merlo, A.; Sánchez Belenguer, C.; Vendrell Vidal, E.; Fantini, F.; Aliperta, A.

2013-02-01

This paper describes two procedures used to disseminate tangible cultural heritage through real-time 3D simulations providing accurate-scientific representations. The main idea is to create simple geometries (with low-poly count) and apply two different texture maps to them: a normal map and a displacement map. There are two ways to achieve models that fit with normal or displacement maps: with the former (normal maps), the number of polygons in the reality-based model may be dramatically reduced by decimation algorithms and then normals may be calculated by rendering them to texture solutions (baking). With the latter, a LOD model is needed; its topology has to be quad-dominant for it to be converted to a good quality subdivision surface (with consistent tangency and curvature all over). The subdivision surface is constructed using methodologies for the construction of assets borrowed from character animation: these techniques have been recently implemented in many entertainment applications known as "retopology". The normal map is used as usual, in order to shade the surface of the model in a realistic way. The displacement map is used to finish, in real-time, the flat faces of the object, by adding the geometric detail missing in the low-poly models. The accuracy of the resulting geometry is progressively refined based on the distance from the viewing point, so the result is like a continuous level of detail, the only difference being that there is no need to create different 3D models for one and the same object. All geometric detail is calculated in real-time according to the displacement map. This approach can be used in Unity, a real-time 3D engine originally designed for developing computer games. It provides a powerful rendering engine, fully integrated with a complete set of intuitive tools and rapid workflows that allow users to easily create interactive 3D contents. With the release of Unity 4.0, new rendering features have been added, including Direct

3D Display of Spacecraft Dynamics Using Real Telemetry

Directory of Open Access Journals (Sweden)

Sanguk Lee

2002-12-01

Full Text Available 3D display of spacecraft motion by using telemetry data received from satellite in real-time is described. Telemetry data are converted to the appropriate form for 3-D display by the real-time preprocessor. Stored playback telemetry data also can be processed for the display. 3D display of spacecraft motion by using real telemetry data provides intuitive comprehension of spacecraft dynamics.

ArtifactVis2: Managing real-time archaeological data in immersive 3D environments

KAUST Repository

Smith, Neil

2013-10-01

In this paper, we present a stereoscopic research and training environment for archaeologists called ArtifactVis2. This application enables the management and visualization of diverse types of cultural datasets within a collaborative virtual 3D system. The archaeologist is fully immersed in a large-scale visualization of on-going excavations. Massive 3D datasets are seamlessly rendered in real-time with field recorded GIS data, 3D artifact scans and digital photography. Dynamic content can be visualized and cultural analytics can be performed on archaeological datasets collected through a rigorous digital archaeological methodology. The virtual collaborative environment provides a menu driven query system and the ability to annotate, markup, measure, and manipulate any of the datasets. These features enable researchers to re-experience and analyze the minute details of an archaeological site\\'s excavation. It enhances their visual capacity to recognize deep patterns and structures and perceive changes and reoccurrences. As a complement and development from previous work in the field of 3D immersive archaeological environments, ArtifactVis2 provides a GIS based immersive environment that taps directly into archaeological datasets to investigate cultural and historical issues of ancient societies and cultural heritage in ways not possible before. © 2013 IEEE.

A Bayesian approach to real-time 3D tumor localization via monoscopic x-ray imaging during treatment delivery

International Nuclear Information System (INIS)

Li, Ruijiang; Fahimian, Benjamin P.; Xing, Lei

2011-01-01

Purpose: Monoscopic x-ray imaging with on-board kV devices is an attractive approach for real-time image guidance in modern radiation therapy such as VMAT or IMRT, but it falls short in providing reliable information along the direction of imaging x-ray. By effectively taking consideration of projection data at prior times and/or angles through a Bayesian formalism, the authors develop an algorithm for real-time and full 3D tumor localization with a single x-ray imager during treatment delivery. Methods: First, a prior probability density function is constructed using the 2D tumor locations on the projection images acquired during patient setup. Whenever an x-ray image is acquired during the treatment delivery, the corresponding 2D tumor location on the imager is used to update the likelihood function. The unresolved third dimension is obtained by maximizing the posterior probability distribution. The algorithm can also be used in a retrospective fashion when all the projection images during the treatment delivery are used for 3D localization purposes. The algorithm does not involve complex optimization of any model parameter and therefore can be used in a ''plug-and-play'' fashion. The authors validated the algorithm using (1) simulated 3D linear and elliptic motion and (2) 3D tumor motion trajectories of a lung and a pancreas patient reproduced by a physical phantom. Continuous kV images were acquired over a full gantry rotation with the Varian TrueBeam on-board imaging system. Three scenarios were considered: fluoroscopic setup, cone beam CT setup, and retrospective analysis. Results: For the simulation study, the RMS 3D localization error is 1.2 and 2.4 mm for the linear and elliptic motions, respectively. For the phantom experiments, the 3D localization error is < 1 mm on average and < 1.5 mm at 95th percentile in the lung and pancreas cases for all three scenarios. The difference in 3D localization error for different scenarios is small and is not

Near-real time 3D probabilistic earthquakes locations at Mt. Etna volcano

Science.gov (United States)

Barberi, G.; D'Agostino, M.; Mostaccio, A.; Patane', D.; Tuve', T.

2012-04-01

Automatic procedure for locating earthquake in quasi-real time must provide a good estimation of earthquakes location within a few seconds after the event is first detected and is strongly needed for seismic warning system. The reliability of an automatic location algorithm is influenced by several factors such as errors in picking seismic phases, network geometry, and velocity model uncertainties. On Mt. Etna, the seismic network is managed by INGV and the quasi-real time earthquakes locations are performed by using an automatic-picking algorithm based on short-term-average to long-term-average ratios (STA/LTA) calculated from an approximate squared envelope function of the seismogram, which furnish a list of P-wave arrival times, and the location algorithm Hypoellipse, with a 1D velocity model. The main purpose of this work is to investigate the performances of a different automatic procedure to improve the quasi-real time earthquakes locations. In fact, as the automatic data processing may be affected by outliers (wrong picks), the use of a traditional earthquake location techniques based on a least-square misfit function (L2-norm) often yield unstable and unreliable solutions. Moreover, on Mt. Etna, the 1D model is often unable to represent the complex structure of the volcano (in particular the strong lateral heterogeneities), whereas the increasing accuracy in the 3D velocity models at Mt. Etna during recent years allows their use today in routine earthquake locations. Therefore, we selected, as reference locations, all the events occurred on Mt. Etna in the last year (2011) which was automatically detected and located by means of the Hypoellipse code. By using this dataset (more than 300 events), we applied a nonlinear probabilistic earthquake location algorithm using the Equal Differential Time (EDT) likelihood function, (Font et al., 2004; Lomax, 2005) which is much more robust in the presence of outliers in the data. Successively, by using a probabilistic

Feasibility of the integration of CRONOS, a 3-D neutronics code, into real-time simulators

International Nuclear Information System (INIS)

Ragusa, J.C.

2001-01-01

In its effort to contribute to nuclear power plant safety, CEA proposes the integration of an engineering grade 3-D neutronics code into a real-time plant analyser. This paper describes the capabilities of the neutronics code CRONOS to achieve a fast running performance. First, we will present current core models in simulators and explain their drawbacks. Secondly, the mean features of CRONOS's spatial-kinetics methods will be reviewed. We will then present an optimum core representation with respect to mesh size, choice of finite elements (FE) basis and execution time, for accurate results as well as the multi 1-D thermal-hydraulics (T/H) model developed to take into account 3-D effects in updating the cross-sections. A Main Steam Line Break (MSLB) End-of-Life (EOL) Hot-Zero-Power (HZP) accident will be used as an example, before we conclude with the perspectives of integrating CRONOS's 3-D core model into real-time simulators. (author)

Feasibility of the integration of CRONOS, a 3-D neutronics code, into real-time simulators

Energy Technology Data Exchange (ETDEWEB)

Ragusa, J.C. [CEA Saclay, Dept. de Mecanique et de Technologie, 91 - Gif-sur-Yvette (France)

2001-07-01

In its effort to contribute to nuclear power plant safety, CEA proposes the integration of an engineering grade 3-D neutronics code into a real-time plant analyser. This paper describes the capabilities of the neutronics code CRONOS to achieve a fast running performance. First, we will present current core models in simulators and explain their drawbacks. Secondly, the mean features of CRONOS's spatial-kinetics methods will be reviewed. We will then present an optimum core representation with respect to mesh size, choice of finite elements (FE) basis and execution time, for accurate results as well as the multi 1-D thermal-hydraulics (T/H) model developed to take into account 3-D effects in updating the cross-sections. A Main Steam Line Break (MSLB) End-of-Life (EOL) Hot-Zero-Power (HZP) accident will be used as an example, before we conclude with the perspectives of integrating CRONOS's 3-D core model into real-time simulators. (author)

QuickPALM: 3D real-time photoactivation nanoscopy image processing in ImageJ

CSIR Research Space (South Africa)

Henriques, R

2010-05-01

Full Text Available QuickPALM in conjunction with the acquisition of control features provides a complete solution for the acquisition, reconstruction and visualization of 3D PALM or STORM images, achieving resolutions of ~40 nm in real time. This software package...

A real-time 3D end-to-end augmented reality system (and its representation transformations)

Science.gov (United States)

Tytgat, Donny; Aerts, Maarten; De Busser, Jeroen; Lievens, Sammy; Rondao Alface, Patrice; Macq, Jean-Francois

2016-09-01

The new generation of HMDs coming to the market is expected to enable many new applications that allow free viewpoint experiences with captured video objects. Current applications usually rely on 3D content that is manually created or captured in an offline manner. In contrast, this paper focuses on augmented reality applications that use live captured 3D objects while maintaining free viewpoint interaction. We present a system that allows live dynamic 3D objects (e.g. a person who is talking) to be captured in real-time. Real-time performance is achieved by traversing a number of representation formats and exploiting their specific benefits. For instance, depth images are maintained for fast neighborhood retrieval and occlusion determination, while implicit surfaces are used to facilitate multi-source aggregation for both geometry and texture. The result is a 3D reconstruction system that outputs multi-textured triangle meshes at real-time rates. An end-to-end system is presented that captures and reconstructs live 3D data and allows for this data to be used on a networked (AR) device. For allocating the different functional blocks onto the available physical devices, a number of alternatives are proposed considering the available computational power and bandwidth for each of the components. As we will show, the representation format can play an important role in this functional allocation and allows for a flexible system that can support a highly heterogeneous infrastructure.

2D array transducers for real-time 3D ultrasound guidance of interventional devices

Science.gov (United States)

Light, Edward D.; Smith, Stephen W.

2009-02-01

We describe catheter ring arrays for real-time 3D ultrasound guidance of devices such as vascular grafts, heart valves and vena cava filters. We have constructed several prototypes operating at 5 MHz and consisting of 54 elements using the W.L. Gore & Associates, Inc. micro-miniature ribbon cables. We have recently constructed a new transducer using a braided wiring technology from Precision Interconnect. This transducer consists of 54 elements at 4.8 MHz with pitch of 0.20 mm and typical -6 dB bandwidth of 22%. In all cases, the transducer and wiring assembly were integrated with an 11 French catheter of a Cook Medical deployment device for vena cava filters. Preliminary in vivo and in vitro testing is ongoing including simultaneous 3D ultrasound and x-ray fluoroscopy.

A meshless EFG-based algorithm for 3D deformable modeling of soft tissue in real-time.

Science.gov (United States)

Abdi, Elahe; Farahmand, Farzam; Durali, Mohammad

2012-01-01

The meshless element-free Galerkin method was generalized and an algorithm was developed for 3D dynamic modeling of deformable bodies in real time. The efficacy of the algorithm was investigated in a 3D linear viscoelastic model of human spleen subjected to a time-varying compressive force exerted by a surgical grasper. The model remained stable in spite of the considerably large deformations occurred. There was a good agreement between the results and those of an equivalent finite element model. The computational cost, however, was much lower, enabling the proposed algorithm to be effectively used in real-time applications.

3D real-time monitoring system for LHD plasma heating experiment

International Nuclear Information System (INIS)

Emoto, M.; Narlo, J.; Kaneko, O.; Komori, A.; Iima, M.; Yamaguchi, S.; Sudo, S.

2001-01-01

The JAVA-based real-time monitoring system has been in use at the National Institute for Fusion Science, Japan, since the end of March 1988 to maintain stable operations. This system utilizes JAVA technology to realize its platform-independent nature. The main programs are written as JAVA applets and provide human-friendly interfaces. In order to enhance the system's easy-recognition nature, a 3D feature is added. Since most of the system is written mainly in JAVA language, we adopted JAVA3D technology, which was easy to incorporate into the current running systems. With this 3D feature, the operator can more easily find the malfunctioning parts of complex instruments, such as LHD vacuum vessels. This feature is also helpful for recognizing physical phenomena. In this paper, we present an example in which the temperature increases of a vacuum vessel after NBI are visualized

Real-time intensity based 2D/3D registration using kV-MV image pairs for tumor motion tracking in image guided radiotherapy

Science.gov (United States)

Furtado, H.; Steiner, E.; Stock, M.; Georg, D.; Birkfellner, W.

2014-03-01

Intra-fractional respiratorymotion during radiotherapy is one of themain sources of uncertainty in dose application creating the need to extend themargins of the planning target volume (PTV). Real-time tumormotion tracking by 2D/3D registration using on-board kilo-voltage (kV) imaging can lead to a reduction of the PTV. One limitation of this technique when using one projection image, is the inability to resolve motion along the imaging beam axis. We present a retrospective patient study to investigate the impact of paired portal mega-voltage (MV) and kV images, on registration accuracy. We used data from eighteen patients suffering from non small cell lung cancer undergoing regular treatment at our center. For each patient we acquired a planning CT and sequences of kV and MV images during treatment. Our evaluation consisted of comparing the accuracy of motion tracking in 6 degrees-of-freedom(DOF) using the anterior-posterior (AP) kV sequence or the sequence of kV-MV image pairs. We use graphics processing unit rendering for real-time performance. Motion along cranial-caudal direction could accurately be extracted when using only the kV sequence but in AP direction we obtained large errors. When using kV-MV pairs, the average error was reduced from 3.3 mm to 1.8 mm and the motion along AP was successfully extracted. The mean registration time was of 190+/-35ms. Our evaluation shows that using kVMV image pairs leads to improved motion extraction in 6 DOF. Therefore, this approach is suitable for accurate, real-time tumor motion tracking with a conventional LINAC.

Real-Time 3D Tracking and Reconstruction on Mobile Phones.

Science.gov (United States)

Prisacariu, Victor Adrian; Kähler, Olaf; Murray, David W; Reid, Ian D

2015-05-01

We present a novel framework for jointly tracking a camera in 3D and reconstructing the 3D model of an observed object. Due to the region based approach, our formulation can handle untextured objects, partial occlusions, motion blur, dynamic backgrounds and imperfect lighting. Our formulation also allows for a very efficient implementation which achieves real-time performance on a mobile phone, by running the pose estimation and the shape optimisation in parallel. We use a level set based pose estimation but completely avoid the, typically required, explicit computation of a global distance. This leads to tracking rates of more than 100 Hz on a desktop PC and 30 Hz on a mobile phone. Further, we incorporate additional orientation information from the phone's inertial sensor which helps us resolve the tracking ambiguities inherent to region based formulations. The reconstruction step first probabilistically integrates 2D image statistics from selected keyframes into a 3D volume, and then imposes coherency and compactness using a total variational regularisation term. The global optimum of the overall energy function is found using a continuous max-flow algorithm and we show that, similar to tracking, the integration of per voxel posteriors instead of likelihoods improves the precision and accuracy of the reconstruction.

Real-Time 3D Face Acquisition Using Reconfigurable Hybrid Architecture

Directory of Open Access Journals (Sweden)

Mitéran Johel

2007-01-01

Full Text Available Acquiring 3D data of human face is a general problem which can be applied in face recognition, virtual reality, and many other applications. It can be solved using stereovision. This technique consists in acquiring data in three dimensions from two cameras. The aim is to implement an algorithmic chain which makes it possible to obtain a three-dimensional space from two two-dimensional spaces: two images coming from the two cameras. Several implementations have already been considered. We propose a new simple real-time implementation based on a hybrid architecture (FPGA-DSP, allowing to consider an embedded and reconfigurable processing. Then we show our method which provides depth map of face, dense and reliable, and which can be implemented on an embedded architecture. A various architecture study led us to a judicious choice allowing to obtain the desired result. The real-time data processing is implemented in an embedded architecture. We obtain a dense face disparity map, precise enough for considered applications (multimedia, virtual worlds, biometrics and using a reliable method.

Online 4D ultrasound guidance for real-time motion compensation by MLC tracking.

Science.gov (United States)

Ipsen, Svenja; Bruder, Ralf; O'Brien, Rick; Keall, Paul J; Schweikard, Achim; Poulsen, Per R

2016-10-01

With the trend in radiotherapy moving toward dose escalation and hypofractionation, the need for highly accurate targeting increases. While MLC tracking is already being successfully used for motion compensation of moving targets in the prostate, current real-time target localization methods rely on repeated x-ray imaging and implanted fiducial markers or electromagnetic transponders rather than direct target visualization. In contrast, ultrasound imaging can yield volumetric data in real-time (3D + time = 4D) without ionizing radiation. The authors report the first results of combining these promising techniques-online 4D ultrasound guidance and MLC tracking-in a phantom. A software framework for real-time target localization was installed directly on a 4D ultrasound station and used to detect a 2 mm spherical lead marker inside a water tank. The lead marker was rigidly attached to a motion stage programmed to reproduce nine characteristic tumor trajectories chosen from large databases (five prostate, four lung). The 3D marker position detected by ultrasound was transferred to a computer program for MLC tracking at a rate of 21.3 Hz and used for real-time MLC aperture adaption on a conventional linear accelerator. The tracking system latency was measured using sinusoidal trajectories and compensated for by applying a kernel density prediction algorithm for the lung traces. To measure geometric accuracy, static anterior and lateral conformal fields as well as a 358° arc with a 10 cm circular aperture were delivered for each trajectory. The two-dimensional (2D) geometric tracking error was measured as the difference between marker position and MLC aperture center in continuously acquired portal images. For dosimetric evaluation, VMAT treatment plans with high and low modulation were delivered to a biplanar diode array dosimeter using the same trajectories. Dose measurements with and without MLC tracking were compared to a static reference dose using 3%/3 mm and 2

Position tracking of moving liver lesion based on real-time registration between 2D ultrasound and 3D preoperative images

International Nuclear Information System (INIS)

Weon, Chijun; Hyun Nam, Woo; Lee, Duhgoon; Ra, Jong Beom; Lee, Jae Young

2015-01-01

Purpose: Registration between 2D ultrasound (US) and 3D preoperative magnetic resonance (MR) (or computed tomography, CT) images has been studied recently for US-guided intervention. However, the existing techniques have some limits, either in the registration speed or the performance. The purpose of this work is to develop a real-time and fully automatic registration system between two intermodal images of the liver, and subsequently an indirect lesion positioning/tracking algorithm based on the registration result, for image-guided interventions. Methods: The proposed position tracking system consists of three stages. In the preoperative stage, the authors acquire several 3D preoperative MR (or CT) images at different respiratory phases. Based on the transformations obtained from nonrigid registration of the acquired 3D images, they then generate a 4D preoperative image along the respiratory phase. In the intraoperative preparatory stage, they properly attach a 3D US transducer to the patient’s body and fix its pose using a holding mechanism. They then acquire a couple of respiratory-controlled 3D US images. Via the rigid registration of these US images to the 3D preoperative images in the 4D image, the pose information of the fixed-pose 3D US transducer is determined with respect to the preoperative image coordinates. As feature(s) to use for the rigid registration, they may choose either internal liver vessels or the inferior vena cava. Since the latter is especially useful in patients with a diffuse liver disease, the authors newly propose using it. In the intraoperative real-time stage, they acquire 2D US images in real-time from the fixed-pose transducer. For each US image, they select candidates for its corresponding 2D preoperative slice from the 4D preoperative MR (or CT) image, based on the predetermined pose information of the transducer. The correct corresponding image is then found among those candidates via real-time 2D registration based on a

Three-dimensional (3D) real-time conformal brachytherapy - a novel solution for prostate cancer treatment Part I. Rationale and method

International Nuclear Information System (INIS)

Fijalkowski, M.; Bialas, B.; Maciejewski, B.; Bystrzycka, J.; Slosarek, K.

2005-01-01

Recently, the system for conformal real-time high-dose-rate brachytherapy has been developed and dedicated in general for the treatment of prostate cancer. The aim of this paper is to present the 3D-conformal real-time brachytherapy technique introduced to clinical practice at the Institute of Oncology in Gliwice. Equipment and technique of 3D-conformal real time brachytherapy (3D-CBRT) is presented in detail and compared with conventional high-dose-rate brachytherapy. Step-by-step procedures of treatment planning are described, including own modifications. The 3D-CBRT offers the following advantages: (1) on-line continuous visualization of the prostate and acquisition of the series of NS images during the entire procedure of planning and treatment; (2) high precision of definition and contouring the target volume and the healthy organs at risk (urethra, rectum, bladder) based on 3D transrectal continuous ultrasound images; (3) interactive on-line dose optimization with real-time corrections of the dose-volume histograms (DVHs) till optimal dose distribution is achieved; (4) possibility to overcome internal prostate motion and set-up inaccuracies by stable positioning of the prostate with needles fixed to the template; (5) significant shortening of overall treatment time; (6) cost reduction - the treatment can be provided as an outpatient procedure. The 3D- real time CBRT can be advertised as an ideal conformal boost dose technique integrated or interdigitated with pelvic conformal external beam radiotherapy or as a monotherapy for prostate cancer. (author)

Enhancement of Online Robotics Learning Using Real-Time 3D Visualization Technology

OpenAIRE

Richard Chiou; Yongjin (james) Kwon; Tzu-Liang (bill) Tseng; Robin Kizirian; Yueh-Ting Yang

2010-01-01

This paper discusses a real-time e-Lab Learning system based on the integration of 3D visualization technology with a remote robotic laboratory. With the emergence and development of the Internet field, online learning is proving to play a significant role in the upcoming era. In an effort to enhance Internet-based learning of robotics and keep up with the rapid progression of technology, a 3- Dimensional scheme of viewing the robotic laboratory has been introduced in addition to the remote c...

Precise and real-time measurement of 3D tumor motion in lung due to breathing and heartbeat, measured during radiotherapy

International Nuclear Information System (INIS)

Seppenwoolde, Yvette; Shirato, Hiroki; Kitamura, Kei; Shimizu, Shinichi; Herk, Marcel van; Lebesque, Joos V.; Miyasaka, Kazuo

2002-01-01

Purpose: In this work, three-dimensional (3D) motion of lung tumors during radiotherapy in real time was investigated. Understanding the behavior of tumor motion in lung tissue to model tumor movement is necessary for accurate (gated or breath-hold) radiotherapy or CT scanning. Methods: Twenty patients were included in this study. Before treatment, a 2-mm gold marker was implanted in or near the tumor. A real-time tumor tracking system using two fluoroscopy image processor units was installed in the treatment room. The 3D position of the implanted gold marker was determined by using real-time pattern recognition and a calibrated projection geometry. The linear accelerator was triggered to irradiate the tumor only when the gold marker was located within a certain volume. The system provided the coordinates of the gold marker during beam-on and beam-off time in all directions simultaneously, at a sample rate of 30 images per second. The recorded tumor motion was analyzed in terms of the amplitude and curvature of the tumor motion in three directions, the differences in breathing level during treatment, hysteresis (the difference between the inhalation and exhalation trajectory of the tumor), and the amplitude of tumor motion induced by cardiac motion. Results: The average amplitude of the tumor motion was greatest (12±2 mm [SD]) in the cranial-caudal direction for tumors situated in the lower lobes and not attached to rigid structures such as the chest wall or vertebrae. For the lateral and anterior-posterior directions, tumor motion was small both for upper- and lower-lobe tumors (2±1 mm). The time-averaged tumor position was closer to the exhale position, because the tumor spent more time in the exhalation than in the inhalation phase. The tumor motion was modeled as a sinusoidal movement with varying asymmetry. The tumor position in the exhale phase was more stable than the tumor position in the inhale phase during individual treatment fields. However, in many

Enhancement of Online Robotics Learning Using Real-Time 3D Visualization Technology

Directory of Open Access Journals (Sweden)

Richard Chiou

2010-06-01

Full Text Available This paper discusses a real-time e-Lab Learning system based on the integration of 3D visualization technology with a remote robotic laboratory. With the emergence and development of the Internet field, online learning is proving to play a significant role in the upcoming era. In an effort to enhance Internet-based learning of robotics and keep up with the rapid progression of technology, a 3- Dimensional scheme of viewing the robotic laboratory has been introduced in addition to the remote controlling of the robots. The uniqueness of the project lies in making this process Internet-based, and remote robot operated and visualized in 3D. This 3D system approach provides the students with a more realistic feel of the 3D robotic laboratory even though they are working remotely. As a result, the 3D visualization technology has been tested as part of a laboratory in the MET 205 Robotics and Mechatronics class and has received positive feedback by most of the students. This type of research has introduced a new level of realism and visual communications to online laboratory learning in a remote classroom.

A Spatial Reference Grid for Real-Time Autonomous Underwater Modeling using 3-D Sonar

Energy Technology Data Exchange (ETDEWEB)

Auran, P.G.

1996-12-31

The offshore industry has recognized the need for intelligent underwater robotic vehicles. This doctoral thesis deals with autonomous underwater vehicles (AUVs) and concentrates on a data representation for real-time image formation and analysis. Its main objective is to develop a 3-D image representation suitable for autonomous perception objectives underwater, assuming active sonar as the main sensor for perception. The main contributions are: (1) A dynamical image representation for 3-D range data, (2) A basic electronic circuit and software system for 3-D sonar sampling and amplitude thresholding, (3) A model for target reliability, (4) An efficient connected components algorithm for 3-D segmentation, (5) A method for extracting general 3-D geometrical representations from segmented echo clusters, (6) Experimental results of planar and curved target modeling. 142 refs., 120 figs., 10 tabs.

Demo: Distributed Real-Time Generative 3D Hand Tracking using Edge GPGPU Acceleration

DEFF Research Database (Denmark)

Qammaz, Ammar; Kosta, Sokol; Kyriazis, Nikolaos

2018-01-01

computations locally. The network connection takes the place of a GPGPU accelerator and sharing resources with a larger workstation becomes the acceleration mechanism. The unique properties of a generative optimizer are examined and constitute a challenging use-case, since the requirement for real......This work demonstrates a real-time 3D hand tracking application that runs via computation offloading. The proposed framework enables the application to run on low-end mobile devices such as laptops and tablets, despite the fact that they lack the sufficient hardware to perform the required...

Real-time viability and apoptosis kinetic detection method of 3D multicellular tumor spheroids using the Celigo Image Cytometer.

Science.gov (United States)

Kessel, Sarah; Cribbes, Scott; Bonasu, Surekha; Rice, William; Qiu, Jean; Chan, Leo Li-Ying

2017-09-01

The development of three-dimensional (3D) multicellular tumor spheroid models for cancer drug discovery research has increased in the recent years. The use of 3D tumor spheroid models may be more representative of the complex in vivo tumor microenvironments in comparison to two-dimensional (2D) assays. Currently, viability of 3D multicellular tumor spheroids has been commonly measured on standard plate-readers using metabolic reagents such as CellTiter-Glo® for end point analysis. Alternatively, high content image cytometers have been used to measure drug effects on spheroid size and viability. Previously, we have demonstrated a novel end point drug screening method for 3D multicellular tumor spheroids using the Celigo Image Cytometer. To better characterize the cancer drug effects, it is important to also measure the kinetic cytotoxic and apoptotic effects on 3D multicellular tumor spheroids. In this work, we demonstrate the use of PI and caspase 3/7 stains to measure viability and apoptosis for 3D multicellular tumor spheroids in real-time. The method was first validated by staining different types of tumor spheroids with PI and caspase 3/7 and monitoring the fluorescent intensities for 16 and 21 days. Next, PI-stained and nonstained control tumor spheroids were digested into single cell suspension to directly measure viability in a 2D assay to determine the potential toxicity of PI. Finally, extensive data analysis was performed on correlating the time-dependent PI and caspase 3/7 fluorescent intensities to the spheroid size and necrotic core formation to determine an optimal starting time point for cancer drug testing. The ability to measure real-time viability and apoptosis is highly important for developing a proper 3D model for screening tumor spheroids, which can allow researchers to determine time-dependent drug effects that usually are not captured by end point assays. This would improve the current tumor spheroid analysis method to potentially better

Real-time 2D/3D registration using kV-MV image pairs for tumor motion tracking in image guided radiotherapy.

Science.gov (United States)

Furtado, Hugo; Steiner, Elisabeth; Stock, Markus; Georg, Dietmar; Birkfellner, Wolfgang

2013-10-01

Intra-fractional respiratory motion during radiotherapy leads to a larger planning target volume (PTV). Real-time tumor motion tracking by two-dimensional (2D)/3D registration using on-board kilo-voltage (kV) imaging can allow for a reduction of the PTV though motion along the imaging beam axis cannot be resolved using only one projection image. We present a retrospective patient study investigating the impact of paired portal mega-voltage (MV) and kV images on registration accuracy. Material and methods. We used data from 10 patients suffering from non-small cell lung cancer (NSCLC) undergoing stereotactic body radiation therapy (SBRT) lung treatment. For each patient we acquired a planning computed tomography (CT) and sequences of kV and MV images during treatment. We compared the accuracy of motion tracking in six degrees-of-freedom (DOF) using the anterior-posterior (AP) kV sequence or the sequence of kV-MV image pairs. Results. Motion along cranial-caudal direction could accurately be extracted when using only the kV sequence but in AP direction we obtained large errors. When using kV-MV pairs, the average error was reduced from 2.9 mm to 1.5 mm and the motion along AP was successfully extracted. Mean registration time was 188 ms. Conclusion. Our evaluation shows that using kV-MV image pairs leads to improved motion extraction in six DOF and is suitable for real-time tumor motion tracking with a conventional LINAC.

An experiment of a 3D real-time robust visual odometry for intelligent vehicles

OpenAIRE

Rodriguez Florez , Sergio Alberto; Fremont , Vincent; Bonnifait , Philippe

2009-01-01

International audience; Vision systems are nowadays very promising for many on-board vehicles perception functionalities, like obstacles detection/recognition and ego-localization. In this paper, we present a 3D visual odometric method that uses a stereo-vision system to estimate the 3D ego-motion of a vehicle in outdoor road conditions. In order to run in real-time, the studied technique is sparse meaning that it makes use of feature points that are tracked during several frames. A robust sc...

Real-Time Multi-Directional Equipment Site

Data.gov (United States)

Federal Laboratory Consortium — As part of the George E. Brown, Jr. Network for Earthquake Engineering Simulation (NEES) Program, Lehigh University has established the Real-Time Multi-Directional...

Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration.

Science.gov (United States)

Su, Li-Ming; Vagvolgyi, Balazs P; Agarwal, Rahul; Reiley, Carol E; Taylor, Russell H; Hager, Gregory D

2009-04-01

To investigate a markerless tracking system for real-time stereo-endoscopic visualization of preoperative computed tomographic imaging as an augmented display during robot-assisted laparoscopic partial nephrectomy. Stereoscopic video segments of a patient undergoing robot-assisted laparoscopic partial nephrectomy for tumor and another for a partial staghorn renal calculus were processed to evaluate the performance of a three-dimensional (3D)-to-3D registration algorithm. After both cases, we registered a segment of the video recording to the corresponding preoperative 3D-computed tomography image. After calibrating the camera and overlay, 3D-to-3D registration was created between the model and the surgical recording using a modified iterative closest point technique. Image-based tracking technology tracked selected fixed points on the kidney surface to augment the image-to-model registration. Our investigation has demonstrated that we can identify and track the kidney surface in real time when applied to intraoperative video recordings and overlay the 3D models of the kidney, tumor (or stone), and collecting system semitransparently. Using a basic computer research platform, we achieved an update rate of 10 Hz and an overlay latency of 4 frames. The accuracy of the 3D registration was 1 mm. Augmented reality overlay of reconstructed 3D-computed tomography images onto real-time stereo video footage is possible using iterative closest point and image-based surface tracking technology that does not use external navigation tracking systems or preplaced surface markers. Additional studies are needed to assess the precision and to achieve fully automated registration and display for intraoperative use.

On the Feasibility of Real-Time 3D Hand Tracking using Edge GPGPU Acceleration

DEFF Research Database (Denmark)

Qammaz, A.; Kosta, S.; Kyriazis, N.

2018-01-01

This paper presents the case study of a non-intrusive porting of a monolithic C++ library for real-time 3D hand tracking, to the domain of edge-based computation. Towards a proof of concept, the case study considers a pair of workstations, a computationally powerful and a computationally weak one...

Simulation Study of Real Time 3-D Synthetic Aperture Sequential Beamforming for Ultrasound Imaging

DEFF Research Database (Denmark)

Hemmsen, Martin Christian; Rasmussen, Morten Fischer; Stuart, Matthias Bo

2014-01-01

in the main system. The real-time imaging capability is achieved using a synthetic aperture beamforming technique, utilizing the transmit events to generate a set of virtual elements that in combination can generate an image. The two core capabilities in combination is named Synthetic Aperture Sequential......This paper presents a new beamforming method for real-time three-dimensional (3-D) ultrasound imaging using a 2-D matrix transducer. To obtain images with sufficient resolution and contrast, several thousand elements are needed. The proposed method reduces the required channel count from...... Beamforming (SASB). Simulations are performed to evaluate the image quality of the presented method in comparison to Parallel beamforming utilizing 16 receive beamformers. As indicators for image quality the detail resolution and Cystic resolution are determined for a set of scatterers at a depth of 90mm...

Real-Time Climate Simulations in the Interactive 3D Game Universe Sandbox ²

Science.gov (United States)

Goldenson, N. L.

2014-12-01

Exploration in an open-ended computer game is an engaging way to explore climate and climate change. Everyone can explore physical models with real-time visualization in the educational simulator Universe Sandbox ² (universesandbox.com/2), which includes basic climate simulations on planets. I have implemented a time-dependent, one-dimensional meridional heat transport energy balance model to run and be adjustable in real time in the midst of a larger simulated system. Universe Sandbox ² is based on the original game - at its core a gravity simulator - with other new physically-based content for stellar evolution, and handling collisions between bodies. Existing users are mostly science enthusiasts in informal settings. We believe that this is the first climate simulation to be implemented in a professionally developed computer game with modern 3D graphical output in real time. The type of simple climate model we've adopted helps us depict the seasonal cycle and the more drastic changes that come from changing the orbit or other external forcings. Users can alter the climate as the simulation is running by altering the star(s) in the simulation, dragging to change orbits and obliquity, adjusting the climate simulation parameters directly or changing other properties like CO2 concentration that affect the model parameters in representative ways. Ongoing visuals of the expansion and contraction of sea ice and snow-cover respond to the temperature calculations, and make it accessible to explore a variety of scenarios and intuitive to understand the output. Variables like temperature can also be graphed in real time. We balance computational constraints with the ability to capture the physical phenomena we wish to visualize, giving everyone access to a simple open-ended meridional energy balance climate simulation to explore and experiment with. The software lends itself to labs at a variety of levels about climate concepts including seasons, the Greenhouse effect

IPS – A SYSTEM FOR REAL-TIME NAVIGATION AND 3D MODELING

Directory of Open Access Journals (Sweden)

D. Grießbach

2012-07-01

Full Text Available fdaReliable navigation and 3D modeling is a necessary requirement for any autonomous system in real world scenarios. German Aerospace Center (DLR developed a system providing precise information about local position and orientation of a mobile platform as well as three-dimensional information about its environment in real-time. This system, called Integral Positioning System (IPS can be applied for indoor environments and outdoor environments. To achieve high precision, reliability, integrity and availability a multi-sensor approach was chosen. The important role of sensor data synchronization, system calibration and spatial referencing is emphasized because the data from several sensors has to be fused using a Kalman filter. A hardware operating system (HW-OS is presented, that facilitates the low-level integration of different interfaces. The benefit of this approach is an increased precision of synchronization at the expense of additional engineering costs. It will be shown that the additional effort is leveraged by the new design concept since the HW-OS methodology allows a proven, flexible and fast design process, a high re-usability of common components and consequently a higher reliability within the low-level sensor fusion. Another main focus of the paper is on IPS software. The DLR developed, implemented and tested a flexible and extensible software concept for data grabbing, efficient data handling, data preprocessing (e.g. image rectification being essential for thematic data processing. Standard outputs of IPS are a trajectory of the moving platform and a high density 3D point cloud of the current environment. This information is provided in real-time. Based on these results, information processing on more abstract levels can be executed.

Real-time 3D vectorcardiography: an application for didactic use

International Nuclear Information System (INIS)

Daniel, G; Lissa, G; Redondo, D Medina; Vasquez, L; Zapata, D

2007-01-01

The traditional approach to teach the physiological basis of electrocardiography, based only on textbooks, turns out to be insufficient or confusing for students of biomedical sciences. The addition of laboratory practice to the curriculum enables students to approach theoretical aspects from a hands-on experience, resulting in a more efficient and deeper knowledge of the phenomena of interest. Here, we present the development of a PC-based application meant to facilitate the understanding of cardiac bioelectrical phenomena by visualizing in real time the instantaneous 3D cardiac vector. The system uses 8 standard leads from a 12-channel electrocardiograph. The application interface has pedagogic objectives, and facilitates the observation of cardiac depolarization and repolarization and its temporal relationship with the ECG, making it simpler to interpret

Real-time physics-based 3D biped character animation using an inverted pendulum model.

Science.gov (United States)

Tsai, Yao-Yang; Lin, Wen-Chieh; Cheng, Kuangyou B; Lee, Jehee; Lee, Tong-Yee

2010-01-01

We present a physics-based approach to generate 3D biped character animation that can react to dynamical environments in real time. Our approach utilizes an inverted pendulum model to online adjust the desired motion trajectory from the input motion capture data. This online adjustment produces a physically plausible motion trajectory adapted to dynamic environments, which is then used as the desired motion for the motion controllers to track in dynamics simulation. Rather than using Proportional-Derivative controllers whose parameters usually cannot be easily set, our motion tracking adopts a velocity-driven method which computes joint torques based on the desired joint angular velocities. Physically correct full-body motion of the 3D character is computed in dynamics simulation using the computed torques and dynamical model of the character. Our experiments demonstrate that tracking motion capture data with real-time response animation can be achieved easily. In addition, physically plausible motion style editing, automatic motion transition, and motion adaptation to different limb sizes can also be generated without difficulty.

Esophagogastric Junction pressure morphology: comparison between a station pull-through and real-time 3D-HRM representation.

Science.gov (United States)

Nicodème, F; Lin, Z; Pandolfino, J E; Kahrilas, P J

2013-09-01

Esophagogastric junction (EGJ) competence is the fundamental defense against reflux making it of great clinical significance. However, characterizing EGJ competence with conventional manometric methodologies has been confounded by its anatomic and physiological complexity. Recent technological advances in miniaturization and electronics have led to the development of a novel device that may overcome these challenges. Nine volunteer subjects were studied with a novel 3D-HRM device providing 7.5 mm axial and 45° radial pressure resolution within the EGJ. Real-time measurements were made at rest and compared to simulations of a conventional pull-through made with the same device. Moreover, 3D-HRM recordings were analyzed to differentiate contributing pressure signals within the EGJ attributable to lower esophageal sphincter (LES), diaphragm, and vasculature. 3D-HRM recordings suggested that sphincter length assessed by a pull-through method greatly exaggerated the estimate of LES length by failing to discriminate among circumferential contractile pressure and asymmetric extrinsic pressure signals attributable to diaphragmatic and vascular structures. Real-time 3D EGJ recordings found that the dominant constituents of EGJ pressure at rest were attributable to the diaphragm. 3D-HRM permits real-time recording of EGJ pressure morphology facilitating analysis of the EGJ constituents responsible for its function as a reflux barrier making it a promising tool in the study of GERD pathophysiology. The enhanced axial and radial recording resolution of the device should facilitate further studies to explore perturbations in the physiological constituents of EGJ pressure in health and disease. © 2013 John Wiley & Sons Ltd.

Real-time registration of 3D to 2D ultrasound images for image-guided prostate biopsy.

Science.gov (United States)

Gillies, Derek J; Gardi, Lori; De Silva, Tharindu; Zhao, Shuang-Ren; Fenster, Aaron

2017-09-01

During image-guided prostate biopsy, needles are targeted at tissues that are suspicious of cancer to obtain specimen for histological examination. Unfortunately, patient motion causes targeting errors when using an MR-transrectal ultrasound (TRUS) fusion approach to augment the conventional biopsy procedure. This study aims to develop an automatic motion correction algorithm approaching the frame rate of an ultrasound system to be used in fusion-based prostate biopsy systems. Two modes of operation have been investigated for the clinical implementation of the algorithm: motion compensation using a single user initiated correction performed prior to biopsy, and real-time continuous motion compensation performed automatically as a background process. Retrospective 2D and 3D TRUS patient images acquired prior to biopsy gun firing were registered using an intensity-based algorithm utilizing normalized cross-correlation and Powell's method for optimization. 2D and 3D images were downsampled and cropped to estimate the optimal amount of image information that would perform registrations quickly and accurately. The optimal search order during optimization was also analyzed to avoid local optima in the search space. Error in the algorithm was computed using target registration errors (TREs) from manually identified homologous fiducials in a clinical patient dataset. The algorithm was evaluated for real-time performance using the two different modes of clinical implementations by way of user initiated and continuous motion compensation methods on a tissue mimicking prostate phantom. After implementation in a TRUS-guided system with an image downsampling factor of 4, the proposed approach resulted in a mean ± std TRE and computation time of 1.6 ± 0.6 mm and 57 ± 20 ms respectively. The user initiated mode performed registrations with in-plane, out-of-plane, and roll motions computation times of 108 ± 38 ms, 60 ± 23 ms, and 89 ± 27 ms, respectively, and corresponding

3D tumor localization through real-time volumetric x-ray imaging for lung cancer radiotherapy.

Science.gov (United States)

Li, Ruijiang; Lewis, John H; Jia, Xun; Gu, Xuejun; Folkerts, Michael; Men, Chunhua; Song, William Y; Jiang, Steve B

2011-05-01

To evaluate an algorithm for real-time 3D tumor localization from a single x-ray projection image for lung cancer radiotherapy. Recently, we have developed an algorithm for reconstructing volumetric images and extracting 3D tumor motion information from a single x-ray projection [Li et al., Med. Phys. 37, 2822-2826 (2010)]. We have demonstrated its feasibility using a digital respiratory phantom with regular breathing patterns. In this work, we present a detailed description and a comprehensive evaluation of the improved algorithm. The algorithm was improved by incorporating respiratory motion prediction. The accuracy and efficiency of using this algorithm for 3D tumor localization were then evaluated on (1) a digital respiratory phantom, (2) a physical respiratory phantom, and (3) five lung cancer patients. These evaluation cases include both regular and irregular breathing patterns that are different from the training dataset. For the digital respiratory phantom with regular and irregular breathing, the average 3D tumor localization error is less than 1 mm which does not seem to be affected by amplitude change, period change, or baseline shift. On an NVIDIA Tesla C1060 graphic processing unit (GPU) card, the average computation time for 3D tumor localization from each projection ranges between 0.19 and 0.26 s, for both regular and irregular breathing, which is about a 10% improvement over previously reported results. For the physical respiratory phantom, an average tumor localization error below 1 mm was achieved with an average computation time of 0.13 and 0.16 s on the same graphic processing unit (GPU) card, for regular and irregular breathing, respectively. For the five lung cancer patients, the average tumor localization error is below 2 mm in both the axial and tangential directions. The average computation time on the same GPU card ranges between 0.26 and 0.34 s. Through a comprehensive evaluation of our algorithm, we have established its accuracy in 3D

Real-time 3D human capture system for mixed-reality art and entertainment.

Science.gov (United States)

Nguyen, Ta Huynh Duy; Qui, Tran Cong Thien; Xu, Ke; Cheok, Adrian David; Teo, Sze Lee; Zhou, ZhiYing; Mallawaarachchi, Asitha; Lee, Shang Ping; Liu, Wei; Teo, Hui Siang; Thang, Le Nam; Li, Yu; Kato, Hirokazu

2005-01-01

A real-time system for capturing humans in 3D and placing them into a mixed reality environment is presented in this paper. The subject is captured by nine cameras surrounding her. Looking through a head-mounted-display with a camera in front pointing at a marker, the user can see the 3D image of this subject overlaid onto a mixed reality scene. The 3D images of the subject viewed from this viewpoint are constructed using a robust and fast shape-from-silhouette algorithm. The paper also presents several techniques to produce good quality and speed up the whole system. The frame rate of our system is around 25 fps using only standard Intel processor-based personal computers. Besides a remote live 3D conferencing and collaborating system, we also describe an application of the system in art and entertainment, named Magic Land, which is a mixed reality environment where captured avatars of human and 3D computer generated virtual animations can form an interactive story and play with each other. This system demonstrates many technologies in human computer interaction: mixed reality, tangible interaction, and 3D communication. The result of the user study not only emphasizes the benefits, but also addresses some issues of these technologies.

3D-SURFER 2.0: web platform for real-time search and characterization of protein surfaces.

Science.gov (United States)

Xiong, Yi; Esquivel-Rodriguez, Juan; Sael, Lee; Kihara, Daisuke

2014-01-01

The increasing number of uncharacterized protein structures necessitates the development of computational approaches for function annotation using the protein tertiary structures. Protein structure database search is the basis of any structure-based functional elucidation of proteins. 3D-SURFER is a web platform for real-time protein surface comparison of a given protein structure against the entire PDB using 3D Zernike descriptors. It can smoothly navigate the protein structure space in real-time from one query structure to another. A major new feature of Release 2.0 is the ability to compare the protein surface of a single chain, a single domain, or a single complex against databases of protein chains, domains, complexes, or a combination of all three in the latest PDB. Additionally, two types of protein structures can now be compared: all-atom-surface and backbone-atom-surface. The server can also accept a batch job for a large number of database searches. Pockets in protein surfaces can be identified by VisGrid and LIGSITE (csc) . The server is available at http://kiharalab.org/3d-surfer/.

High-accuracy and real-time 3D positioning, tracking system for medical imaging applications based on 3D digital image correlation

Science.gov (United States)

Xue, Yuan; Cheng, Teng; Xu, Xiaohai; Gao, Zeren; Li, Qianqian; Liu, Xiaojing; Wang, Xing; Song, Rui; Ju, Xiangyang; Zhang, Qingchuan

2017-01-01

This paper presents a system for positioning markers and tracking the pose of a rigid object with 6 degrees of freedom in real-time using 3D digital image correlation, with two examples for medical imaging applications. Traditional DIC method was improved to meet the requirements of the real-time by simplifying the computations of integral pixel search. Experiments were carried out and the results indicated that the new method improved the computational efficiency by about 4-10 times in comparison with the traditional DIC method. The system was aimed for orthognathic surgery navigation in order to track the maxilla segment after LeFort I osteotomy. Experiments showed noise for the static point was at the level of 10-3 mm and the measurement accuracy was 0.009 mm. The system was demonstrated on skin surface shape evaluation of a hand for finger stretching exercises, which indicated a great potential on tracking muscle and skin movements.

Learning dictionaries of sparse codes of 3D movements of body joints for real-time human activity understanding.

Science.gov (United States)

Qi, Jin; Yang, Zhiyong

2014-01-01

Real-time human activity recognition is essential for human-robot interactions for assisted healthy independent living. Most previous work in this area is performed on traditional two-dimensional (2D) videos and both global and local methods have been used. Since 2D videos are sensitive to changes of lighting condition, view angle, and scale, researchers begun to explore applications of 3D information in human activity understanding in recently years. Unfortunately, features that work well on 2D videos usually don't perform well on 3D videos and there is no consensus on what 3D features should be used. Here we propose a model of human activity recognition based on 3D movements of body joints. Our method has three steps, learning dictionaries of sparse codes of 3D movements of joints, sparse coding, and classification. In the first step, space-time volumes of 3D movements of body joints are obtained via dense sampling and independent component analysis is then performed to construct a dictionary of sparse codes for each activity. In the second step, the space-time volumes are projected to the dictionaries and a set of sparse histograms of the projection coefficients are constructed as feature representations of the activities. Finally, the sparse histograms are used as inputs to a support vector machine to recognize human activities. We tested this model on three databases of human activities and found that it outperforms the state-of-the-art algorithms. Thus, this model can be used for real-time human activity recognition in many applications.

Learning dictionaries of sparse codes of 3D movements of body joints for real-time human activity understanding.

Directory of Open Access Journals (Sweden)

Jin Qi

Full Text Available Real-time human activity recognition is essential for human-robot interactions for assisted healthy independent living. Most previous work in this area is performed on traditional two-dimensional (2D videos and both global and local methods have been used. Since 2D videos are sensitive to changes of lighting condition, view angle, and scale, researchers begun to explore applications of 3D information in human activity understanding in recently years. Unfortunately, features that work well on 2D videos usually don't perform well on 3D videos and there is no consensus on what 3D features should be used. Here we propose a model of human activity recognition based on 3D movements of body joints. Our method has three steps, learning dictionaries of sparse codes of 3D movements of joints, sparse coding, and classification. In the first step, space-time volumes of 3D movements of body joints are obtained via dense sampling and independent component analysis is then performed to construct a dictionary of sparse codes for each activity. In the second step, the space-time volumes are projected to the dictionaries and a set of sparse histograms of the projection coefficients are constructed as feature representations of the activities. Finally, the sparse histograms are used as inputs to a support vector machine to recognize human activities. We tested this model on three databases of human activities and found that it outperforms the state-of-the-art algorithms. Thus, this model can be used for real-time human activity recognition in many applications.

Contrast-enhanced MR angiography of the carotid artery using 3D time-resolved imaging of contrast kinetics. Comparison with real-time fluoroscopic triggered 3D-elliptical centric view ordering

International Nuclear Information System (INIS)

Naganawa, Shinji; Koshikawa, Tokiko; Fukatsu, Hiroshi; Sakurai, Yasuo; Ishiguchi, Tsuneo; Ishigaki, Takeo; Ichinose, Nobuyasu

2001-01-01

The purpose of this study was to evaluate contrast-enhanced MR angiography using the 3D time-resolved imaging of contrast kinetics technique (3D-TRICKS) by direct comparison with the fluoroscopic triggered 3D-elliptical centric view ordering (3D-ELLIP) technique. 3D-TRICKS and 3D-ELLIP were directly compared on a 1.5-Tesla MR unit using the same spatial resolution and matrix. In 3D-TRICKS, the central part of the k-space is updated more frequently than the peripheral part of the k-space, which is divided in the slice-encoding direction. The carotid arteries were imaged using 3D-TRICKS and 3D-ELLIP sequentially in 14 patients. Temporal resolution was 12 sec for 3D-ELLIP and 6 sec for 3D-TRICKS. The signal-to-noise ratio (S/N) of the common carotid artery was measured, and the quality of MIP images was then scored in terms of venous overlap and blurring of vessel contours. No significant difference in mean S/N was seen between the two methods. Significant venous overlap was not seen in any of the patients examined. Moderate blurring of vessel contours was noted on 3D-TRICKS in five patients and on 3D-ELLIP in four patients. Blurring in the slice-encoding direction was slightly more pronounced in 3D-TRICKS. However, qualitative analysis scores showed no significant differences. When the spatial resolution of the two methods was identical, the performance of 3D-TRICKS was found to be comparable in static visualization of the carotid arteries with 3D-ELLIP, although blurring in the slice-encoding direction was slightly more pronounced in 3D-TRICKS. 3D-TRICKS is a more robust technique than 3D-ELLIP, because 3D-ELLIP requires operator-dependent fluoroscopic triggering. Furthermore, 3D-TRICKS can achieve higher temporal resolution. For the spatial resolution employed in this study, 3D-TRICKS may be the method of choice. (author)

Optimal transcostal high-intensity focused ultrasound with combined real-time 3D movement tracking and correction

International Nuclear Information System (INIS)

Marquet, F; Aubry, J F; Pernot, M; Fink, M; Tanter, M

2011-01-01

Recent studies have demonstrated the feasibility of transcostal high intensity focused ultrasound (HIFU) treatment in liver. However, two factors limit thermal necrosis of the liver through the ribs: the energy deposition at focus is decreased by the respiratory movement of the liver and the energy deposition on the skin is increased by the presence of highly absorbing bone structures. Ex vivo ablations were conducted to validate the feasibility of a transcostal real-time 3D movement tracking and correction mode. Experiments were conducted through a chest phantom made of three human ribs immersed in water and were placed in front of a 300 element array working at 1 MHz. A binarized apodization law introduced recently in order to spare the rib cage during treatment has been extended here with real-time electronic steering of the beam. Thermal simulations have been conducted to determine the steering limits. In vivo 3D-movement detection was performed on pigs using an ultrasonic sequence. The maximum error on the transcostal motion detection was measured to be 0.09 ± 0.097 mm on the anterior–posterior axis. Finally, a complete sequence was developed combining real-time 3D transcostal movement correction and spiral trajectory of the HIFU beam, allowing the system to treat larger areas with optimized efficiency. Lesions as large as 1 cm in diameter have been produced at focus in excised liver, whereas no necroses could be obtained with the same emitted power without correcting the movement of the tissue sample.

2.5D real waveform and real noise simulation of receiver functions in 3D models

Science.gov (United States)

Schiffer, Christian; Jacobsen, Bo; Balling, Niels

2014-05-01

There are several reasons why a real-data receiver function differs from the theoretical receiver function in a 1D model representing the stratification under the seismometer. Main reasons are ambient noise, spectral deficiencies in the impinging P-waveform, and wavefield propagation in laterally varying velocity variations. We present a rapid "2.5D" modelling approach which takes these aspects into account, so that a given 3D velocity model of the crust and uppermost mantle can be tested more realistically against observed recordings from seismometer arrays. Each recorded event at each seismometer is simulated individually through the following steps: A 2D section is extracted from the 3D model along the direction towards the hypocentre. A properly slanted plane or curved impulsive wavefront is propagated through this 2D section, resulting in noise free and spectrally complete synthetic seismometer data. The real vertical component signal is taken as a proxy of the real impingent wavefield, so by convolution and subsequent addition of real ambient noise recorded just before the P-arrival we get synthetic vertical and horizontal component data which very closely match the spectral signal content and signal to noise ratio of this specific recording. When these realistic synthetic data undergo exactly the same receiver function estimation and subsequent graphical display we get a much more realistic image to compare to the real-data receiver functions. We applied this approach to the Central Fjord area in East Greenland (Schiffer et al., 2013), where a 3D velocity model of crust and uppermost mantle was adjusted to receiver functions from 2 years of seismometer recordings and wide angle crustal profiles (Schlindwein and Jokat, 1999; Voss and Jokat, 2007). Computationally this substitutes tens or hundreds of heavy 3D computations with hundreds or thousands of single-core 2D computations which parallelize very efficiently on common multicore systems. In perspective

The Value of 3D Printing Models of Left Atrial Appendage Using Real-Time 3D Transesophageal Echocardiographic Data in Left Atrial Appendage Occlusion: Applications toward an Era of Truly Personalized Medicine.

Science.gov (United States)

Liu, Peng; Liu, Rijing; Zhang, Yan; Liu, Yingfeng; Tang, Xiaoming; Cheng, Yanzhen

The objective of this study was to assess the clinical feasibility of generating 3D printing models of left atrial appendage (LAA) using real-time 3D transesophageal echocardiogram (TEE) data for preoperative reference of LAA occlusion. Percutaneous LAA occlusion can effectively prevent patients with atrial fibrillation from stroke. However, the anatomical structure of LAA is so complicated that adequate information of its structure is essential for successful LAA occlusion. Emerging 3D printing technology has the demonstrated potential to structure more accurately than conventional imaging modalities by creating tangible patient-specific models. Typically, 3D printing data sets are acquired from CT and MRI, which may involve intravenous contrast, sedation, and ionizing radiation. It has been reported that 3D models of LAA were successfully created by the data acquired from CT. However, 3D printing of the LAA using real-time 3D TEE data has not yet been explored. Acquisition of 3D transesophageal echocardiographic data from 8 patients with atrial fibrillation was performed using the Philips EPIQ7 ultrasound system. Raw echocardiographic image data were opened in Philips QLAB and converted to 'Cartesian DICOM' format and imported into Mimics® software to create 3D models of LAA, which were printed using a rubber-like material. The printed 3D models were then used for preoperative reference and procedural simulation in LAA occlusion. We successfully printed LAAs of 8 patients. Each LAA costs approximately CNY 800-1,000 and the total process takes 16-17 h. Seven of the 8 Watchman devices predicted by preprocedural 2D TEE images were of the same sizes as those placed in the real operation. Interestingly, 3D printing models were highly reflective of the shape and size of LAAs, and all device sizes predicted by the 3D printing model were fully consistent with those placed in the real operation. Also, the 3D printed model could predict operating difficulty and the

Review of Real-Time 3-Dimensional Image Guided Radiation Therapy on Standard-Equipped Cancer Radiation Therapy Systems: Are We at the Tipping Point for the Era of Real-Time Radiation Therapy?

Science.gov (United States)

Keall, Paul J; Nguyen, Doan Trang; O'Brien, Ricky; Zhang, Pengpeng; Happersett, Laura; Bertholet, Jenny; Poulsen, Per R

2018-04-14

To review real-time 3-dimensional (3D) image guided radiation therapy (IGRT) on standard-equipped cancer radiation therapy systems, focusing on clinically implemented solutions. Three groups in 3 continents have clinically implemented novel real-time 3D IGRT solutions on standard-equipped linear accelerators. These technologies encompass kilovoltage, combined megavoltage-kilovoltage, and combined kilovoltage-optical imaging. The cancer sites treated span pelvic and abdominal tumors for which respiratory motion is present. For each method the 3D-measured motion during treatment is reported. After treatment, dose reconstruction was used to assess the treatment quality in the presence of motion with and without real-time 3D IGRT. The geometric accuracy was quantified through phantom experiments. A literature search was conducted to identify additional real-time 3D IGRT methods that could be clinically implemented in the near future. The real-time 3D IGRT methods were successfully clinically implemented and have been used to treat more than 200 patients. Systematic target position shifts were observed using all 3 methods. Dose reconstruction demonstrated that the delivered dose is closer to the planned dose with real-time 3D IGRT than without real-time 3D IGRT. In addition, compromised target dose coverage and variable normal tissue doses were found without real-time 3D IGRT. The geometric accuracy results with real-time 3D IGRT had a mean error of real-time 3D IGRT methods using standard-equipped radiation therapy systems that could also be clinically implemented. Multiple clinical implementations of real-time 3D IGRT on standard-equipped cancer radiation therapy systems have been demonstrated. Many more approaches that could be implemented were identified. These solutions provide a pathway for the broader adoption of methods to make radiation therapy more accurate, impacting tumor and normal tissue dose, margins, and ultimately patient outcomes. Copyright © 2018

Real time 3D photometry

Science.gov (United States)

Fernandez-Balbuena, A. A.; Vazquez-Molini, D.; García-Botella, A.; Romo, J.; Serrano, Ana

2017-09-01

The photometry and radiometry measurement is a well-developed field. The necessity of measuring optical systems performance involves the use of several techniques like Gonio-photometry. The Gonio photometers are a precise measurement tool that is used in the lighting area like office, luminaire head car lighting, concentrator /collimator measurement and all the designed and fabricated optical systems that works with light. There is one disadvantage in this kind of measurements that obtain the intensity polar curves and the total flux of the optical system. In the industry, there are good Gonio photometers that are precise and reliable but they are very expensive and the measurement time is long. In industry the cost can be of minor importance but measuring time that is around 30 minutes is of major importance due to trained staff cost. We have designed a system to measure photometry in real time; it consists in a curved screen to get a huge measurement angle and a CCD. The system to be measured projects light onto the screen and the CCD records a video of the screen obtaining an image of the projected profile. A complex calibration permits to trace screen data (x,y,z) to intensity polar curve (I,αγ). This intensity is obtained in candels (cd) with an image + processing time below one second.

Synchronized 2D/3D optical mapping for interactive exploration and real-time visualization of multi-function neurological images.

Science.gov (United States)

Zhang, Qi; Alexander, Murray; Ryner, Lawrence

2013-01-01

Efficient software with the ability to display multiple neurological image datasets simultaneously with full real-time interactivity is critical for brain disease diagnosis and image-guided planning. In this paper, we describe the creation and function of a new comprehensive software platform that integrates novel algorithms and functions for multiple medical image visualization, processing, and manipulation. We implement an opacity-adjustment algorithm to build 2D lookup tables for multiple slice image display and fusion, which achieves a better visual result than those of using VTK-based methods. We also develop a new real-time 2D and 3D data synchronization scheme for multi-function MR volume and slice image optical mapping and rendering simultaneously through using the same adjustment operation. All these methodologies are integrated into our software framework to provide users with an efficient tool for flexibly, intuitively, and rapidly exploring and analyzing the functional and anatomical MR neurological data. Finally, we validate our new techniques and software platform with visual analysis and task-specific user studies. Copyright © 2013 Elsevier Ltd. All rights reserved.

GPU acceleration towards real-time image reconstruction in 3D tomographic diffractive microscopy

Science.gov (United States)

Bailleul, J.; Simon, B.; Debailleul, M.; Liu, H.; Haeberlé, O.

2012-06-01

Phase microscopy techniques regained interest in allowing for the observation of unprepared specimens with excellent temporal resolution. Tomographic diffractive microscopy is an extension of holographic microscopy which permits 3D observations with a finer resolution than incoherent light microscopes. Specimens are imaged by a series of 2D holograms: their accumulation progressively fills the range of frequencies of the specimen in Fourier space. A 3D inverse FFT eventually provides a spatial image of the specimen. Consequently, acquisition then reconstruction are mandatory to produce an image that could prelude real-time control of the observed specimen. The MIPS Laboratory has built a tomographic diffractive microscope with an unsurpassed 130nm resolution but a low imaging speed - no less than one minute. Afterwards, a high-end PC reconstructs the 3D image in 20 seconds. We now expect an interactive system providing preview images during the acquisition for monitoring purposes. We first present a prototype implementing this solution on CPU: acquisition and reconstruction are tied in a producer-consumer scheme, sharing common data into CPU memory. Then we present a prototype dispatching some reconstruction tasks to GPU in order to take advantage of SIMDparallelization for FFT and higher bandwidth for filtering operations. The CPU scheme takes 6 seconds for a 3D image update while the GPU scheme can go down to 2 or > 1 seconds depending on the GPU class. This opens opportunities for 4D imaging of living organisms or crystallization processes. We also consider the relevance of GPU for 3D image interaction in our specific conditions.

Synthetic biology's tall order: Reconstruction of 3D, super resolution images of single molecules in real-time

CSIR Research Space (South Africa)

Henriques, R

2010-08-31

Full Text Available -to-use reconstruction software coupled with image acquisition. Here, we present QuickPALM, an Image plugin, enabling real-time reconstruction of 3D super-resolution images during acquisition and drift correction. We illustrate its application by reconstructing Cy5...

3D Printed "Earable" Smart Devices for Real-Time Detection of Core Body Temperature.

Science.gov (United States)

Ota, Hiroki; Chao, Minghan; Gao, Yuji; Wu, Eric; Tai, Li-Chia; Chen, Kevin; Matsuoka, Yasutomo; Iwai, Kosuke; Fahad, Hossain M; Gao, Wei; Nyein, Hnin Yin Yin; Lin, Liwei; Javey, Ali

2017-07-28

Real-time detection of basic physiological parameters such as blood pressure and heart rate is an important target in wearable smart devices for healthcare. Among these, the core body temperature is one of the most important basic medical indicators of fever, insomnia, fatigue, metabolic functionality, and depression. However, traditional wearable temperature sensors are based upon the measurement of skin temperature, which can vary dramatically from the true core body temperature. Here, we demonstrate a three-dimensional (3D) printed wearable "earable" smart device that is designed to be worn on the ear to track core body temperature from the tympanic membrane (i.e., ear drum) based on an infrared sensor. The device is fully integrated with data processing circuits and a wireless module for standalone functionality. Using this smart earable device, we demonstrate that the core body temperature can be accurately monitored regardless of the environment and activity of the user. In addition, a microphone and actuator are also integrated so that the device can also function as a bone conduction hearing aid. Using 3D printing as the fabrication method enables the device to be customized for the wearer for more personalized healthcare. This smart device provides an important advance in realizing personalized health care by enabling real-time monitoring of one of the most important medical parameters, core body temperature, employed in preliminary medical screening tests.

Three-dimensional liver motion tracking using real-time two-dimensional MRI.

Science.gov (United States)

Brix, Lau; Ringgaard, Steffen; Sørensen, Thomas Sangild; Poulsen, Per Rugaard

2014-04-01

Combined magnetic resonance imaging (MRI) systems and linear accelerators for radiotherapy (MR-Linacs) are currently under development. MRI is noninvasive and nonionizing and can produce images with high soft tissue contrast. However, new tracking methods are required to obtain fast real-time spatial target localization. This study develops and evaluates a method for tracking three-dimensional (3D) respiratory liver motion in two-dimensional (2D) real-time MRI image series with high temporal and spatial resolution. The proposed method for 3D tracking in 2D real-time MRI series has three steps: (1) Recording of a 3D MRI scan and selection of a blood vessel (or tumor) structure to be tracked in subsequent 2D MRI series. (2) Generation of a library of 2D image templates oriented parallel to the 2D MRI image series by reslicing and resampling the 3D MRI scan. (3) 3D tracking of the selected structure in each real-time 2D image by finding the template and template position that yield the highest normalized cross correlation coefficient with the image. Since the tracked structure has a known 3D position relative to each template, the selection and 2D localization of a specific template translates into quantification of both the through-plane and in-plane position of the structure. As a proof of principle, 3D tracking of liver blood vessel structures was performed in five healthy volunteers in two 5.4 Hz axial, sagittal, and coronal real-time 2D MRI series of 30 s duration. In each 2D MRI series, the 3D localization was carried out twice, using nonoverlapping template libraries, which resulted in a total of 12 estimated 3D trajectories per volunteer. Validation tests carried out to support the tracking algorithm included quantification of the breathing induced 3D liver motion and liver motion directionality for the volunteers, and comparison of 2D MRI estimated positions of a structure in a watermelon with the actual positions. Axial, sagittal, and coronal 2D MRI series

Three-dimensional liver motion tracking using real-time two-dimensional MRI

Energy Technology Data Exchange (ETDEWEB)

Brix, Lau, E-mail: lau.brix@stab.rm.dk [Department of Procurement and Clinical Engineering, Region Midt, Olof Palmes Allé 15, 8200 Aarhus N, Denmark and MR Research Centre, Aarhus University Hospital, Skejby, Brendstrupgaardsvej 100, 8200 Aarhus N (Denmark); Ringgaard, Steffen [MR Research Centre, Aarhus University Hospital, Skejby, Brendstrupgaardsvej 100, 8200 Aarhus N (Denmark); Sørensen, Thomas Sangild [Department of Computer Science, Aarhus University, Aabogade 34, 8200 Aarhus N, Denmark and Department of Clinical Medicine, Aarhus University, Brendstrupgaardsvej 100, 8200 Aarhus N (Denmark); Poulsen, Per Rugaard [Department of Clinical Medicine, Aarhus University, Brendstrupgaardsvej 100, 8200 Aarhus N, Denmark and Department of Oncology, Aarhus University Hospital, Nørrebrogade 44, 8000 Aarhus C (Denmark)

2014-04-15

Purpose: Combined magnetic resonance imaging (MRI) systems and linear accelerators for radiotherapy (MR-Linacs) are currently under development. MRI is noninvasive and nonionizing and can produce images with high soft tissue contrast. However, new tracking methods are required to obtain fast real-time spatial target localization. This study develops and evaluates a method for tracking three-dimensional (3D) respiratory liver motion in two-dimensional (2D) real-time MRI image series with high temporal and spatial resolution. Methods: The proposed method for 3D tracking in 2D real-time MRI series has three steps: (1) Recording of a 3D MRI scan and selection of a blood vessel (or tumor) structure to be tracked in subsequent 2D MRI series. (2) Generation of a library of 2D image templates oriented parallel to the 2D MRI image series by reslicing and resampling the 3D MRI scan. (3) 3D tracking of the selected structure in each real-time 2D image by finding the template and template position that yield the highest normalized cross correlation coefficient with the image. Since the tracked structure has a known 3D position relative to each template, the selection and 2D localization of a specific template translates into quantification of both the through-plane and in-plane position of the structure. As a proof of principle, 3D tracking of liver blood vessel structures was performed in five healthy volunteers in two 5.4 Hz axial, sagittal, and coronal real-time 2D MRI series of 30 s duration. In each 2D MRI series, the 3D localization was carried out twice, using nonoverlapping template libraries, which resulted in a total of 12 estimated 3D trajectories per volunteer. Validation tests carried out to support the tracking algorithm included quantification of the breathing induced 3D liver motion and liver motion directionality for the volunteers, and comparison of 2D MRI estimated positions of a structure in a watermelon with the actual positions. Results: Axial, sagittal

Three-dimensional liver motion tracking using real-time two-dimensional MRI

International Nuclear Information System (INIS)

Brix, Lau; Ringgaard, Steffen; Sørensen, Thomas Sangild; Poulsen, Per Rugaard

2014-01-01

Purpose: Combined magnetic resonance imaging (MRI) systems and linear accelerators for radiotherapy (MR-Linacs) are currently under development. MRI is noninvasive and nonionizing and can produce images with high soft tissue contrast. However, new tracking methods are required to obtain fast real-time spatial target localization. This study develops and evaluates a method for tracking three-dimensional (3D) respiratory liver motion in two-dimensional (2D) real-time MRI image series with high temporal and spatial resolution. Methods: The proposed method for 3D tracking in 2D real-time MRI series has three steps: (1) Recording of a 3D MRI scan and selection of a blood vessel (or tumor) structure to be tracked in subsequent 2D MRI series. (2) Generation of a library of 2D image templates oriented parallel to the 2D MRI image series by reslicing and resampling the 3D MRI scan. (3) 3D tracking of the selected structure in each real-time 2D image by finding the template and template position that yield the highest normalized cross correlation coefficient with the image. Since the tracked structure has a known 3D position relative to each template, the selection and 2D localization of a specific template translates into quantification of both the through-plane and in-plane position of the structure. As a proof of principle, 3D tracking of liver blood vessel structures was performed in five healthy volunteers in two 5.4 Hz axial, sagittal, and coronal real-time 2D MRI series of 30 s duration. In each 2D MRI series, the 3D localization was carried out twice, using nonoverlapping template libraries, which resulted in a total of 12 estimated 3D trajectories per volunteer. Validation tests carried out to support the tracking algorithm included quantification of the breathing induced 3D liver motion and liver motion directionality for the volunteers, and comparison of 2D MRI estimated positions of a structure in a watermelon with the actual positions. Results: Axial, sagittal

Accuracy of Real-time Couch Tracking During 3-dimensional Conformal Radiation Therapy, Intensity Modulated Radiation Therapy, and Volumetric Modulated Arc Therapy for Prostate Cancer

International Nuclear Information System (INIS)

Wilbert, Juergen; Baier, Kurt; Hermann, Christian; Flentje, Michael; Guckenberger, Matthias

2013-01-01

Purpose: To evaluate the accuracy of real-time couch tracking for prostate cancer. Methods and Materials: Intrafractional motion trajectories of 15 prostate cancer patients were the basis for this phantom study; prostate motion had been monitored with the Calypso System. An industrial robot moved a phantom along these trajectories, motion was detected via an infrared camera system, and the robotic HexaPOD couch was used for real-time counter-steering. Residual phantom motion during real-time tracking was measured with the infrared camera system. Film dosimetry was performed during delivery of 3-dimensional conformal radiation therapy (3D-CRT), step-and-shoot intensity modulated radiation therapy (IMRT), and volumetric modulated arc therapy (VMAT). Results: Motion of the prostate was largest in the anterior–posterior direction, with systematic (∑) and random (σ) errors of 2.3 mm and 2.9 mm, respectively; the prostate was outside a threshold of 5 mm (3D vector) for 25.0%±19.8% of treatment time. Real-time tracking reduced prostate motion to ∑=0.01 mm and σ = 0.55 mm in the anterior–posterior direction; the prostate remained within a 1-mm and 5-mm threshold for 93.9%±4.6% and 99.7%±0.4% of the time, respectively. Without real-time tracking, pass rates based on a γ index of 2%/2 mm in film dosimetry ranged between 66% and 72% for 3D-CRT, IMRT, and VMAT, on average. Real-time tracking increased pass rates to minimum 98% on average for 3D-CRT, IMRT, and VMAT. Conclusions: Real-time couch tracking resulted in submillimeter accuracy for prostate cancer, which transferred into high dosimetric accuracy independently of whether 3D-CRT, IMRT, or VMAT was used.

Evaluation of accuracy about 2D vs 3D real-time position management system based on couch rotation when non-coplanar respiratory gated radiation therapy

International Nuclear Information System (INIS)

Kwon, Kyung Tae; Kim, Jung Soo; Sim, Hyun Sun; Min, Jung Whan; Son, Soon Yong; Han, Dong Kyoon

2016-01-01

Because of non-coplanar therapy with couch rotation in respiratory gated radiation therapy, the recognition of marker movement due to the change in the distance between the infrared camera and the marker due to the rotation of the couch is called RPM (Real-time The purpose of this paper is to evaluate the accuracy of motion reflections (baseline changes) of 2D gating configuration (two dot marker block) and 3D gating configuration (six dot marker block). The motion was measured by varying the couch angle in the clockwise and counterclockwise directions by 10° in the 2D gating configuration. In the 3D gating configuration, the couch angle was changed by 10° in the clockwise direction and compared with the baseline at the reference 0°. The reference amplitude was 1.173 to 1.165, the couch angle at 20° was 1.132, and the couch angle at 1.0° was 1.083. At 350° counterclockwise, the reference amplitude was 1.168 to 1.157, the couch angle at 340° was 1.124, and the couch angle at 330° was 1.079. In this study, the phantom is used to quantitatively evaluate the value of the amplitude according to couch change

Evaluation of accuracy about 2D vs 3D real-time position management system based on couch rotation when non-coplanar respiratory gated radiation therapy

Energy Technology Data Exchange (ETDEWEB)

Kwon, Kyung Tae; Kim, Jung Soo [Dongnam Health University, Suwon (Korea, Republic of); Sim, Hyun Sun [College of Health Sciences, Korea University, Seoul (Korea, Republic of); Min, Jung Whan [Shingu University College, Sungnam (Korea, Republic of); Son, Soon Yong [Wonkwang Health Science University, Iksan (Korea, Republic of); Han, Dong Kyoon [College of Health Sciences, EulJi University, Daejeon (Korea, Republic of)

2016-12-15

Because of non-coplanar therapy with couch rotation in respiratory gated radiation therapy, the recognition of marker movement due to the change in the distance between the infrared camera and the marker due to the rotation of the couch is called RPM (Real-time The purpose of this paper is to evaluate the accuracy of motion reflections (baseline changes) of 2D gating configuration (two dot marker block) and 3D gating configuration (six dot marker block). The motion was measured by varying the couch angle in the clockwise and counterclockwise directions by 10° in the 2D gating configuration. In the 3D gating configuration, the couch angle was changed by 10° in the clockwise direction and compared with the baseline at the reference 0°. The reference amplitude was 1.173 to 1.165, the couch angle at 20° was 1.132, and the couch angle at 1.0° was 1.083. At 350° counterclockwise, the reference amplitude was 1.168 to 1.157, the couch angle at 340° was 1.124, and the couch angle at 330° was 1.079. In this study, the phantom is used to quantitatively evaluate the value of the amplitude according to couch change.

Portable high-intensity focused ultrasound system with 3D electronic steering, real-time cavitation monitoring, and 3D image reconstruction algorithms: a preclinical study in pigs

International Nuclear Information System (INIS)

Choi, Jin Woo; Lee, Jae Young; Hwang, Eui Jin; Hwang, In Pyeong; Woo, Sung Min; Lee, Chang Joo; Park, Eun Joo; Choi, Byung Ihn

2014-01-01

The aim of this study was to evaluate the safety and accuracy of a new portable ultrasonography-guided high-intensity focused ultrasound (USg-HIFU) system with a 3-dimensional (3D) electronic steering transducer, a simultaneous ablation and imaging module, real-time cavitation monitoring, and 3D image reconstruction algorithms. To address the accuracy of the transducer, hydrophones in a water chamber were used to assess the generation of sonic fields. An animal study was also performed in five pigs by ablating in vivo thighs by single-point sonication (n=10) or volume sonication (n=10) and ex vivo kidneys by single-point sonication (n=10). Histological and statistical analyses were performed. In the hydrophone study, peak voltages were detected within 1.0 mm from the targets on the y- and z-axes and within 2.0-mm intervals along the x-axis (z-axis, direction of ultrasound propagation; y- and x-axes, perpendicular to the direction of ultrasound propagation). Twenty-nine of 30 HIFU sessions successfully created ablations at the target. The in vivo porcine thigh study showed only a small discrepancy (width, 0.5-1.1 mm; length, 3.0 mm) between the planning ultrasonograms and the pathological specimens. Inordinate thermal damage was not observed in the adjacent tissues or sonic pathways in the in vivo thigh and ex vivo kidney studies. Our study suggests that this new USg-HIFU system may be a safe and accurate technique for ablating soft tissues and encapsulated organs.

Portable high-intensity focused ultrasound system with 3D electronic steering, real-time cavitation monitoring, and 3D image reconstruction algorithms: a preclinical study in pigs

Energy Technology Data Exchange (ETDEWEB)

Choi, Jin Woo; Lee, Jae Young; Hwang, Eui Jin; Hwang, In Pyeong; Woo, Sung Min; Lee, Chang Joo; Park, Eun Joo; Choi, Byung Ihn [Dept. of Radiology and Institute of Radiation Medicine, Seoul National University Hospital, Seoul (Korea, Republic of)

2014-10-15

The aim of this study was to evaluate the safety and accuracy of a new portable ultrasonography-guided high-intensity focused ultrasound (USg-HIFU) system with a 3-dimensional (3D) electronic steering transducer, a simultaneous ablation and imaging module, real-time cavitation monitoring, and 3D image reconstruction algorithms. To address the accuracy of the transducer, hydrophones in a water chamber were used to assess the generation of sonic fields. An animal study was also performed in five pigs by ablating in vivo thighs by single-point sonication (n=10) or volume sonication (n=10) and ex vivo kidneys by single-point sonication (n=10). Histological and statistical analyses were performed. In the hydrophone study, peak voltages were detected within 1.0 mm from the targets on the y- and z-axes and within 2.0-mm intervals along the x-axis (z-axis, direction of ultrasound propagation; y- and x-axes, perpendicular to the direction of ultrasound propagation). Twenty-nine of 30 HIFU sessions successfully created ablations at the target. The in vivo porcine thigh study showed only a small discrepancy (width, 0.5-1.1 mm; length, 3.0 mm) between the planning ultrasonograms and the pathological specimens. Inordinate thermal damage was not observed in the adjacent tissues or sonic pathways in the in vivo thigh and ex vivo kidney studies. Our study suggests that this new USg-HIFU system may be a safe and accurate technique for ablating soft tissues and encapsulated organs.

Real-time interactive 3D manipulation of particles viewed in two orthogonal observation planes

DEFF Research Database (Denmark)

Perch-Nielsen, I.; Rodrigo, P.J.; Glückstad, J.

2005-01-01

The generalized phase contrast (GPC) method has been applied to transform a single TEM00 beam into a manifold of counterpropagating-beam traps capable of real-time interactive manipulation of multiple microparticles in three dimensions (3D). This paper reports on the use of low numerical aperture...... for imaging through each of the two opposing objective lenses. As a consequence of the large working distance, simultaneous monitoring of the trapped particles in a second orthogonal observation plane is demonstrated. (C) 2005 Optical Society of America....

4D Near Real-Time Environmental Monitoring Using Highly Temporal LiDAR

Science.gov (United States)

Höfle, Bernhard; Canli, Ekrem; Schmitz, Evelyn; Crommelinck, Sophie; Hoffmeister, Dirk; Glade, Thomas

2016-04-01

The last decade has witnessed extensive applications of 3D environmental monitoring with the LiDAR technology, also referred to as laser scanning. Although several automatic methods were developed to extract environmental parameters from LiDAR point clouds, only little research has focused on highly multitemporal near real-time LiDAR (4D-LiDAR) for environmental monitoring. Large potential of applying 4D-LiDAR is given for landscape objects with high and varying rates of change (e.g. plant growth) and also for phenomena with sudden unpredictable changes (e.g. geomorphological processes). In this presentation we will report on the most recent findings of the research projects 4DEMON (http://uni-heidelberg.de/4demon) and NoeSLIDE (https://geomorph.univie.ac.at/forschung/projekte/aktuell/noeslide/). The method development in both projects is based on two real-world use cases: i) Surface parameter derivation of agricultural crops (e.g. crop height) and ii) change detection of landslides. Both projects exploit the "full history" contained in the LiDAR point cloud time series. One crucial initial step of 4D-LiDAR analysis is the co-registration over time, 3D-georeferencing and time-dependent quality assessment of the LiDAR point cloud time series. Due to the high amount of datasets (e.g. one full LiDAR scan per day), the procedure needs to be performed fully automatically. Furthermore, the online near real-time 4D monitoring system requires to set triggers that can detect removal or moving of tie reflectors (used for co-registration) or the scanner itself. This guarantees long-term data acquisition with high quality. We will present results from a georeferencing experiment for 4D-LiDAR monitoring, which performs benchmarking of co-registration, 3D-georeferencing and also fully automatic detection of events (e.g. removal/moving of reflectors or scanner). Secondly, we will show our empirical findings of an ongoing permanent LiDAR observation of a landslide (Gresten

MO-FG-CAMPUS-JeP3-04: Feasibility Study of Real-Time Ultrasound Monitoring for Abdominal Stereotactic Body Radiation Therapy

Energy Technology Data Exchange (ETDEWEB)

Su, Lin; Kien Ng, Sook; Zhang, Ying; Herman, Joseph; Wong, John; Ding, Kai [Department of Radiation Oncology, John Hopkins University, Baltimore, MD (United States); Ji, Tianlong [Department of Radiation Oncology, The First Hospital of China Medical University, Shenyang, Liaoning (China); Iordachita, Iulian [Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD (United States); Tutkun Sen, H.; Kazanzides, Peter; Lediju Bell, Muyinatu A. [Department of Computer Science, Johns Hopkins University, Baltimore, MD (United States)

2016-06-15

Purpose: Ultrasound is ideal for real-time monitoring in radiotherapy with high soft tissue contrast, non-ionization, portability, and cost effectiveness. Few studies investigated clinical application of real-time ultrasound monitoring for abdominal stereotactic body radiation therapy (SBRT). This study aims to demonstrate the feasibility of real-time monitoring of 3D target motion using 4D ultrasound. Methods: An ultrasound probe holding system was designed to allow clinician to freely move and lock ultrasound probe. For phantom study, an abdominal ultrasound phantom was secured on a 2D programmable respiratory motion stage. One side of the stage was elevated than another side to generate 3D motion. The motion stage made periodic breath-hold movement. Phantom movement tracked by infrared camera was considered as ground truth. For volunteer study three healthy subjects underwent the same setup for abdominal SBRT with active breath control (ABC). 4D ultrasound B-mode images were acquired for both phantom and volunteers for real-time monitoring. 10 breath-hold cycles were monitored for each experiment. For phantom, the target motion tracked by ultrasound was compared with motion tracked by infrared camera. For healthy volunteers, the reproducibility of ABC breath-hold was evaluated. Results: Volunteer study showed the ultrasound system fitted well to the clinical SBRT setup. The reproducibility for 10 breath-holds is less than 2 mm in three directions for all three volunteers. For phantom study the motion between inspiration and expiration captured by camera (ground truth) is 2.35±0.02 mm, 1.28±0.04 mm, 8.85±0.03 mm in LR, AP, SI directly, respectively. The motion monitored by ultrasound is 2.21±0.07 mm, 1.32±0.12mm, 9.10±0.08mm, respectively. The motion monitoring error in any direction is less than 0.5 mm. Conclusion: The volunteer study proved the clinical feasibility of real-time ultrasound monitoring for abdominal SBRT. The phantom and volunteer ABC

MO-FG-CAMPUS-JeP3-04: Feasibility Study of Real-Time Ultrasound Monitoring for Abdominal Stereotactic Body Radiation Therapy

International Nuclear Information System (INIS)

Su, Lin; Kien Ng, Sook; Zhang, Ying; Herman, Joseph; Wong, John; Ding, Kai; Ji, Tianlong; Iordachita, Iulian; Tutkun Sen, H.; Kazanzides, Peter; Lediju Bell, Muyinatu A.

2016-01-01

Purpose: Ultrasound is ideal for real-time monitoring in radiotherapy with high soft tissue contrast, non-ionization, portability, and cost effectiveness. Few studies investigated clinical application of real-time ultrasound monitoring for abdominal stereotactic body radiation therapy (SBRT). This study aims to demonstrate the feasibility of real-time monitoring of 3D target motion using 4D ultrasound. Methods: An ultrasound probe holding system was designed to allow clinician to freely move and lock ultrasound probe. For phantom study, an abdominal ultrasound phantom was secured on a 2D programmable respiratory motion stage. One side of the stage was elevated than another side to generate 3D motion. The motion stage made periodic breath-hold movement. Phantom movement tracked by infrared camera was considered as ground truth. For volunteer study three healthy subjects underwent the same setup for abdominal SBRT with active breath control (ABC). 4D ultrasound B-mode images were acquired for both phantom and volunteers for real-time monitoring. 10 breath-hold cycles were monitored for each experiment. For phantom, the target motion tracked by ultrasound was compared with motion tracked by infrared camera. For healthy volunteers, the reproducibility of ABC breath-hold was evaluated. Results: Volunteer study showed the ultrasound system fitted well to the clinical SBRT setup. The reproducibility for 10 breath-holds is less than 2 mm in three directions for all three volunteers. For phantom study the motion between inspiration and expiration captured by camera (ground truth) is 2.35±0.02 mm, 1.28±0.04 mm, 8.85±0.03 mm in LR, AP, SI directly, respectively. The motion monitored by ultrasound is 2.21±0.07 mm, 1.32±0.12mm, 9.10±0.08mm, respectively. The motion monitoring error in any direction is less than 0.5 mm. Conclusion: The volunteer study proved the clinical feasibility of real-time ultrasound monitoring for abdominal SBRT. The phantom and volunteer ABC

Researching on Real 3d Modeling Constructed with the Oblique Photogrammetry and Terrestrial Photogrammetry

Science.gov (United States)

Han, Youmei; Jiao, Minglian; Shijuan

2018-04-01

With the rapid development of the oblique photogrammetry, many cities have built some real 3D model with this technology. Although it has the advantages of short period, high efficiency and good air angle effect, the near ground view angle of these real 3D models are not very good. With increasing development of smart cities, the requirements of reality, practicality and accuracy on real 3D models are becoming higher. How to produce and improve the real 3D models quickly has become one of the hot research directions of geospatial information. To meet this requirement In this paper, Combined with the characteristics of current oblique photogrammetry modeling and the terrestrial photogrammetry, we proposed a new technological process, which consists of close range sensor design, data acquisition and processing. The proposed method is being tested by using oblique photography images acquired. The results confirm the effectiveness of the proposed approach.

Monitoring the effects of doxorubicin on 3D-spheroid tumor cells in real-time

Directory of Open Access Journals (Sweden)

Baek N

2016-11-01

Full Text Available NamHuk Baek,1,* Ok Won Seo,1,* MinSung Kim,1 John Hulme,2 Seong Soo A An2 1Department of R & D, NanoEntek Inc., Seoul, Republic of Korea; 2Department of BioNano Technology Gachon University, Gyeonggi-do, Republic of Korea *These authors contributed equally to this work Abstract: Recently, increasing numbers of cell culture experiments with 3D spheroids presented better correlating results in vivo than traditional 2D cell culture systems. 3D spheroids could offer a simple and highly reproducible model that would exhibit many characteristics of natural tissue, such as the production of extracellular matrix. In this paper numerous cell lines were screened and selected depending on their ability to form and maintain a spherical shape. The effects of increasing concentrations of doxorubicin (DXR on the integrity and viability of the selected spheroids were then measured at regular intervals and in real-time. In total 12 cell lines, adenocarcinomic alveolar basal epithelial (A549, muscle (C2C12, prostate (DU145, testis (F9, pituitary epithelial-like (GH3, cervical cancer (HeLa, HeLa contaminant (HEp2, embryo (NIH3T3, embryo (PA317, neuroblastoma (SH-SY5Y, osteosarcoma U2OS, and embryonic kidney cells (293T, were screened. Out of the 12, 8 cell lines, NIH3T3, C2C12, 293T, SH-SY5Y, A549, HeLa, PA317, and U2OS formed regular spheroids and the effects of DXR on these structures were measured at regular intervals. Finally, 5 cell lines, A549, HeLa, SH-SY5Y, U2OS, and 293T, were selected for real-time monitoring and the effects of DXR treatment on their behavior were continuously recorded for 5 days. A potential correlation regarding the effects of DXR on spheroid viability and ATP production was measured on days 1, 3, and 5. Cytotoxicity of DXR seemed to occur after endocytosis, since the cellular activities and ATP productions were still viable after 1 day of the treatment in all spheroids, except SH-SY5Y. Both cellular activity and ATP production were

Computer Tool for Automatically Generated 3D Illustration in Real Time from Archaeological Scanned Pieces

OpenAIRE

Luis López; Germán Arroyo; Domingo Martín

2012-01-01

The graphical documentation process of archaeological pieces requires the active involvement of a professional artist to recreate beautiful illustrations using a wide variety of expressive techniques. Frequently, the artist’s work is limited by the inconvenience of working only with the photographs of the pieces he is going to illustrate. This paper presents a software tool that allows the easy generation of illustrations in real time from 3D scanned models. The developed interface allows the...

4-D ICE: A 2-D Array Transducer With Integrated ASIC in a 10-Fr Catheter for Real-Time 3-D Intracardiac Echocardiography.

Science.gov (United States)

Wildes, Douglas; Lee, Warren; Haider, Bruno; Cogan, Scott; Sundaresan, Krishnakumar; Mills, David M; Yetter, Christopher; Hart, Patrick H; Haun, Christopher R; Concepcion, Mikael; Kirkhorn, Johan; Bitoun, Marc

2016-12-01

We developed a 2.5 ×6.6 mm 2 2 -D array transducer with integrated transmit/receive application-specific integrated circuit (ASIC) for real-time 3-D intracardiac echocardiography (4-D ICE) applications. The ASIC and transducer design were optimized so that the high-voltage transmit, low-voltage time-gain control and preamp, subaperture beamformer, and digital control circuits for each transducer element all fit within the 0.019-mm 2 area of the element. The transducer assembly was deployed in a 10-Fr (3.3-mm diameter) catheter, integrated with a GE Vivid E9 ultrasound imaging system, and evaluated in three preclinical studies. The 2-D image quality and imaging modes were comparable to commercial 2-D ICE catheters. The 4-D field of view was at least 90 ° ×60 ° ×8 cm and could be imaged at 30 vol/s, sufficient to visualize cardiac anatomy and other diagnostic and therapy catheters. 4-D ICE should significantly reduce X-ray fluoroscopy use and dose during electrophysiology ablation procedures. 4-D ICE may be able to replace transesophageal echocardiography (TEE), and the associated risks and costs of general anesthesia, for guidance of some structural heart procedures.

Current status of DIII-D real-time digital plasma control

International Nuclear Information System (INIS)

Penaflor, B.G.; Piglowski, D.A.; Ferron, J.R.; Walker, M.L.

1999-06-01

This paper describes the current status of real-time digital plasma control for the DIII-D tokamak. The digital plasma control system (PCS) has been in place at DIII-D since the early 1990s and continues to expand and improve in its capabilities to monitor and control plasma parameters for DIII-D fusion science experiments. The PCs monitors over 200 tokamak parameters from the DIII-D experiment using a real-time data acquisition system that acquires a new set of samples once every 60 micros. This information is then used in a number of feedback control algorithms to compute and control a variety of parameters including those affecting plasma shape and position. A number of system related improvements has improved the usability and flexibility of the DIII-D PCS. These include more graphical user interfaces to assist in entering and viewing the large and ever growing number of parameters controlled by the PCS, increased interaction and accessibility from other DIII-D applications, and upgrades to the computer hardware and vended software. Future plans for the system include possible upgrades of the real-time computers, further links to other DIII-D diagnostic measurements such as real-time Thomson scattering analysis, and joint collaborations with other tokamak experiments including the NSTX at Princeton

Development of CT and 3D-CT Using Flat Panel Detector Based Real-Time Digital Radiography System

International Nuclear Information System (INIS)

Ravindran, V. R.; Sreelakshmi, C.; Vibin

2008-01-01

The application of Digital Radiography in the Nondestructive Evaluation (NDE) of space vehicle components is a recent development in India. A Real-time DR system based on amorphous silicon Flat Panel Detector has been developed for the NDE of solid rocket motors at Rocket Propellant Plant of VSSC in a few years back. The technique has been successfully established for the nondestructive evaluation of solid rocket motors. The DR images recorded for a few solid rocket specimens are presented in the paper. The Real-time DR system is capable of generating sufficient digital X-ray image data with object rotation for the CT image reconstruction. In this paper the indigenous development of CT imaging based on the Realtime DR system for solid rocket motor is presented. Studies are also carried out to generate 3D-CT image from a set of adjacent CT images of the rocket motor. The capability of revealing the spatial location and characterisation of defect is demonstrated by the CT and 3D-CT images generated.

RESEARCHING ON REAL 3D MODELING CONSTRUCTED WITH THE OBLIQUE PHOTOGRAMMETRY AND TERRESTRIAL PHOTOGRAMMETRY

Directory of Open Access Journals (Sweden)

Y. Han

2018-04-01

Full Text Available With the rapid development of the oblique photogrammetry, many cities have built some real 3D model with this technology. Although it has the advantages of short period, high efficiency and good air angle effect, the near ground view angle of these real 3D models are not very good. With increasing development of smart cities, the requirements of reality, practicality and accuracy on real 3D models are becoming higher. How to produce and improve the real 3D models quickly has become one of the hot research directions of geospatial information. To meet this requirement In this paper, Combined with the characteristics of current oblique photogrammetry modeling and the terrestrial photogrammetry, we proposed a new technological process, which consists of close range sensor design, data acquisition and processing. The proposed method is being tested by using oblique photography images acquired. The results confirm the effectiveness of the proposed approach.

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system

Energy Technology Data Exchange (ETDEWEB)

Liu, Wenyang [Department of Bioengineering, University of California, Los Angeles, Los Angeles, California 90095 (United States); Cheung, Yam [Department of Radiation Oncology, University of Texas Southwestern, Dallas, Texas 75390 (United States); Sawant, Amit [Department of Radiation Oncology, University of Texas Southwestern, Dallas, Texas, 75390 and Department of Radiation Oncology, University of Maryland, College Park, Maryland 20742 (United States); Ruan, Dan, E-mail: druan@mednet.ucla.edu [Department of Bioengineering, University of California, Los Angeles, Los Angeles, California 90095 and Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California 90095 (United States)

2016-05-15

Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system.

Science.gov (United States)

Liu, Wenyang; Cheung, Yam; Sawant, Amit; Ruan, Dan

2016-05-01

To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced occlusions. The authors have

A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system

International Nuclear Information System (INIS)

Liu, Wenyang; Cheung, Yam; Sawant, Amit; Ruan, Dan

2016-01-01

Purpose: To develop a robust and real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system. Methods: The authors have developed a robust and fast surface reconstruction method on point clouds acquired by the photogrammetry system, without explicitly solving the partial differential equation required by a typical variational approach. Taking advantage of the overcomplete nature of the acquired point clouds, their method solves and propagates a sparse linear relationship from the point cloud manifold to the surface manifold, assuming both manifolds share similar local geometry. With relatively consistent point cloud acquisitions, the authors propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, assuming that the point correspondences built by the iterative closest point (ICP) is reasonably accurate and have residual errors following a Gaussian distribution. To accommodate changing noise levels and/or presence of inconsistent occlusions during the acquisition, the authors further propose a modified sparse regression (MSR) model to model the potentially large and sparse error built by ICP with a Laplacian prior. The authors evaluated the proposed method on both clinical point clouds acquired under consistent acquisition conditions and on point clouds with inconsistent occlusions. The authors quantitatively evaluated the reconstruction performance with respect to root-mean-squared-error, by comparing its reconstruction results against that from the variational method. Results: On clinical point clouds, both the SR and MSR models have achieved sub-millimeter reconstruction accuracy and reduced the reconstruction time by two orders of magnitude to a subsecond reconstruction time. On point clouds with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent and robust performance despite the introduced

Autonomous and 3D real-time multi-beam manipulation in a microfluidic environment

DEFF Research Database (Denmark)

Perch-Nielsen, I.; Rodrigo, P.J.; Alonzo, C.A.

2006-01-01

The Generalized Phase Contrast (GPC) method of optical 3D manipulation has previously been used for controlled spatial manipulation of live biological specimen in real-time. These biological experiments were carried out over a time-span of several hours while an operator intermittently optimized...... the optical system. Here we present GPC-based optical micromanipulation in a microfluidic system where trapping experiments are computer-automated and thereby capable of running with only limited supervision. The system is able to dynamically detect living yeast cells using a computer-interfaced CCD camera......, and respond to this by instantly creating traps at positions of the spotted cells streaming at flow velocities that would be difficult for a human operator to handle. With the added ability to control flow rates, experiments were also carried out to confirm the theoretically predicted axially dependent...

Real-time 2-D Phased Array Vector Flow Imaging

DEFF Research Database (Denmark)

Holbek, Simon; Hansen, Kristoffer Lindskov; Fogh, Nikolaj

2018-01-01

Echocardiography examination of the blood flow is currently either restricted to 1-D techniques in real-time or experimental off-line 2-D methods. This paper presents an implementation of transverse oscillation for real-time 2-D vector flow imaging (VFI) on a commercial BK Ultrasound scanner....... A large field-of-view (FOV) sequence for studying flow dynamics at 11 frames per second (fps) and a sequence for studying peak systolic velocities (PSV) with a narrow FOV at 36 fps were validated. The VFI sequences were validated in a flow-rig with continuous laminar parabolic flow and in a pulsating flow...

Clinical value of real time 3D sonohysterography and 2D sonohysterography in comparison to hysteroscopy with subsequent histopathological examination in perimenopausal women with abnormal uterine bleeding.

Science.gov (United States)

Kowalczyk, Dariusz; Guzikowski, Wojciech; Więcek, Jacek; Sioma-Markowska, Urszula

2012-01-01

In many publications the transvaginal ultrasound is regarded as the first step to diagnose the cause of uterine bleeding in perimenopausal women. In order to improve the sensitivity and specificity of the conventional ultrasound physiological saline solution was administered to the uterine cavity and after expansion of its walls the interior uterine cavity was examined. And this procedure is called 2D sonohysterography (SIS 2D). By the ultrasound scanners which enable to get 3D real time image a spatial evaluation of the uterine cavity is possible. Clinical value of the real time 3D sonohysterography and 2D sonohysterography compared to hysteroscopy with histopathological examination in perimenopausal women. The study concerned a group of 97 perimenopausal women with abnormal uterine bleeding. In all of them after a standard transvaginal ultrasonography a catheter was inserted into the uterine cavity. After expansion of the uterine walls by administering about 10 ml of 0,9% saline solution the uterine cavity was examined by conventional sonohysterography. Then a 3D imaging mode was activated and the uterine interior was examined by real time 3D ultrasonography. The ultrasound results were verified by hysteroscopy, the endometrial lesions were removed and underwent a histopathological examination. In two cases the SIS examination was impossible because of uterine cervix atresion. In the rest of examined group the SIS 2D sensitivity and specificity came up to 72 and 96% respectively. In the group of SIS 3D the sensitivity and specificity reached 83 and 99% respectively. Adding SIS 3D, a minimally invasive method, to conventional sonohysterography improves the precision of diagnosis of endometrial pathology, allows to get three-dimensional image of the uterine cavity and enables examination of endometrial lesions. The diagnostic precision of this procedure is similar to the results achieved by hysteroscopy.

REAL-TIME CAMERA GUIDANCE FOR 3D SCENE RECONSTRUCTION

Directory of Open Access Journals (Sweden)

F. Schindler

2012-07-01

Full Text Available We propose a framework for operator guidance during the image acquisition process for reliable multi-view stereo reconstruction. Goal is to achieve full coverage of the object and sufficient overlap. Multi-view stereo is a commonly used method to reconstruct both camera trajectory and 3D object shape. After determining an initial solution, a globally optimal reconstruction is usually obtained by executing a bundle adjustment involving all images. Acquiring suitable images, however, still requires an experienced operator to ensure accuracy and completeness of the final solution. We propose an interactive framework for guiding unexperienced users or possibly an autonomous robot. Using approximate camera orientations and object points we estimate point uncertainties within a sliding bundle adjustment and suggest appropriate camera movements. A visual feedback system communicates the decisions to the user in an intuitive way. We demonstrate the suitability of our system with a virtual image acquisition simulation as well as in real-world scenarios. We show that when following the camera movements suggested by our system, the proposed framework is able to generate good approximate values for the bundle adjustment, leading to accurate results compared to ground truth after few iterations. Possible applications are non-professional 3D acquisition systems on low-cost platforms like mobile phones, autonomously navigating robots as well as online flight planning of unmanned aerial vehicles.

LandSIM3D: modellazione in real time 3D di dati geografici

Directory of Open Access Journals (Sweden)

Lambo Srl Lambo Srl

2009-03-01

Full Text Available LandSIM3D: realtime 3D modelling of geographic data LandSIM3D allows to model in 3D an existing landscape in a few hours only and geo-referenced offering great landscape analysis and understanding tools. 3D projects can then be inserted into the existing landscape with ease and precision. The project alternatives and impact can then be visualized and studied into their immediate environmental. The complex evolution of the landscape in the future can also be simulated and the landscape model can be manipulated interactively and better shared with colleagues. For that reason, LandSIM3D is different from traditional 3D imagery solutions, normally reserved for computer graphics experts. For more information about LandSIM3D, go to www.landsim3d.com.

Real-Time 3-Dimensional Ultrasound-Assisted Infraclavicular Brachial Plexus Catheter Placement: Implications of a New Technology

Directory of Open Access Journals (Sweden)

Steven R. Clendenen

2010-01-01

Full Text Available Background. There are a variety of techniques for targeting placement of an infraclavicular blockade; these include eliciting paresthesias, nerve stimulation, and 2-dimensional (2D ultrasound (US guidance. Current 2D US allows direct visualization of a “flat” image of the advancing needle and neurovascular structures but without the ability to extensively analyze multidimensional data and allow for real-time manipulation. Three-dimensional (3D ultrasonography has gained popularity and usefulness in many clinical specialties such as obstetrics and cardiology. We describe some of the potential clinical applications of 3D US in regional anesthesia. Methods. This case represents an infraclavicular catheter placement facilitated by 3D US, which demonstrates 360-degree spatial relationships of the entire anatomic region. Results. The block needle, peripheral nerve catheter, and local anesthetic diffusion were observed in multiple planes of view without manipulation of the US probe. Conclusion. Advantages of 3D US may include the ability to confirm correct needle and catheter placement prior to the injection of local anesthetic. The spread of local anesthetic along the length of the nerve can be easily observed while manipulating the 3D images in real-time by simply rotating the trackball on the US machine to provide additional information that cannot be identified with 2D US alone.

SU-E-J-237: Real-Time 3D Anatomy Estimation From Undersampled MR Acquisitions

Energy Technology Data Exchange (ETDEWEB)

Glitzner, M; Lagendijk, J; Raaymakers, B; Crijns, S [University Medical Center Utrecht, Utrecht (Netherlands); Senneville, B Denis de [University Medical Center Utrecht, Utrecht (Netherlands); Mathematical Institute of Bordeaux, University of Bordeaux, Talence Cedex (France)

2015-06-15

Recent developments made MRI guided radiotherapy feasible. Performing simultaneous imaging during fractions can provide information about changing anatomy by means of deformable image registration for either immediate plan adaptations or accurate dose accumulation on the changing anatomy. In 3D MRI, however, acquisition time is considerable and scales with resolution. Furthermore, intra-scan motion degrades image quality.In this work, we investigate the sensitivity of registration quality on imageresolution: potentially, by employing spatial undersampling, the acquisition timeof MR images for the purpose of deformable image registration can be reducedsignificantly.On a volunteer, 3D-MR imaging data was sampled in a navigator-gated manner, acquiring one axial volume (360×260×100mm{sup 3}) per 3s during exhale phase. A T1-weighted FFE sequence was used with an acquired voxel size of (2.5mm{sup 3}) for a duration of 17min. Deformation vector fields were evaluated for 100 imaging cycles with respect to the initial anatomy using deformable image registration based on optical flow. Subsequently, the imaging data was downsampled by a factor of 2, simulating a fourfold acquisition speed. Displacements of the downsampled volumes were then calculated by the same process.In kidneyliver boundaries and the region around stomach/duodenum, prominent organ drifts could be observed in both the original and the downsampled imaging data. An increasing displacement of approximately 2mm was observed for the kidney, while an area around the stomach showed sudden displacements of 4mm. Comparison of the motile points over time showed high reproducibility between the displacements of high-resolution and downsampled volumes: over a 17min acquisition, the componentwise RMS error was not more than 0.38mm.Based on the synthetic experiments, 3D nonrigid image registration shows little sensitivity to image resolution and the displacement information is preserved even when halving the

Real-time 3D imaging methods using 2D phased arrays based on synthetic focusing techniques.

Science.gov (United States)

Kim, Jung-Jun; Song, Tai-Kyong

2008-07-01

A fast 3D ultrasound imaging technique using a 2D phased array transducer based on the synthetic focusing method for nondestructive testing or medical imaging is proposed. In the proposed method, each column of a 2D array is fired successively to produce transverse fan beams focused at a fixed depth along a given longitudinal direction and the resulting pulse echoes are received at all elements of a 2D array used. After firing all column arrays, a frame of high-resolution image along a given longitudinal direction is obtained with dynamic focusing employed in the longitudinal direction on receive and in the transverse direction on both transmit and receive. The volume rate of the proposed method can be increased much higher than that of the conventional 2D array imaging by employing an efficient sparse array technique. A simple modification to the proposed method can further increase the volume scan rate significantly. The proposed methods are verified through computer simulations.

Pulsed cavitational ultrasound for non-invasive chordal cutting guided by real-time 3D echocardiography.

Science.gov (United States)

Villemain, Olivier; Kwiecinski, Wojciech; Bel, Alain; Robin, Justine; Bruneval, Patrick; Arnal, Bastien; Tanter, Mickael; Pernot, Mathieu; Messas, Emmanuel

2016-10-01

Basal chordae surgical section has been shown to be effective in reducing ischaemic mitral regurgitation (IMR). Achieving this section by non-invasive mean can considerably decrease the morbidity of this intervention on already infarcted myocardium. We investigated in vitro and in vivo the feasibility and safety of pulsed cavitational focused ultrasound (histotripsy) for non-invasive chordal cutting guided by real-time 3D echocardiography. Experiments were performed on 12 sheep hearts, 5 in vitro on explanted sheep hearts and 7 in vivo on beating sheep hearts. In vitro, the mitral valve (MV) apparatus including basal and marginal chordae was removed and fixed on a holder in a water tank. High-intensity ultrasound pulses were emitted from the therapeutic device (1-MHz focused transducer, pulses of 8 µs duration, peak negative pressure of 17 MPa, repetition frequency of 100 Hz), placed at a distance of 64 mm under 3D echocardiography guidance. In vivo, after sternotomy, the same therapeutic device was applied on the beating heart. We analysed MV coaptation and chordae by real-time 3D echocardiography before and after basal chordal cutting. After sacrifice, the MV apparatus were harvested for anatomical and histological post-mortem explorations to confirm the section of the chordae. In vitro, all chordae were completely cut after a mean procedure duration of 5.5 ± 2.5 min. The procedure duration was found to increase linearly with the chordae diameter. In vivo, the central basal chordae of the anterior leaflet were completely cut. The mean procedure duration was 20 ± 9 min (min = 14, max = 26). The sectioned chordae was visible on echocardiography, and MV coaptation remained normal with no significant mitral regurgitation. Anatomical and histological post-mortem explorations of the hearts confirmed the section of the chordae. Histotripsy guided by 3D echo achieved successfully to cut MV chordae in vitro and in vivo in beating heart. We hope that this technique will

Real-Time and High-Resolution 3D Face Measurement via a Smart Active Optical Sensor.

Science.gov (United States)

You, Yong; Shen, Yang; Zhang, Guocai; Xing, Xiuwen

2017-03-31

The 3D measuring range and accuracy in traditional active optical sensing, such as Fourier transform profilometry, are influenced by the zero frequency of the captured patterns. The phase-shifting technique is commonly applied to remove the zero component. However, this phase-shifting method must capture several fringe patterns with phase difference, thereby influencing the real-time performance. This study introduces a smart active optical sensor, in which a composite pattern is utilized. The composite pattern efficiently combines several phase-shifting fringes and carrier frequencies. The method can remove zero frequency by using only one pattern. Model face reconstruction and human face measurement were employed to study the validity and feasibility of this method. Results show no distinct decrease in the precision of the novel method unlike the traditional phase-shifting method. The texture mapping technique was utilized to reconstruct a nature-appearance 3D digital face.

Validation and Assessment of Multi-GNSS Real-Time Precise Point Positioning in Simulated Kinematic Mode Using IGS Real-Time Service

Directory of Open Access Journals (Sweden)

Liang Wang

2018-02-01

Full Text Available Precise Point Positioning (PPP is a popular technology for precise applications based on the Global Navigation Satellite System (GNSS. Multi-GNSS combined PPP has become a hot topic in recent years with the development of multiple GNSSs. Meanwhile, with the operation of the real-time service (RTS of the International GNSS Service (IGS agency that provides satellite orbit and clock corrections to broadcast ephemeris, it is possible to obtain the real-time precise products of satellite orbits and clocks and to conduct real-time PPP. In this contribution, the real-time multi-GNSS orbit and clock corrections of the CLK93 product are applied for real-time multi-GNSS PPP processing, and its orbit and clock qualities are investigated, first with a seven-day experiment by comparing them with the final multi-GNSS precise product ‘GBM’ from GFZ. Then, an experiment involving real-time PPP processing for three stations in the Multi-GNSS Experiment (MGEX network with a testing period of two weeks is conducted in order to evaluate the convergence performance of real-time PPP in a simulated kinematic mode. The experimental result shows that real-time PPP can achieve a convergence performance of less than 15 min for an accuracy level of 20 cm. Finally, the real-time data streams from 12 globally distributed IGS/MGEX stations for one month are used to assess and validate the positioning accuracy of real-time multi-GNSS PPP. The results show that the simulated kinematic positioning accuracy achieved by real-time PPP on different stations is about 3.0 to 4.0 cm for the horizontal direction and 5.0 to 7.0 cm for the three-dimensional (3D direction.

SU-C-201-04: Noise and Temporal Resolution in a Near Real-Time 3D Dosimeter

Energy Technology Data Exchange (ETDEWEB)

Rilling, M [Department of physics, engineering physics and optics, Universite Laval, Quebec City, QC (Canada); Centre de recherche sur le cancer, Universite Laval, Quebec City, QC (Canada); Radiation oncology department, CHU de Quebec, Quebec City, QC (Canada); Center for optics, photonics and lasers, Universite Laval, Quebec City, Quebec (Canada); Goulet, M [Radiation oncology department, CHU de Quebec, Quebec City, QC (Canada); Beaulieu, L; Archambault, L [Department of physics, engineering physics and optics, Universite Laval, Quebec City, QC (Canada); Centre de recherche sur le cancer, Universite Laval, Quebec City, QC (Canada); Radiation oncology department, CHU de Quebec, Quebec City, QC (Canada); Thibault, S [Center for optics, photonics and lasers, Universite Laval, Quebec City, Quebec (Canada)

2016-06-15

Purpose: To characterize the performance of a real-time three-dimensional scintillation dosimeter in terms of signal-to-noise ratio (SNR) and temporal resolution of 3D dose measurements. This study quantifies its efficiency in measuring low dose levels characteristic of EBRT dynamic treatments, and in reproducing field profiles for varying multileaf collimator (MLC) speeds. Methods: The dosimeter prototype uses a plenoptic camera to acquire continuous images of the light field emitted by a 10×10×10 cm{sup 3} plastic scintillator. Using EPID acquisitions, ray tracing-based iterative tomographic algorithms allow millimeter-sized reconstruction of relative 3D dose distributions. Measurements were taken at 6MV, 400 MU/min with the scintillator centered at the isocenter, first receiving doses from 1.4 to 30.6 cGy. Dynamic measurements were then performed by closing half of the MLCs at speeds of 0.67 to 2.5 cm/s, at 0° and 90° collimator angles. A reference static half-field was obtained for measured profile comparison. Results: The SNR steadily increases as a function of dose and reaches a clinically adequate plateau of 80 at 10 cGy. Below this, the decrease in light collected and increase in pixel noise diminishes the SNR; nonetheless, the EPID acquisitions and the voxel correlation employed in the reconstruction algorithms result in suitable SNR values (>75) even at low doses. For dynamic measurements at varying MLC speeds, central relative dose profiles are characterized by gradients at %D{sub 50} of 8.48 to 22.7 %/mm. These values converge towards the 32.8 %/mm-gradient measured for the static reference field profile, but are limited by the dosimeter’s current acquisition rate of 1Hz. Conclusion: This study emphasizes the efficiency of the 3D dose distribution reconstructions, while identifying limits of the current prototype’s temporal resolution in terms of dynamic EBRT parameters. This work paves the way for providing an optimized, second

SU-C-201-04: Noise and Temporal Resolution in a Near Real-Time 3D Dosimeter

International Nuclear Information System (INIS)

Rilling, M; Goulet, M; Beaulieu, L; Archambault, L; Thibault, S

2016-01-01

Purpose: To characterize the performance of a real-time three-dimensional scintillation dosimeter in terms of signal-to-noise ratio (SNR) and temporal resolution of 3D dose measurements. This study quantifies its efficiency in measuring low dose levels characteristic of EBRT dynamic treatments, and in reproducing field profiles for varying multileaf collimator (MLC) speeds. Methods: The dosimeter prototype uses a plenoptic camera to acquire continuous images of the light field emitted by a 10×10×10 cm"3 plastic scintillator. Using EPID acquisitions, ray tracing-based iterative tomographic algorithms allow millimeter-sized reconstruction of relative 3D dose distributions. Measurements were taken at 6MV, 400 MU/min with the scintillator centered at the isocenter, first receiving doses from 1.4 to 30.6 cGy. Dynamic measurements were then performed by closing half of the MLCs at speeds of 0.67 to 2.5 cm/s, at 0° and 90° collimator angles. A reference static half-field was obtained for measured profile comparison. Results: The SNR steadily increases as a function of dose and reaches a clinically adequate plateau of 80 at 10 cGy. Below this, the decrease in light collected and increase in pixel noise diminishes the SNR; nonetheless, the EPID acquisitions and the voxel correlation employed in the reconstruction algorithms result in suitable SNR values (>75) even at low doses. For dynamic measurements at varying MLC speeds, central relative dose profiles are characterized by gradients at %D_5_0 of 8.48 to 22.7 %/mm. These values converge towards the 32.8 %/mm-gradient measured for the static reference field profile, but are limited by the dosimeter’s current acquisition rate of 1Hz. Conclusion: This study emphasizes the efficiency of the 3D dose distribution reconstructions, while identifying limits of the current prototype’s temporal resolution in terms of dynamic EBRT parameters. This work paves the way for providing an optimized, second-generational real-time 3D

Real-time 3-dimensional virtual reality navigation system with open MRI for breast-conserving surgery

International Nuclear Information System (INIS)

Tomikawa, Morimasa; Konishi, Kozo; Ieiri, Satoshi; Hong, Jaesung; Uemura, Munenori; Hashizume, Makoto; Shiotani, Satoko; Tokunaga, Eriko; Maehara, Yoshihiko

2011-01-01

We report here the early experiences using a real-time three-dimensional (3D) virtual reality navigation system with open magnetic resonance imaging (MRI) for breast-conserving surgery (BCS). Two patients with a non-palpable MRI-detected breast tumor underwent BCS under the guidance of the navigation system. An initial MRI for the breast tumor using skin-affixed markers was performed immediately prior to excision. A percutaneous intramammary dye marker was applied to delineate an excision line, and the computer software '3D Slicer' generated a real-time 3D virtual reality model of the tumor and the puncture needle in the breast. Under guidance by the navigation system, marking procedures were performed without any difficulties. Fiducial registration errors were 3.00 mm for patient no.1, and 4.07 mm for patient no.2. The real-time 3D virtual reality navigation system with open MRI is feasible for safe and accurate excision of non-palpable MRI-detected breast tumors. (author)

An inkjet-printed buoyant 3-D lagrangian sensor for real-time flood monitoring

KAUST Repository

Farooqui, Muhammad Fahad

2014-06-01

A 3-D (cube-shaped) Lagrangian sensor, inkjet printed on a paper substrate, is presented for the first time. The sensor comprises a transmitter chip with a microcontroller completely embedded in the cube, along with a $1.5 \\\\lambda 0 dipole that is uniquely implemented on all the faces of the cube to achieve a near isotropic radiation pattern. The sensor has been designed to operate both in the air as well as water (half immersed) for real-time flood monitoring. The sensor weighs 1.8 gm and measures 13 mm$\\\\,\\\\times\\\\,$ 13 mm$\\\\,\\\\times\\\\,$ 13 mm, and each side of the cube corresponds to only $0.1 \\\\lambda 0 (at 2.4 GHz). The printed circuit board is also inkjet-printed on paper substrate to make the sensor light weight and buoyant. Issues related to the bending of inkjet-printed tracks and integration of the transmitter chip in the cube are discussed. The Lagrangian sensor is designed to operate in a wireless sensor network and field tests have confirmed that it can communicate up to a distance of 100 m while in the air and up to 50 m while half immersed in water. © 1963-2012 IEEE.

An algorithm to provide real time neutral beam substitution in the DIII-D tokamak

International Nuclear Information System (INIS)

Phillips, J.C.; Greene, K.L.; Hyatt, A.W.; McHarg, B.B. Jr.; Penaflor, B.G.

1999-06-01

A key component of the DIII-D tokamak fusion experiment is a flexible and easy to expand digital control system which actively controls a large number of parameters in real-time. These include plasma shape, position, density, and total stored energy. This system, known as the PCS (plasma control system), also has the ability to directly control auxiliary plasma heating systems, such as the 20 MW of neutral beams routinely used on DIII-D. This paper describes the implementation of a real-time algorithm allowing substitution of power from one neutral beam for another, given a fault in the originally scheduled beam. Previously, in the event of a fault in one of the neutral beams, the actual power profile for the shot might be deficient, resulting in a less useful or wasted shot. Using this new real-time algorithm, a stand by neutral beam may substitute within milliseconds for one which has faulted. Since single shots can have substantial value, this is an important advance to DIII-D's capabilities and utilization. Detailed results are presented, along with a description not only of the algorithm but of the simulation setup required to prove the algorithm without the costs normally associated with using physics operations time

Novel System for Real-Time Integration of 3-D Echocardiography and Fluoroscopy for Image-Guided Cardiac Interventions: Preclinical Validation and Clinical Feasibility Evaluation

Science.gov (United States)

Housden, R. James; Ma, Yingliang; Rajani, Ronak; Gao, Gang; Nijhof, Niels; Cathier, Pascal; Bullens, Roland; Gijsbers, Geert; Parish, Victoria; Kapetanakis, Stamatis; Hancock, Jane; Rinaldi, C. Aldo; Cooklin, Michael; Gill, Jaswinder; Thomas, Martyn; O'neill, Mark D.; Razavi, Reza; Rhode, Kawal S.

2014-01-01

Real-time imaging is required to guide minimally invasive catheter-based cardiac interventions. While transesophageal echocardiography allows for high-quality visualization of cardiac anatomy, X-ray fluoroscopy provides excellent visualization of devices. We have developed a novel image fusion system that allows real-time integration of 3-D echocardiography and the X-ray fluoroscopy. The system was validated in the following two stages: 1) preclinical to determine function and validate accuracy; and 2) in the clinical setting to assess clinical workflow feasibility and determine overall system accuracy. In the preclinical phase, the system was assessed using both phantom and porcine experimental studies. Median 2-D projection errors of 4.5 and 3.3 mm were found for the phantom and porcine studies, respectively. The clinical phase focused on extending the use of the system to interventions in patients undergoing either atrial fibrillation catheter ablation (CA) or transcatheter aortic valve implantation (TAVI). Eleven patients were studied with nine in the CA group and two in the TAVI group. Successful real-time view synchronization was achieved in all cases with a calculated median distance error of 2.2 mm in the CA group and 3.4 mm in the TAVI group. A standard clinical workflow was established using the image fusion system. These pilot data confirm the technical feasibility of accurate real-time echo-fluoroscopic image overlay in clinical practice, which may be a useful adjunct for real-time guidance during interventional cardiac procedures. PMID:27170872

High-precision real-time 3D shape measurement based on a quad-camera system

Science.gov (United States)

Tao, Tianyang; Chen, Qian; Feng, Shijie; Hu, Yan; Zhang, Minliang; Zuo, Chao

2018-01-01

Phase-shifting profilometry (PSP) based 3D shape measurement is well established in various applications due to its high accuracy, simple implementation, and robustness to environmental illumination and surface texture. In PSP, higher depth resolution generally requires higher fringe density of projected patterns which, in turn, lead to severe phase ambiguities that must be solved with additional information from phase coding and/or geometric constraints. However, in order to guarantee the reliability of phase unwrapping, available techniques are usually accompanied by increased number of patterns, reduced amplitude of fringe, and complicated post-processing algorithms. In this work, we demonstrate that by using a quad-camera multi-view fringe projection system and carefully arranging the relative spatial positions between the cameras and the projector, it becomes possible to completely eliminate the phase ambiguities in conventional three-step PSP patterns with high-fringe-density without projecting any additional patterns or embedding any auxiliary signals. Benefiting from the position-optimized quad-camera system, stereo phase unwrapping can be efficiently and reliably performed by flexible phase consistency checks. Besides, redundant information of multiple phase consistency checks is fully used through a weighted phase difference scheme to further enhance the reliability of phase unwrapping. This paper explains the 3D measurement principle and the basic design of quad-camera system, and finally demonstrates that in a large measurement volume of 200 mm × 200 mm × 400 mm, the resultant dynamic 3D sensing system can realize real-time 3D reconstruction at 60 frames per second with a depth precision of 50 μm.

Research Directions in Real-Time Systems.

Science.gov (United States)

1996-09-01

This report summarizes a survey of published research in real time systems . Material is presented that provides an overview of the topic, focusing on...communications protocols and scheduling techniques. It is noted that real - time systems deserve special attention separate from other areas because of...formal tools for design and analysis of real - time systems . The early work on applications as well as notable theoretical advances are summarized

Spatiotemporal Segmentation and Modeling of the Mitral Valve in Real-Time 3D Echocardiographic Images.

Science.gov (United States)

Pouch, Alison M; Aly, Ahmed H; Lai, Eric K; Yushkevich, Natalie; Stoffers, Rutger H; Gorman, Joseph H; Cheung, Albert T; Gorman, Joseph H; Gorman, Robert C; Yushkevich, Paul A

2017-09-01

Transesophageal echocardiography is the primary imaging modality for preoperative assessment of mitral valves with ischemic mitral regurgitation (IMR). While there are well known echocardiographic insights into the 3D morphology of mitral valves with IMR, such as annular dilation and leaflet tethering, less is understood about how quantification of valve dynamics can inform surgical treatment of IMR or predict short-term recurrence of the disease. As a step towards filling this knowledge gap, we present a novel framework for 4D segmentation and geometric modeling of the mitral valve in real-time 3D echocardiography (rt-3DE). The framework integrates multi-atlas label fusion and template-based medial modeling to generate quantitatively descriptive models of valve dynamics. The novelty of this work is that temporal consistency in the rt-3DE segmentations is enforced during both the segmentation and modeling stages with the use of groupwise label fusion and Kalman filtering. The algorithm is evaluated on rt-3DE data series from 10 patients: five with normal mitral valve morphology and five with severe IMR. In these 10 data series that total 207 individual 3DE images, each 3DE segmentation is validated against manual tracing and temporal consistency between segmentations is demonstrated. The ultimate goal is to generate accurate and consistent representations of valve dynamics that can both visually and quantitatively provide insight into normal and pathological valve function.

Automated real-time search and analysis algorithms for a non-contact 3D profiling system

Science.gov (United States)

Haynes, Mark; Wu, Chih-Hang John; Beck, B. Terry; Peterman, Robert J.

2013-04-01

The purpose of this research is to develop a new means of identifying and extracting geometrical feature statistics from a non-contact precision-measurement 3D profilometer. Autonomous algorithms have been developed to search through large-scale Cartesian point clouds to identify and extract geometrical features. These algorithms are developed with the intent of providing real-time production quality control of cold-rolled steel wires. The steel wires in question are prestressing steel reinforcement wires for concrete members. The geometry of the wire is critical in the performance of the overall concrete structure. For this research a custom 3D non-contact profilometry system has been developed that utilizes laser displacement sensors for submicron resolution surface profiling. Optimizations in the control and sensory system allow for data points to be collected at up to an approximate 400,000 points per second. In order to achieve geometrical feature extraction and tolerancing with this large volume of data, the algorithms employed are optimized for parsing large data quantities. The methods used provide a unique means of maintaining high resolution data of the surface profiles while keeping algorithm running times within practical bounds for industrial application. By a combination of regional sampling, iterative search, spatial filtering, frequency filtering, spatial clustering, and template matching a robust feature identification method has been developed. These algorithms provide an autonomous means of verifying tolerances in geometrical features. The key method of identifying the features is through a combination of downhill simplex and geometrical feature templates. By performing downhill simplex through several procedural programming layers of different search and filtering techniques, very specific geometrical features can be identified within the point cloud and analyzed for proper tolerancing. Being able to perform this quality control in real time

Real-time 3D radiation risk assessment supporting simulation of work in nuclear environments

International Nuclear Information System (INIS)

Szoke, I; Louka, M N; Bryntesen, T R; Bratteli, J; Edvardsen, S T; RøEitrheim, K K; Bodor, K

2014-01-01

This paper describes the latest developments at the Institute for Energy Technology (IFE) in Norway, in the field of real-time 3D (three-dimensional) radiation risk assessment for the support of work simulation in nuclear environments. 3D computer simulation can greatly facilitate efficient work planning, briefing, and training of workers. It can also support communication within and between work teams, and with advisors, regulators, the media and public, at all the stages of a nuclear installation’s lifecycle. Furthermore, it is also a beneficial tool for reviewing current work practices in order to identify possible gaps in procedures, as well as to support the updating of international recommendations, dissemination of experience, and education of the current and future generation of workers. IFE has been involved in research and development into the application of 3D computer simulation and virtual reality (VR) technology to support work in radiological environments in the nuclear sector since the mid 1990s. During this process, two significant software tools have been developed, the VRdose system and the Halden Planner, and a number of publications have been produced to contribute to improving the safety culture in the nuclear industry. This paper describes the radiation risk assessment techniques applied in earlier versions of the VRdose system and the Halden Planner, for visualising radiation fields and calculating dose, and presents new developments towards implementing a flexible and up-to-date dosimetric package in these 3D software tools, based on new developments in the field of radiation protection. The latest versions of these 3D tools are capable of more accurate risk estimation, permit more flexibility via a range of user choices, and are applicable to a wider range of irradiation situations than their predecessors. (paper)

Real-time 3D radiation risk assessment supporting simulation of work in nuclear environments.

Science.gov (United States)

Szőke, I; Louka, M N; Bryntesen, T R; Bratteli, J; Edvardsen, S T; RøEitrheim, K K; Bodor, K

2014-06-01

This paper describes the latest developments at the Institute for Energy Technology (IFE) in Norway, in the field of real-time 3D (three-dimensional) radiation risk assessment for the support of work simulation in nuclear environments. 3D computer simulation can greatly facilitate efficient work planning, briefing, and training of workers. It can also support communication within and between work teams, and with advisors, regulators, the media and public, at all the stages of a nuclear installation's lifecycle. Furthermore, it is also a beneficial tool for reviewing current work practices in order to identify possible gaps in procedures, as well as to support the updating of international recommendations, dissemination of experience, and education of the current and future generation of workers.IFE has been involved in research and development into the application of 3D computer simulation and virtual reality (VR) technology to support work in radiological environments in the nuclear sector since the mid 1990s. During this process, two significant software tools have been developed, the VRdose system and the Halden Planner, and a number of publications have been produced to contribute to improving the safety culture in the nuclear industry.This paper describes the radiation risk assessment techniques applied in earlier versions of the VRdose system and the Halden Planner, for visualising radiation fields and calculating dose, and presents new developments towards implementing a flexible and up-to-date dosimetric package in these 3D software tools, based on new developments in the field of radiation protection. The latest versions of these 3D tools are capable of more accurate risk estimation, permit more flexibility via a range of user choices, and are applicable to a wider range of irradiation situations than their predecessors.

Introduction to programmable shader in real time 3D computer graphics

International Nuclear Information System (INIS)

Uemura, Syuhei; Kirii, Keisuke; Matsumura, Makoto; Matsumoto, Kenichiro

2004-01-01

Nevertheless the visualization of large-scale data had played the important role which influences informational usefulness in the basic field of science, the high-end graphics system or the exclusive system needed to be used. On the other hand, in recent years, the progress speed of the capability of the video game console or the graphics board for PC has a remarkable thing reflecting the expansion tendency of TV game market in and outside the country. Especially, the ''programmable shader'' technology in which the several graphics chip maker has started implementation is the innovative technology which can also be called change of generation of real-time 3D graphics, and the scope of the visual expression technique has spread greatly. However, it cannot say that the development/use environment of software which used programmable shader are fully generalized, and the present condition is that the grope of the applied technology to overly the ultra high-speed/quality visualization of large-scale data is not prograssing. We provide the outline of programmable shader technology and consider the possibility of the application to large-scale data visualization. (author)

2D virtual texture on 3D real object with coded structured light

Science.gov (United States)

Molinier, Thierry; Fofi, David; Salvi, Joaquim; Gorria, Patrick

2008-02-01

Augmented reality is used to improve color segmentation on human body or on precious no touch artifacts. We propose a technique to project a synthesized texture on real object without contact. Our technique can be used in medical or archaeological application. By projecting a suitable set of light patterns onto the surface of a 3D real object and by capturing images with a camera, a large number of correspondences can be found and the 3D points can be reconstructed. We aim to determine these points of correspondence between cameras and projector from a scene without explicit points and normals. We then project an adjusted texture onto the real object surface. We propose a global and automatic method to virtually texture a 3D real object.

Visual simultaneous localization and mapping (VSLAM) methods applied to indoor 3D topographical and radiological mapping in real-time

International Nuclear Information System (INIS)

Hautot, F.; Dubart, P.; Chagneau, B.; Bacri, C.O.; Abou-Khalil, R.

2017-01-01

New developments in the field of robotics and computer vision enable to merge sensors to allow fast real-time localization of radiological measurements in the space/volume with near real-time radioactive sources identification and characterization. These capabilities lead nuclear investigations to a more efficient way for operators' dosimetry evaluation, intervention scenarios and risks mitigation and simulations, such as accidents in unknown potentially contaminated areas or during dismantling operations. This paper will present new progresses in merging RGB-D camera based on SLAM (Simultaneous Localization and Mapping) systems and nuclear measurement in motion methods in order to detect, locate, and evaluate the activity of radioactive sources in 3-dimensions

Real-time target tracking of soft tissues in 3D ultrasound images based on robust visual information and mechanical simulation.

Science.gov (United States)

Royer, Lucas; Krupa, Alexandre; Dardenne, Guillaume; Le Bras, Anthony; Marchand, Eric; Marchal, Maud

2017-01-01

In this paper, we present a real-time approach that allows tracking deformable structures in 3D ultrasound sequences. Our method consists in obtaining the target displacements by combining robust dense motion estimation and mechanical model simulation. We perform evaluation of our method through simulated data, phantom data, and real-data. Results demonstrate that this novel approach has the advantage of providing correct motion estimation regarding different ultrasound shortcomings including speckle noise, large shadows and ultrasound gain variation. Furthermore, we show the good performance of our method with respect to state-of-the-art techniques by testing on the 3D databases provided by MICCAI CLUST'14 and CLUST'15 challenges. Copyright © 2016 Elsevier B.V. All rights reserved.

Development of real-time motion capture system for 3D on-line games linked with virtual character

Science.gov (United States)

Kim, Jong Hyeong; Ryu, Young Kee; Cho, Hyung Suck

2004-10-01

Motion tracking method is being issued as essential part of the entertainment, medical, sports, education and industry with the development of 3-D virtual reality. Virtual human character in the digital animation and game application has been controlled by interfacing devices; mouse, joysticks, midi-slider, and so on. Those devices could not enable virtual human character to move smoothly and naturally. Furthermore, high-end human motion capture systems in commercial market are expensive and complicated. In this paper, we proposed a practical and fast motion capturing system consisting of optic sensors, and linked the data with 3-D game character with real time. The prototype experiment setup is successfully applied to a boxing game which requires very fast movement of human character.

Use of real-time three-dimensional transesophageal echocardiography in type A aortic dissections: Advantages of 3D TEE illustrated in three cases

Directory of Open Access Journals (Sweden)

Cindy J Wang

2015-01-01

Full Text Available Stanford type A aortic dissections often present to the hospital requiring emergent surgical intervention. Initial diagnosis is usually made by computed tomography; however transesophageal echocardiography (TEE can further characterize aortic dissections with specific advantages: It may be performed on an unstable patient, it can be used intra-operatively, and it has the ability to provide continuous real-time information. Three-dimensional (3D TEE has become more accessible over recent years allowing it to serve as an additional tool in the operating room. We present a case series of three patients presenting with type A aortic dissections and the advantages of intra-operative 3D TEE to diagnose the extent of dissection in each case. Prior case reports have demonstrated the use of 3D TEE in type A aortic dissections to characterize the extent of dissection and involvement of neighboring structures. In our three cases described, 3D TEE provided additional understanding of spatial relationships between the dissection flap and neighboring structures such as the aortic valve and coronary orifices that were not fully appreciated with two-dimensional TEE, which affected surgical decisions in the operating room. This case series demonstrates the utility and benefit of real-time 3D TEE during intra-operative management of a type A aortic dissection.

An Embedded Real-Time Red Peach Detection System Based on an OV7670 Camera, ARM Cortex-M4 Processor and 3D Look-Up Tables

Directory of Open Access Journals (Sweden)

Marcel Tresanchez

2012-10-01

Full Text Available This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6 processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.

An embedded real-time red peach detection system based on an OV7670 camera, ARM cortex-M4 processor and 3D look-up tables.

Science.gov (United States)

Teixidó, Mercè; Font, Davinia; Pallejà, Tomàs; Tresanchez, Marcel; Nogués, Miquel; Palacín, Jordi

2012-10-22

This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6) processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT) defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.

VR-Planets : a 3D immersive application for real-time flythrough images of planetary surfaces

Science.gov (United States)

Civet, François; Le Mouélic, Stéphane

2015-04-01

During the last two decades, a fleet of planetary probes has acquired several hundred gigabytes of images of planetary surfaces. Mars has been particularly well covered thanks to the Mars Global Surveyor, Mars Express and Mars Reconnaissance Orbiter spacecrafts. HRSC, CTX, HiRISE instruments allowed the computation of Digital Elevation Models with a resolution from hundreds of meters up to 1 meter per pixel, and corresponding orthoimages with a resolution from few hundred of meters up to 25 centimeters per pixel. The integration of such huge data sets into a system allowing user-friendly manipulation either for scientific investigation or for public outreach can represent a real challenge. We are investigating how innovative tools can be used to freely fly over reconstructed landscapes in real time, using technologies derived from the game industry and virtual reality. We have developed an application based on a game engine, using planetary data, to immerse users in real martian landscapes. The user can freely navigate in each scene at full spatial resolution using a game controller. The actual rendering is compatible with several visualization devices such as 3D active screen, virtual reality headsets (Oculus Rift), and android devices.

Holovideo: Real-time 3D range video encoding and decoding on GPU

Science.gov (United States)

Karpinsky, Nikolaus; Zhang, Song

2012-02-01

We present a 3D video-encoding technique called Holovideo that is capable of encoding high-resolution 3D videos into standard 2D videos, and then decoding the 2D videos back into 3D rapidly without significant loss of quality. Due to the nature of the algorithm, 2D video compression such as JPEG encoding with QuickTime Run Length Encoding (QTRLE) can be applied with little quality loss, resulting in an effective way to store 3D video at very small file sizes. We found that under a compression ratio of 134:1, Holovideo to OBJ file format, the 3D geometry quality drops at a negligible level. Several sets of 3D videos were captured using a structured light scanner, compressed using the Holovideo codec, and then uncompressed and displayed to demonstrate the effectiveness of the codec. With the use of OpenGL Shaders (GLSL), the 3D video codec can encode and decode in realtime. We demonstrated that for a video size of 512×512, the decoding speed is 28 frames per second (FPS) with a laptop computer using an embedded NVIDIA GeForce 9400 m graphics processing unit (GPU). Encoding can be done with this same setup at 18 FPS, making this technology suitable for applications such as interactive 3D video games and 3D video conferencing.

Real-time measurement of dynamic structure for Pd-D system in heavy-water electrolysis cell

International Nuclear Information System (INIS)

Wang Jun; Zeng Xianxin; Yang Jilian; Zhang Baisheng; Ruan Jinghui

1993-01-01

The real-time dynamic structure of Pd-D system in D 2 O electrolysis cell is measured on neutron powder diffractometer in CIAE. Diffraction patterns in 2 θ range of 34 degree-95 degree are obtained under the conditions of electrolysing for 0, 3 and 48 A ·h respectively, and the gradual transition of Pd-D system from α-phase to β-phase is observed. The real-time measurements of β peak of (220) reflection show that intensity of β peak almost reaches the saturation point after electrolysing for 0.65 A · h and increases slowly with further electrolysis afterwards

Real-time volumetric image reconstruction and 3D tumor localization based on a single x-ray projection image for lung cancer radiotherapy.

Science.gov (United States)

Li, Ruijiang; Jia, Xun; Lewis, John H; Gu, Xuejun; Folkerts, Michael; Men, Chunhua; Jiang, Steve B

2010-06-01

To develop an algorithm for real-time volumetric image reconstruction and 3D tumor localization based on a single x-ray projection image for lung cancer radiotherapy. Given a set of volumetric images of a patient at N breathing phases as the training data, deformable image registration was performed between a reference phase and the other N-1 phases, resulting in N-1 deformation vector fields (DVFs). These DVFs can be represented efficiently by a few eigenvectors and coefficients obtained from principal component analysis (PCA). By varying the PCA coefficients, new DVFs can be generated, which, when applied on the reference image, lead to new volumetric images. A volumetric image can then be reconstructed from a single projection image by optimizing the PCA coefficients such that its computed projection matches the measured one. The 3D location of the tumor can be derived by applying the inverted DVF on its position in the reference image. The algorithm was implemented on graphics processing units (GPUs) to achieve real-time efficiency. The training data were generated using a realistic and dynamic mathematical phantom with ten breathing phases. The testing data were 360 cone beam projections corresponding to one gantry rotation, simulated using the same phantom with a 50% increase in breathing amplitude. The average relative image intensity error of the reconstructed volumetric images is 6.9% +/- 2.4%. The average 3D tumor localization error is 0.8 +/- 0.5 mm. On an NVIDIA Tesla C1060 GPU card, the average computation time for reconstructing a volumetric image from each projection is 0.24 s (range: 0.17 and 0.35 s). The authors have shown the feasibility of reconstructing volumetric images and localizing tumor positions in 3D in near real-time from a single x-ray image.

Integration of virtual and real scenes within an integral 3D imaging environment

Science.gov (United States)

Ren, Jinsong; Aggoun, Amar; McCormick, Malcolm

2002-11-01

The Imaging Technologies group at De Montfort University has developed an integral 3D imaging system, which is seen as the most likely vehicle for 3D television avoiding psychological effects. To create real fascinating three-dimensional television programs, a virtual studio that performs the task of generating, editing and integrating the 3D contents involving virtual and real scenes is required. The paper presents, for the first time, the procedures, factors and methods of integrating computer-generated virtual scenes with real objects captured using the 3D integral imaging camera system. The method of computer generation of 3D integral images, where the lens array is modelled instead of the physical camera is described. In the model each micro-lens that captures different elemental images of the virtual scene is treated as an extended pinhole camera. An integration process named integrated rendering is illustrated. Detailed discussion and deep investigation are focused on depth extraction from captured integral 3D images. The depth calculation method from the disparity and the multiple baseline method that is used to improve the precision of depth estimation are also presented. The concept of colour SSD and its further improvement in the precision is proposed and verified.

A GPU-based framework for modeling real-time 3D lung tumor conformal dosimetry with subject-specific lung tumor motion

International Nuclear Information System (INIS)

Min Yugang; Santhanam, Anand; Ruddy, Bari H; Neelakkantan, Harini; Meeks, Sanford L; Kupelian, Patrick A

2010-01-01

In this paper, we present a graphics processing unit (GPU)-based simulation framework to calculate the delivered dose to a 3D moving lung tumor and its surrounding normal tissues, which are undergoing subject-specific lung deformations. The GPU-based simulation framework models the motion of the 3D volumetric lung tumor and its surrounding tissues, simulates the dose delivery using the dose extracted from a treatment plan using Pinnacle Treatment Planning System, Phillips, for one of the 3DCTs of the 4DCT and predicts the amount and location of radiation doses deposited inside the lung. The 4DCT lung datasets were registered with each other using a modified optical flow algorithm. The motion of the tumor and the motion of the surrounding tissues were simulated by measuring the changes in lung volume during the radiotherapy treatment using spirometry. The real-time dose delivered to the tumor for each beam is generated by summing the dose delivered to the target volume at each increase in lung volume during the beam delivery time period. The simulation results showed the real-time capability of the framework at 20 discrete tumor motion steps per breath, which is higher than the number of 4DCT steps (approximately 12) reconstructed during multiple breathing cycles.

A GPU-based framework for modeling real-time 3D lung tumor conformal dosimetry with subject-specific lung tumor motion

Energy Technology Data Exchange (ETDEWEB)

Min Yugang; Santhanam, Anand; Ruddy, Bari H [University of Central Florida, FL (United States); Neelakkantan, Harini; Meeks, Sanford L [M D Anderson Cancer Center Orlando, FL (United States); Kupelian, Patrick A, E-mail: anand.santhanam@orlandohealth.co [Department of Radiation Oncology, University of California, Los Angeles, CA (United States)

2010-09-07

In this paper, we present a graphics processing unit (GPU)-based simulation framework to calculate the delivered dose to a 3D moving lung tumor and its surrounding normal tissues, which are undergoing subject-specific lung deformations. The GPU-based simulation framework models the motion of the 3D volumetric lung tumor and its surrounding tissues, simulates the dose delivery using the dose extracted from a treatment plan using Pinnacle Treatment Planning System, Phillips, for one of the 3DCTs of the 4DCT and predicts the amount and location of radiation doses deposited inside the lung. The 4DCT lung datasets were registered with each other using a modified optical flow algorithm. The motion of the tumor and the motion of the surrounding tissues were simulated by measuring the changes in lung volume during the radiotherapy treatment using spirometry. The real-time dose delivered to the tumor for each beam is generated by summing the dose delivered to the target volume at each increase in lung volume during the beam delivery time period. The simulation results showed the real-time capability of the framework at 20 discrete tumor motion steps per breath, which is higher than the number of 4DCT steps (approximately 12) reconstructed during multiple breathing cycles.

A GPU-based framework for modeling real-time 3D lung tumor conformal dosimetry with subject-specific lung tumor motion.

Science.gov (United States)

Min, Yugang; Santhanam, Anand; Neelakkantan, Harini; Ruddy, Bari H; Meeks, Sanford L; Kupelian, Patrick A

2010-09-07

In this paper, we present a graphics processing unit (GPU)-based simulation framework to calculate the delivered dose to a 3D moving lung tumor and its surrounding normal tissues, which are undergoing subject-specific lung deformations. The GPU-based simulation framework models the motion of the 3D volumetric lung tumor and its surrounding tissues, simulates the dose delivery using the dose extracted from a treatment plan using Pinnacle Treatment Planning System, Phillips, for one of the 3DCTs of the 4DCT and predicts the amount and location of radiation doses deposited inside the lung. The 4DCT lung datasets were registered with each other using a modified optical flow algorithm. The motion of the tumor and the motion of the surrounding tissues were simulated by measuring the changes in lung volume during the radiotherapy treatment using spirometry. The real-time dose delivered to the tumor for each beam is generated by summing the dose delivered to the target volume at each increase in lung volume during the beam delivery time period. The simulation results showed the real-time capability of the framework at 20 discrete tumor motion steps per breath, which is higher than the number of 4DCT steps (approximately 12) reconstructed during multiple breathing cycles.

Real-time high resolution 3D imaging of the lyme disease spirochete adhering to and escaping from the vasculature of a living host.

Directory of Open Access Journals (Sweden)

Tara J Moriarty

2008-06-01

Full Text Available Pathogenic spirochetes are bacteria that cause a number of emerging and re-emerging diseases worldwide, including syphilis, leptospirosis, relapsing fever, and Lyme borreliosis. They navigate efficiently through dense extracellular matrix and cross the blood-brain barrier by unknown mechanisms. Due to their slender morphology, spirochetes are difficult to visualize by standard light microscopy, impeding studies of their behavior in situ. We engineered a fluorescent infectious strain of Borrelia burgdorferi, the Lyme disease pathogen, which expressed green fluorescent protein (GFP. Real-time 3D and 4D quantitative analysis of fluorescent spirochete dissemination from the microvasculature of living mice at high resolution revealed that dissemination was a multi-stage process that included transient tethering-type associations, short-term dragging interactions, and stationary adhesion. Stationary adhesions and extravasating spirochetes were most commonly observed at endothelial junctions, and translational motility of spirochetes appeared to play an integral role in transendothelial migration. To our knowledge, this is the first report of high resolution 3D and 4D visualization of dissemination of a bacterial pathogen in a living mammalian host, and provides the first direct insight into spirochete dissemination in vivo.

SUPRA: open-source software-defined ultrasound processing for real-time applications : A 2D and 3D pipeline from beamforming to B-mode.

Science.gov (United States)

Göbl, Rüdiger; Navab, Nassir; Hennersperger, Christoph

2018-06-01

Research in ultrasound imaging is limited in reproducibility by two factors: First, many existing ultrasound pipelines are protected by intellectual property, rendering exchange of code difficult. Second, most pipelines are implemented in special hardware, resulting in limited flexibility of implemented processing steps on such platforms. With SUPRA, we propose an open-source pipeline for fully software-defined ultrasound processing for real-time applications to alleviate these problems. Covering all steps from beamforming to output of B-mode images, SUPRA can help improve the reproducibility of results and make modifications to the image acquisition mode accessible to the research community. We evaluate the pipeline qualitatively, quantitatively, and regarding its run time. The pipeline shows image quality comparable to a clinical system and backed by point spread function measurements a comparable resolution. Including all processing stages of a usual ultrasound pipeline, the run-time analysis shows that it can be executed in 2D and 3D on consumer GPUs in real time. Our software ultrasound pipeline opens up the research in image acquisition. Given access to ultrasound data from early stages (raw channel data, radiofrequency data), it simplifies the development in imaging. Furthermore, it tackles the reproducibility of research results, as code can be shared easily and even be executed without dedicated ultrasound hardware.

Real-time 3D visualization of cellular rearrangements during cardiac valve formation.

Science.gov (United States)

Pestel, Jenny; Ramadass, Radhan; Gauvrit, Sebastien; Helker, Christian; Herzog, Wiebke; Stainier, Didier Y R

2016-06-15

During cardiac valve development, the single-layered endocardial sheet at the atrioventricular canal (AVC) is remodeled into multilayered immature valve leaflets. Most of our knowledge about this process comes from examining fixed samples that do not allow a real-time appreciation of the intricacies of valve formation. Here, we exploit non-invasive in vivo imaging techniques to identify the dynamic cell behaviors that lead to the formation of the immature valve leaflets. We find that in zebrafish, the valve leaflets consist of two sets of endocardial cells at the luminal and abluminal side, which we refer to as luminal cells (LCs) and abluminal cells (ALCs), respectively. By analyzing cellular rearrangements during valve formation, we observed that the LCs and ALCs originate from the atrium and ventricle, respectively. Furthermore, we utilized Wnt/β-catenin and Notch signaling reporter lines to distinguish between the LCs and ALCs, and also found that cardiac contractility and/or blood flow is necessary for the endocardial expression of these signaling reporters. Thus, our 3D analyses of cardiac valve formation in zebrafish provide fundamental insights into the cellular rearrangements underlying this process. © 2016. Published by The Company of Biologists Ltd.

A LOW-COST AND LIGHTWEIGHT 3D INTERACTIVE REAL ESTATE-PURPOSED INDOOR VIRTUAL REALITY APPLICATION

Directory of Open Access Journals (Sweden)

K. Ozacar

2017-11-01

Full Text Available Interactive 3D architectural indoor design have been more popular after it benefited from Virtual Reality (VR technologies. VR brings computer-generated 3D content to real life scale and enable users to observe immersive indoor environments so that users can directly modify it. This opportunity enables buyers to purchase a property off-the-plan cheaper through virtual models. Instead of showing property through 2D plan or renders, this visualized interior architecture of an on-sale unbuilt property is demonstrated beforehand so that the investors have an impression as if they were in the physical building. However, current applications either use highly resource consuming software, or are non-interactive, or requires specialist to create such environments. In this study, we have created a real-estate purposed low-cost high quality fully interactive VR application that provides a realistic interior architecture of the property by using free and lightweight software: Sweet Home 3D and Unity. A preliminary study showed that participants generally liked proposed real estate-purposed VR application, and it satisfied the expectation of the property buyers.

a Low-Cost and Lightweight 3d Interactive Real Estate-Purposed Indoor Virtual Reality Application

Science.gov (United States)

Ozacar, K.; Ortakci, Y.; Kahraman, I.; Durgut, R.; Karas, I. R.

2017-11-01

Interactive 3D architectural indoor design have been more popular after it benefited from Virtual Reality (VR) technologies. VR brings computer-generated 3D content to real life scale and enable users to observe immersive indoor environments so that users can directly modify it. This opportunity enables buyers to purchase a property off-the-plan cheaper through virtual models. Instead of showing property through 2D plan or renders, this visualized interior architecture of an on-sale unbuilt property is demonstrated beforehand so that the investors have an impression as if they were in the physical building. However, current applications either use highly resource consuming software, or are non-interactive, or requires specialist to create such environments. In this study, we have created a real-estate purposed low-cost high quality fully interactive VR application that provides a realistic interior architecture of the property by using free and lightweight software: Sweet Home 3D and Unity. A preliminary study showed that participants generally liked proposed real estate-purposed VR application, and it satisfied the expectation of the property buyers.

Programmering af applikationer med dSPACE real-time værktøjer

DEFF Research Database (Denmark)

Voigt, Kristian

1998-01-01

real-time direkte på et virkeligt system. Reguleringen af systemet sker vha. et DSP- og I/O-kort. En model af systemet opbygges vha. Matlab/Simulink fra firmaet The Mathworks. Modellen oversættes til C-kode vha. Real-Time Workshop fra firmaet The Mathworks. For at gøre C-koden hardwarespecifik bruges...... software fra hardwareleverandøren - dSPACE. Firmaet dSPACE har desuden levereret software til at monitorere real-time værdier i systemet, og software til at ændre på parametre i modellen i real-time.I brugervejledningens Appendix F findes et eksempel, der gennemgår hele forløbet med opstart af programmer...

A centrifugal direct recombinase polymerase amplification (direct-RPA) microdevice for multiplex and real-time identification of food poisoning bacteria.

Science.gov (United States)

Choi, Goro; Jung, Jae Hwan; Park, Byung Hyun; Oh, Seung Jun; Seo, Ji Hyun; Choi, Jong Seob; Kim, Do Hyun; Seo, Tae Seok

2016-06-21

In this study, we developed a centrifugal direct recombinase polymerase amplification (direct-RPA) microdevice for multiplex and real-time identification of food poisoning bacteria contaminated milk samples. The microdevice was designed to contain identical triplicate functional units and each unit has four reaction chambers, thereby making it possible to perform twelve direct-RPA reactions simultaneously. The integrated microdevice consisted of two layers: RPA reagents were injected in the top layer, while spiked milk samples with food poisoning bacteria were loaded into sample reservoirs in the bottom layer. For multiplex bacterial detection, the target gene-specific primers and probes were dried in each reaction chamber. The introduced samples and reagents could be equally aliquoted and dispensed into each reaction chamber by centrifugal force, and then the multiplex direct-RPA reaction was executed. The target genes of bacteria spiked in milk could be amplified at 39 °C without a DNA extraction step by using the direct-RPA cocktails, which were a combination of a direct PCR buffer and RPA enzymes. As the target gene amplification proceeded, the increased fluorescence signals coming from the reaction chambers were recorded in real-time at an interval of 2 min. The entire process, including the sample distribution, the direct-RPA reaction, and the real-time analysis, was accomplished with a custom-made portable genetic analyzer and a miniaturized optical detector. Monoplex, duplex, and triplex food poisoning bacteria (Salmonella enterica, Escherichia coli O157:H7, and Vibrio parahaemolyticus) detection was successfully performed with a detection sensitivity of 4 cells per 3.2 μL of milk samples within 30 min. By implementing the direct-PRA on the miniaturized centrifugal microsystem, the on-site food poisoning bacteria analysis would be feasible with high speed, sensitivity, and multiplicity.

Real-time 3D internal marker tracking during arc radiotherapy by the use of combined MV-kV imaging.

Science.gov (United States)

Liu, W; Wiersma, R D; Mao, W; Luxton, G; Xing, L

2008-12-21

To minimize the adverse dosimetric effect caused by tumor motion, it is desirable to have real-time knowledge of the tumor position throughout the beam delivery process. A promising technique to realize the real-time image guided scheme in external beam radiation therapy is through the combined use of MV and onboard kV beam imaging. The success of this MV-kV triangulation approach for fixed-gantry radiation therapy has been demonstrated. With the increasing acceptance of modern arc radiotherapy in the clinics, a timely and clinically important question is whether the image guidance strategy can be extended to arc therapy to provide the urgently needed real-time tumor motion information. While conceptually feasible, there are a number of theoretical and practical issues specific to the arc delivery that need to be resolved before clinical implementation. The purpose of this work is to establish a robust procedure of system calibration for combined MV and kV imaging for internal marker tracking during arc delivery and to demonstrate the feasibility and accuracy of the technique. A commercially available LINAC equipped with an onboard kV imager and electronic portal imaging device (EPID) was used for the study. A custom built phantom with multiple ball bearings was used to calibrate the stereoscopic MV-kV imaging system to provide the transformation parameters from imaging pixels to 3D world coordinates. The accuracy of the fiducial tracking system was examined using a 4D motion phantom capable of moving in accordance with a pre-programmed trajectory. Overall, spatial accuracy of MV-kV fiducial tracking during the arc delivery process for normal adult breathing amplitude and period was found to be better than 1 mm. For fast motion, the results depended on the imaging frame rates. The RMS error ranged from approximately 0.5 mm for the normal adult breathing pattern to approximately 1.5 mm for more extreme cases with a low imaging frame rate of 3.4 Hz. In general

Real-time 3D internal marker tracking during arc radiotherapy by the use of combined MV-kV imaging

International Nuclear Information System (INIS)

Liu, W; Wiersma, R D; Mao, W; Luxton, G; Xing, L

2008-01-01

To minimize the adverse dosimetric effect caused by tumor motion, it is desirable to have real-time knowledge of the tumor position throughout the beam delivery process. A promising technique to realize the real-time image guided scheme in external beam radiation therapy is through the combined use of MV and onboard kV beam imaging. The success of this MV-kV triangulation approach for fixed-gantry radiation therapy has been demonstrated. With the increasing acceptance of modern arc radiotherapy in the clinics, a timely and clinically important question is whether the image guidance strategy can be extended to arc therapy to provide the urgently needed real-time tumor motion information. While conceptually feasible, there are a number of theoretical and practical issues specific to the arc delivery that need to be resolved before clinical implementation. The purpose of this work is to establish a robust procedure of system calibration for combined MV and kV imaging for internal marker tracking during arc delivery and to demonstrate the feasibility and accuracy of the technique. A commercially available LINAC equipped with an onboard kV imager and electronic portal imaging device (EPID) was used for the study. A custom built phantom with multiple ball bearings was used to calibrate the stereoscopic MV-kV imaging system to provide the transformation parameters from imaging pixels to 3D world coordinates. The accuracy of the fiducial tracking system was examined using a 4D motion phantom capable of moving in accordance with a pre-programmed trajectory. Overall, spatial accuracy of MV-kV fiducial tracking during the arc delivery process for normal adult breathing amplitude and period was found to be better than 1 mm. For fast motion, the results depended on the imaging frame rates. The RMS error ranged from ∼0.5 mm for the normal adult breathing pattern to ∼1.5 mm for more extreme cases with a low imaging frame rate of 3.4 Hz. In general, highly accurate real-time

Computer Tool for Automatically Generated 3D Illustration in Real Time from Archaeological Scanned Pieces

Directory of Open Access Journals (Sweden)

Luis López

2012-11-01

Full Text Available The graphical documentation process of archaeological pieces requires the active involvement of a professional artist to recreate beautiful illustrations using a wide variety of expressive techniques. Frequently, the artist’s work is limited by the inconvenience of working only with the photographs of the pieces he is going to illustrate. This paper presents a software tool that allows the easy generation of illustrations in real time from 3D scanned models. The developed interface allows the user to simulate very elaborate artistic styles through the creation of diagrams by using the available virtual lights. The software processes the diagrams to render an illustration from any given angle or position. Among the available virtual lights, there are well known techniques as silhouettes enhancement, hatching or toon shading.

Modeling of a 3D CMOS sensor for time-of-flight measurements

Science.gov (United States)

Kuhla, Rico; Hosticka, Bedrich J.; Mengel, Peter; Listl, Ludwig

2004-02-01

A solid state 3D-CMOS camera system for direct time-of-flight image acquisition consisting of a CMOS imaging sensor, a laser diode module for active laser pulse illumination and all optics for image forming is presented, including MDSI & CDS algorithms for time-of-flight evaluation from intensity imaging. The investigation is carried out using ideal and real signals. For real signals the narrow infrared laser pulse of the laser diode module and the shutter function of the sensors column circuit were sampled by a new sampling procedure. A discrete sampled shutter function was recorded by using the impulse response of a narrow pulse of FWHM=50ps and an additional delay block with step size of Δτ = 0.25ns. A deterministic system model based on LTI transfer functions was developed. The visual shutter windows give a good understanding of differences between ideal and real output functions of measurement system. Simulations of shutter and laser pulse brought out an extended linear delay domain from MDSI. A stochastic model for the transfer function and photon noise in time domain was developed. We used the model to investigate noise in variation the laser pulse shutter configuration.

High-performance GPU-based rendering for real-time, rigid 2D/3D-image registration and motion prediction in radiation oncology.

Science.gov (United States)

Spoerk, Jakob; Gendrin, Christelle; Weber, Christoph; Figl, Michael; Pawiro, Supriyanto Ardjo; Furtado, Hugo; Fabri, Daniella; Bloch, Christoph; Bergmann, Helmar; Gröller, Eduard; Birkfellner, Wolfgang

2012-02-01

A common problem in image-guided radiation therapy (IGRT) of lung cancer as well as other malignant diseases is the compensation of periodic and aperiodic motion during dose delivery. Modern systems for image-guided radiation oncology allow for the acquisition of cone-beam computed tomography data in the treatment room as well as the acquisition of planar radiographs during the treatment. A mid-term research goal is the compensation of tumor target volume motion by 2D/3D Registration. In 2D/3D registration, spatial information on organ location is derived by an iterative comparison of perspective volume renderings, so-called digitally rendered radiographs (DRR) from computed tomography volume data, and planar reference x-rays. Currently, this rendering process is very time consuming, and real-time registration, which should at least provide data on organ position in less than a second, has not come into existence. We present two GPU-based rendering algorithms which generate a DRR of 512×512 pixels size from a CT dataset of 53 MB size at a pace of almost 100 Hz. This rendering rate is feasible by applying a number of algorithmic simplifications which range from alternative volume-driven rendering approaches - namely so-called wobbled splatting - to sub-sampling of the DRR-image by means of specialized raycasting techniques. Furthermore, general purpose graphics processing unit (GPGPU) programming paradigms were consequently utilized. Rendering quality and performance as well as the influence on the quality and performance of the overall registration process were measured and analyzed in detail. The results show that both methods are competitive and pave the way for fast motion compensation by rigid and possibly even non-rigid 2D/3D registration and, beyond that, adaptive filtering of motion models in IGRT. Copyright © 2011. Published by Elsevier GmbH.

High-performance GPU-based rendering for real-time, rigid 2D/3D-image registration and motion prediction in radiation oncology

Energy Technology Data Exchange (ETDEWEB)

Spoerk, Jakob; Gendrin, Christelle; Weber, Christoph [Medical University of Vienna (Austria). Center of Medical Physics and Biomedical Engineering] [and others

2012-07-01

A common problem in image-guided radiation therapy (IGRT) of lung cancer as well as other malignant diseases is the compensation of periodic and aperiodic motion during dose delivery. Modern systems for image-guided radiation oncology allow for the acquisition of cone-beam computed tomography data in the treatment room as well as the acquisition of planar radiographs during the treatment. A mid-term research goal is the compensation of tumor target volume motion by 2D/3D Registration. In 2D/3D registration, spatial information on organ location is derived by an iterative comparison of perspective volume renderings, so-called digitally rendered radiographs (DRR) from computed tomography volume data, and planar reference X-rays. Currently, this rendering process is very time consuming, and real-time registration, which should at least provide data on organ position in less than a second, has not come into existence. We present two GPU-based rendering algorithms which generate a DRR of 512 x 512 pixels size from a CT dataset of 53 MB size at a pace of almost 100 Hz. This rendering rate is feasible by applying a number of algorithmic simplifications which range from alternative volume-driven rendering approaches - namely so-called wobbled splatting - to sub-sampling of the DRR-image by means of specialized raycasting techniques. Furthermore, general purpose graphics processing unit (GPGPU) programming paradigms were consequently utilized. Rendering quality and performance as well as the influence on the quality and performance of the overall registration process were measured and analyzed in detail. The results show that both methods are competitive and pave the way for fast motion compensation by rigid and possibly even non-rigid 2D/3D registration and, beyond that, adaptive filtering of motion models in IGRT. (orig.)

Scene data fusion: Real-time standoff volumetric gamma-ray imaging

Energy Technology Data Exchange (ETDEWEB)

Barnowski, Ross [Department of Nuclear Engineering, UC Berkeley, 4155 Etcheverry Hall, MC 1730, Berkeley, CA 94720, United States of America (United States); Haefner, Andrew; Mihailescu, Lucian [Lawrence Berkeley National Lab - Applied Nuclear Physics, 1 Cyclotron Road, Berkeley, CA 94720, United States of America (United States); Vetter, Kai [Department of Nuclear Engineering, UC Berkeley, 4155 Etcheverry Hall, MC 1730, Berkeley, CA 94720, United States of America (United States); Lawrence Berkeley National Lab - Applied Nuclear Physics, 1 Cyclotron Road, Berkeley, CA 94720, United States of America (United States)

2015-11-11

An approach to gamma-ray imaging has been developed that enables near real-time volumetric (3D) imaging of unknown environments thus improving the utility of gamma-ray imaging for source-search and radiation mapping applications. The approach, herein dubbed scene data fusion (SDF), is based on integrating mobile radiation imagers with real-time tracking and scene reconstruction algorithms to enable a mobile mode of operation and 3D localization of gamma-ray sources. A 3D model of the scene, provided in real-time by a simultaneous localization and mapping (SLAM) algorithm, is incorporated into the image reconstruction reducing the reconstruction time and improving imaging performance. The SDF concept is demonstrated in this work with a Microsoft Kinect RGB-D sensor, a real-time SLAM solver, and a cart-based Compton imaging platform comprised of two 3D position-sensitive high purity germanium (HPGe) detectors. An iterative algorithm based on Compton kinematics is used to reconstruct the gamma-ray source distribution in all three spatial dimensions. SDF advances the real-world applicability of gamma-ray imaging for many search, mapping, and verification scenarios by improving the tractiblity of the gamma-ray image reconstruction and providing context for the 3D localization of gamma-ray sources within the environment in real-time.

An inexpensive underwater mine countermeasures simulator with real-time 3D after action review

Directory of Open Access Journals (Sweden)

Robert Stone

2016-10-01

Full Text Available This paper presents the results of a concept capability demonstration pilot study, the aim of which was to investigate how inexpensive gaming software and hardware technologies could be exploited in the development and evaluation of a simulator prototype for training Royal Navy mine clearance divers, specifically focusing on the detection and accurate reporting of the location and condition of underwater ordnance. The simulator was constructed using the Blender open source 3D modelling toolkit and game engine, and featured not only an interactive 3D editor for underwater scenario generation by instructors, but also a real-time, 3D After Action Review (AAR system for formative assessment and feedback. The simulated scenarios and AAR architecture were based on early human factors observations and briefings conducted at the UK's Defence Diving School (DDS, an organisation that provides basic military diving training for all Royal Navy and Army (Royal Engineers divers. An experimental pilot study was undertaken to determine whether or not basic navigational and mine detection components of diver performance could be improved as a result of exposing participants to the AAR system, delivered between simulated diving scenarios. The results suggest that the provision of AAR was accompanied by significant performance improvements in the positive identification of simulated underwater ordnance (in contrast to non-ordnance objects and on participants' description of their location, their immediate in-water or seabed context and their structural condition. Only marginal improvements were found with participants' navigational performance in terms of their deviation accuracies from a pre-programmed expert search path. Overall, this project contributes to the growing corpus of evidence supporting the development of simulators that demonstrate the value of exploiting open source gaming software and the significance of adopting established games design

Real-time protection of the Ohmic heating coil force limits in DIII-D

International Nuclear Information System (INIS)

Broesch, J.D.; Scoville, J.T.; Hyatt, A.W.; Coon, R.M.

1997-11-01

The maximum safe operating limits of the DIII-D tokamak are determined by the force produced in the ohmic heating coil and the toroidal field coil during a plasma pulse. This force is directly proportional to the product of the current in the coils. Historically, the current limits for each coil were set statically before each pulse without regard for the time varying nature of the currents. In order to allow the full time-dependent capability of the ohmic coil to be used, a system was developed for monitoring the product of the currents dynamically and making appropriate adjustments in real time. This paper discusses the purpose, implementation, and results of this work

Real-time radiography

International Nuclear Information System (INIS)

Bossi, R.H.; Oien, C.T.

1981-01-01

Real-time radiography is used for imaging both dynamic events and static objects. Fluorescent screens play an important role in converting radiation to light, which is then observed directly or intensified and detected. The radiographic parameters for real-time radiography are similar to conventional film radiography with special emphasis on statistics and magnification. Direct-viewing fluoroscopy uses the human eye as a detector of fluorescent screen light or the light from an intensifier. Remote-viewing systems replace the human observer with a television camera. The remote-viewing systems have many advantages over the direct-viewing conditions such as safety, image enhancement, and the capability to produce permanent records. This report reviews real-time imaging system parameters and components

Collaboration system for simulation using commercial Web3D

International Nuclear Information System (INIS)

Okamoto, Koji; Ohkubo, Kohei

2004-01-01

The Web-3D system has been widely used in the internet. It can show the 3D environment easily and friendly. In order to develop the network collaboration system, the Web-3D system is used as the front end of the visualization tool. The 3D geometries have been transferred from the server using HTTP with the viewpoint, one of the commercialized Web-3D. The simulation results are directly transferred to the client using the TCP/IP socket with JAVA. The viewpoint can be controlled by the JAVA, so the transferred simulation data are displayed on the web, in real-time. The multi-client system enables the visualization of the real-time simulation results with remote site. The same results are shown on the remote web site, simultaneously. This means the remote collaboration can be achievable for the real-time simulation. Also, the system has the feedback system, which control the simulation parameter remotely. In this prototype system, the key feature of the collaboration system are discussed using the viewpoint as the frontend. (author)

Reconstruction of 3d video from 2d real-life sequences

Directory of Open Access Journals (Sweden)

Eduardo Ramos Diaz

2010-01-01

Full Text Available En este artículo, se propone un método novedoso que permite generar secuencias de video en 3D usando secuencias de video reales en 2D. La reconstrucción de la secuencia de video en 3D se realiza usando el cálculo del mapa de profundidad y la síntesis de anaglifos. El mapa de profundidad es formado usando la técnica de correspondencia estéreo basada en la minimización de la energía de error global a partir de funciones de suavizado. La construcción del anaglifo es realizada usando la alineación del componente de color interpolándolo con el mapa de profundidad previamente formado. Adicionalmente, se emplea la transformación del mapa de profundidad para reducir el rango dinámico de los valores de disparidad, minimizando el efecto fantasma mejorando la preservación de color. Se usaron numerosas secuencias de video a color reales que contienen diferentes tipos de movimientos como traslacional, rotacional, acercamiento, y la combinación de los anteriores, demostrando buen funcionamiento visual de la reconstrucción de secuencias de video en 3D propuesta.

Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain-machine interfaces

Science.gov (United States)

Abbott, W. W.; Faisal, A. A.

2012-08-01

Eye movements are highly correlated with motor intentions and are often retained by patients with serious motor deficiencies. Despite this, eye tracking is not widely used as control interface for movement in impaired patients due to poor signal interpretation and lack of control flexibility. We propose that tracking the gaze position in 3D rather than 2D provides a considerably richer signal for human machine interfaces by allowing direct interaction with the environment rather than via computer displays. We demonstrate here that by using mass-produced video-game hardware, it is possible to produce an ultra-low-cost binocular eye-tracker with comparable performance to commercial systems, yet 800 times cheaper. Our head-mounted system has 30 USD material costs and operates at over 120 Hz sampling rate with a 0.5-1 degree of visual angle resolution. We perform 2D and 3D gaze estimation, controlling a real-time volumetric cursor essential for driving complex user interfaces. Our approach yields an information throughput of 43 bits s-1, more than ten times that of invasive and semi-invasive brain-machine interfaces (BMIs) that are vastly more expensive. Unlike many BMIs our system yields effective real-time closed loop control of devices (10 ms latency), after just ten minutes of training, which we demonstrate through a novel BMI benchmark—the control of the video arcade game ‘Pong’.

Methodology for Time-Domain Estimation of Storm-Time Electric Fields Using the 3D Earth Impedance

Science.gov (United States)

Kelbert, A.; Balch, C. C.; Pulkkinen, A. A.; Egbert, G. D.; Love, J. J.; Rigler, E. J.; Fujii, I.

2016-12-01

Magnetic storms can induce geoelectric fields in the Earth's electrically conducting interior, interfering with the operations of electric-power grid industry. The ability to estimate these electric fields at Earth's surface in close to real-time and to provide local short-term predictions would improve the ability of the industry to protect their operations. At any given time, the electric field at the Earth's surface is a function of the time-variant magnetic activity (driven by the solar wind), and the local electrical conductivity structure of the Earth's crust and mantle. For this reason, implementation of an operational electric field estimation service requires an interdisciplinary, collaborative effort between space science, real-time space weather operations, and solid Earth geophysics. We highlight in this talk an ongoing collaboration between USGS, NOAA, NASA, Oregon State University, and the Japan Meteorological Agency, to develop algorithms that can be used for scenario analyses and which might be implemented in a real-time, operational setting. We discuss the development of a time domain algorithm that employs discrete time domain representation of the impedance tensor for a realistic 3D Earth, known as the discrete time impulse response (DTIR), convolved with the local magnetic field time series, to estimate the local electric field disturbances. The algorithm is validated against measured storm-time electric field data collected in the United States and Japan. We also discuss our plans for operational real-time electric field estimation using 3D Earth impedances.

A Real-Time Magnetoencephalography Brain-Computer Interface Using Interactive 3D Visualization and the Hadoop Ecosystem

Directory of Open Access Journals (Sweden)

Wilbert A. McClay

2015-09-01

Full Text Available Ecumenically, the fastest growing segment of Big Data is human biology-related data and the annual data creation is on the order of zetabytes. The implications are global across industries, of which the treatment of brain related illnesses and trauma could see the most significant and immediate effects. The next generation of health care IT and sensory devices are acquiring and storing massive amounts of patient related data. An innovative Brain-Computer Interface (BCI for interactive 3D visualization is presented utilizing the Hadoop Ecosystem for data analysis and storage. The BCI is an implementation of Bayesian factor analysis algorithms that can distinguish distinct thought actions using magneto encephalographic (MEG brain signals. We have collected data on five subjects yielding 90% positive performance in MEG mid- and post-movement activity. We describe a driver that substitutes the actions of the BCI as mouse button presses for real-time use in visual simulations. This process has been added into a flight visualization demonstration. By thinking left or right, the user experiences the aircraft turning in the chosen direction. The driver components of the BCI can be compiled into any software and substitute a user’s intent for specific keyboard strikes or mouse button presses. The BCI’s data analytics OPEN ACCESS Brain. Sci. 2015, 5 420 of a subject’s MEG brainwaves and flight visualization performance are stored and analyzed using the Hadoop Ecosystem as a quick retrieval data warehouse.

A rapid and direct real time PCR-based method for identification of Salmonella spp

DEFF Research Database (Denmark)

Rodriguez-Lazaro, D.; Hernández, Marta; Esteve, T.

2003-01-01

The aim of this work was the validation of a rapid, real-time PCR assay based on TaqMan((R)) technology for the unequivocal identification of Salmonella spp. to be used directly on an agar-grown colony. A real-time PCR system targeting at the Salmonella spp. invA gene was optimized and validated ...

3D wide field-of-view Gabor-domain optical coherence microscopy advancing real-time in-vivo imaging and metrology

Science.gov (United States)

Canavesi, Cristina; Cogliati, Andrea; Hayes, Adam; Tankam, Patrice; Santhanam, Anand; Rolland, Jannick P.

2017-02-01

Real-time volumetric high-definition wide-field-of-view in-vivo cellular imaging requires micron-scale resolution in 3D. Compactness of the handheld device and distortion-free images with cellular resolution are also critically required for onsite use in clinical applications. By integrating a custom liquid lens-based microscope and a dual-axis MEMS scanner in a compact handheld probe, Gabor-domain optical coherence microscopy (GD-OCM) breaks the lateral resolution limit of optical coherence tomography through depth, overcoming the tradeoff between numerical aperture and depth of focus, enabling advances in biotechnology. Furthermore, distortion-free imaging with no post-processing is achieved with a compact, lightweight handheld MEMS scanner that obtained a 12-fold reduction in volume and 17-fold reduction in weight over a previous dual-mirror galvanometer-based scanner. Approaching the holy grail of medical imaging - noninvasive real-time imaging with histologic resolution - GD-OCM demonstrates invariant resolution of 2 μm throughout a volume of 1 x 1 x 0.6 mm3, acquired and visualized in less than 2 minutes with parallel processing on graphics processing units. Results on the metrology of manufactured materials and imaging of human tissue with GD-OCM are presented.

3D-Pathology: a real-time system for quantitative diagnostic pathology and visualisation in 3D

Science.gov (United States)

Gottrup, Christian; Beckett, Mark G.; Hager, Henrik; Locht, Peter

2005-02-01

This paper presents the results of the 3D-Pathology project conducted under the European EC Framework 5. The aim of the project was, through the application of 3D image reconstruction and visualization techniques, to improve the diagnostic and prognostic capabilities of medical personnel when analyzing pathological specimens using transmitted light microscopy. A fully automated, computer-controlled microscope system has been developed to capture 3D images of specimen content. 3D image reconstruction algorithms have been implemented and applied to the acquired volume data in order to facilitate the subsequent 3D visualization of the specimen. Three potential application fields, immunohistology, cromogenic in situ hybridization (CISH) and cytology, have been tested using the prototype system. For both immunohistology and CISH, use of the system furnished significant additional information to the pathologist.

"Eyes On The Solar System": A Real-time, 3D-Interactive Tool to Teach the Wonder of Planetary Science

Science.gov (United States)

Hussey, K. J.

2011-10-01

NASA's Jet Propulsion Laboratory is using videogame technology to immerse students, the general public and mission personnel in our solar system and beyond. "Eyes on the Solar System," a cross-platform, real-time, 3D-interactive application that runs inside a Web browser, was released worldwide late last year (solarsystem.nasa.gov/eyes). It gives users an extraordinary view of our solar system by virtually transporting them across space and time to make first-person observations of spacecraft and NASA/ESA missions in action. Key scientific results illustrated with video presentations and supporting imagery are imbedded contextually into the solar system. The presentation will include a detailed demonstration of the software along with a description/discussion of how this technology can be adapted for education and public outreach, as well as a preview of coming attractions. This work is being conducted by the Visualization Technology Applications and Development Group at NASA's Jet Propulsion Laboratory, the same team responsible for "Eyes on the Earth 3D," which can be viewed at climate.nasa.gov/Eyes.html.

Robotic 4D ultrasound solution for real-time visualization and teleoperation

Directory of Open Access Journals (Sweden)

Al-Badri Mohammed

2017-09-01

Full Text Available Automation of the image acquisition process via robotic solutions offer a large leap towards resolving ultrasound’s user-dependency. This paper, as part of a larger project aimed to develop a multipurpose 4d-ultrasonic force-sensitive robot for medical applications, focuses on achieving real-time remote visualisation for 4d ultrasound image transfer. This was possible through implementing our software modification on a GE Vivid 7 Dimension workstation, which operates a matrix array probe controlled by a KUKA LBR iiwa 7 7-DOF robotic arm. With the help of robotic positioning and the matrix array probe, fast volumetric imaging of target regions was feasible. By testing ultrasound volumes, which were roughly 880 kB in size, while using gigabit Ethernet connection, a latency of ∼57 ms was achievable for volume transfer between the ultrasound station and a remote client application, which as a result allows a frame count of 17.4 fps. Our modification thus offers for the first time real-time remote visualization, recording and control of 4d ultrasound data, which can be implemented in teleoperation.

Real-time multiple human perception with color-depth cameras on a mobile robot.

Science.gov (United States)

Zhang, Hao; Reardon, Christopher; Parker, Lynne E

2013-10-01

The ability to perceive humans is an essential requirement for safe and efficient human-robot interaction. In real-world applications, the need for a robot to interact in real time with multiple humans in a dynamic, 3-D environment presents a significant challenge. The recent availability of commercial color-depth cameras allow for the creation of a system that makes use of the depth dimension, thus enabling a robot to observe its environment and perceive in the 3-D space. Here we present a system for 3-D multiple human perception in real time from a moving robot equipped with a color-depth camera and a consumer-grade computer. Our approach reduces computation time to achieve real-time performance through a unique combination of new ideas and established techniques. We remove the ground and ceiling planes from the 3-D point cloud input to separate candidate point clusters. We introduce the novel information concept, depth of interest, which we use to identify candidates for detection, and that avoids the computationally expensive scanning-window methods of other approaches. We utilize a cascade of detectors to distinguish humans from objects, in which we make intelligent reuse of intermediary features in successive detectors to improve computation. Because of the high computational cost of some methods, we represent our candidate tracking algorithm with a decision directed acyclic graph, which allows us to use the most computationally intense techniques only where necessary. We detail the successful implementation of our novel approach on a mobile robot and examine its performance in scenarios with real-world challenges, including occlusion, robot motion, nonupright humans, humans leaving and reentering the field of view (i.e., the reidentification challenge), human-object and human-human interaction. We conclude with the observation that the incorporation of the depth information, together with the use of modern techniques in new ways, we are able to create an

Intermediate view reconstruction using adaptive disparity search algorithm for real-time 3D processing

Science.gov (United States)

Bae, Kyung-hoon; Park, Changhan; Kim, Eun-soo

2008-03-01

In this paper, intermediate view reconstruction (IVR) using adaptive disparity search algorithm (ASDA) is for realtime 3-dimensional (3D) processing proposed. The proposed algorithm can reduce processing time of disparity estimation by selecting adaptive disparity search range. Also, the proposed algorithm can increase the quality of the 3D imaging. That is, by adaptively predicting the mutual correlation between stereo images pair using the proposed algorithm, the bandwidth of stereo input images pair can be compressed to the level of a conventional 2D image and a predicted image also can be effectively reconstructed using a reference image and disparity vectors. From some experiments, stereo sequences of 'Pot Plant' and 'IVO', it is shown that the proposed algorithm improves the PSNRs of a reconstructed image to about 4.8 dB by comparing with that of conventional algorithms, and reduces the Synthesizing time of a reconstructed image to about 7.02 sec by comparing with that of conventional algorithms.

SU-D-BRF-06: A Brachytherapy Simulator with Realistic Haptic Force Feedback and Real-Time Ultrasounds Image Simulation for Training and Teaching

International Nuclear Information System (INIS)

Beaulieu, L; Carette, A; Comtois, S; Lavigueur, M; Cardou, P; Laurendeau, D

2014-01-01

Purpose: Surgical procedures require dexterity, expertise and repetition to reach optimal patient outcomes. However, efficient training opportunities are usually limited. This work presents a simulator system with realistic haptic force-feedback and full, real-time ultrasounds image simulation. Methods: The simulator is composed of a custom-made Linear-DELTA force-feedback robotic platform. The needle tip is mounted on a force gauge at the end effector of the robot, which responds to needle insertion by providing reaction forces. 3D geometry of the tissue is using a tetrahedral finite element mesh (FEM) mimicking tissue properties. As the needle is inserted/retracted, tissue deformation is computed using a mass-tensor nonlinear visco-elastic FEM. The real-time deformation is fed to the L-DELTA to take into account the force imparted to the needle, providing feedback to the end-user when crossing tissue boundaries or needle bending. Real-time 2D US image is also generated synchronously showing anatomy, needle insertion and tissue deformation. The simulator is running on an Intel I7 6- core CPU at 3.26 MHz. 3D tissue rendering and ultrasound display are performed on a Windows 7 computer; the FEM computation and L-DELTA control are executed on a similar PC using the Neutrino real-time OS. Both machines communicate through an Ethernet link. Results: The system runs at 500 Hz for a 8333-tetrahedron tissue mesh and a 100-node angular spring needle model. This frame rate ensures a relatively smooth displacement of the needle when pushed or retracted (±20 N in all directions at speeds of up to 2 m/s). Unlike commercially-available haptic platforms, the oblong workspace of the L-DELTA robot complies with that required for brachytherapy needle displacements of 0.1m by 0.1m by 0.25m. Conclusion: We have demonstrated a real-life, realistic brachytherapy simulator developed for prostate implants (LDR/HDR). The platform could be adapted to other sites or training for other

Real-time 3-D SAFT-UT system evaluation and validation

International Nuclear Information System (INIS)

Doctor, S.R.; Schuster, G.J.; Reid, L.D.; Hall, T.E.

1996-09-01

SAFT-UT technology is shown to provide significant enhancements to the inspection of materials used in US nuclear power plants. This report provides guidelines for the implementation of SAFT-UT technology and shows the results from its application. An overview of the development of SAFT-UT is provided so that the reader may become familiar with the technology. Then the basic fundamentals are presented with an extensive list of references. A comprehensive operating procedure, which is used in conjunction with the SAFT-UT field system developed by Pacific Northwest Laboratory (PNL), provides the recipe for both SAFT data acquisition and analysis. The specification for the hardware implementation is provided for the SAFT-UT system along with a description of the subsequent developments and improvements. One development of technical interest is the SAFT real time processor. Performance of the real-time processor is impressive and comparison is made of this dedicated parallel processor to a conventional computer and to the newer high-speed computer architectures designed for image processing. Descriptions of other improvements, including a robotic scanner, are provided. Laboratory parametric and application studies, performed by PNL and not previously reported, are discussed followed by a section on field application work in which SAFT was used during inservice inspections of operating reactors

Real-time 3-D SAFT-UT system evaluation and validation

Energy Technology Data Exchange (ETDEWEB)

Doctor, S.R.; Schuster, G.J.; Reid, L.D.; Hall, T.E. [Pacific Northwest National Lab., Richland, WA (United States)

1996-09-01

SAFT-UT technology is shown to provide significant enhancements to the inspection of materials used in US nuclear power plants. This report provides guidelines for the implementation of SAFT-UT technology and shows the results from its application. An overview of the development of SAFT-UT is provided so that the reader may become familiar with the technology. Then the basic fundamentals are presented with an extensive list of references. A comprehensive operating procedure, which is used in conjunction with the SAFT-UT field system developed by Pacific Northwest Laboratory (PNL), provides the recipe for both SAFT data acquisition and analysis. The specification for the hardware implementation is provided for the SAFT-UT system along with a description of the subsequent developments and improvements. One development of technical interest is the SAFT real time processor. Performance of the real-time processor is impressive and comparison is made of this dedicated parallel processor to a conventional computer and to the newer high-speed computer architectures designed for image processing. Descriptions of other improvements, including a robotic scanner, are provided. Laboratory parametric and application studies, performed by PNL and not previously reported, are discussed followed by a section on field application work in which SAFT was used during inservice inspections of operating reactors.

Real Time Revisited

Science.gov (United States)

Allen, Phillip G.

1985-12-01

The call for abolishing photo reconnaissance in favor of real time is once more being heard. Ten years ago the same cries were being heard with the introduction of the Charge Coupled Device (CCD). The real time system problems that existed then and stopped real time proliferation have not been solved. The lack of an organized program by either DoD or industry has hampered any efforts to solve the problems, and as such, very little has happened in real time in the last ten years. Real time is not a replacement for photo, just as photo is not a replacement for infra-red or radar. Operational real time sensors can be designed only after their role has been defined and improvements made to the weak links in the system. Plodding ahead on a real time reconnaissance suite without benefit of evaluation of utility will allow this same paper to be used ten years from now.

Future enhancements to 3D printing and real time production

Science.gov (United States)

Landa, Joseph; Jenkins, Jeffery; Wu, Jerry; Szu, Harold

2014-05-01

The cost and scope of additive printing machines range from several hundred to hundreds of thousands of dollars. For the extra money, one can get improvements in build size, selection of material properties, resolution, and consistency. However, temperature control during build and fusing predicts outcome and protects the IP by large high cost machines. Support material options determine geometries that can be accomplished which drives cost and complexity of printing heads. Historically, 3D printers have been used for design and prototyping efforts. Recent advances and cost reduction sparked new interest in developing printed products and consumables such as NASA who is printing food, printing consumer parts (e.g. cell phone cases, novelty toys), making tools and fixtures in manufacturing, and recursively print a self-similar printer (c.f. makerbot). There is a near term promise of the capability to print on demand products at the home or office... directly from the printer to use.

SLStudio: Open-source framework for real-time structured light

DEFF Research Database (Denmark)

Wilm, Jakob; Olesen, Oline Vinter; Larsen, Rasmus

2014-01-01

that this software makes real-time 3D scene capture more widely accessible and serves as a foundation for new structured light scanners operating in real-time, e.g. 20 depth images per second and more. The use cases for such scanners are plentyfull, however due to the computational constraints, all public......An open-source framework for real-time structured light is presented. It is called “SLStudio”, and enables real-time capture of metric depth images. The framework is modular, and extensible to support new algorithms for scene encoding/decoding, triangulation, and aquisition hardware. It is the aim...... implementations so far are limited to offline processing. With “SLStudio”, we are making a platform available which enables researchers from many different fields to build application specific real time 3D scanners. The software is hosted at http://compute.dtu.dk/~jakw/slstudio....

Induced tauopathy in a novel 3D-culture model mediates neurodegenerative processes: a real-time study on biochips.

Directory of Open Access Journals (Sweden)

Diana Seidel

Full Text Available Tauopathies including Alzheimer's disease represent one of the major health problems of aging population worldwide. Therefore, a better understanding of tau-dependent pathologies and consequently, tau-related intervention strategies is highly demanded. In recent years, several tau-focused therapies have been proposed with the aim to stop disease progression. However, to develop efficient active pharmaceutical ingredients for the broad treatment of Alzheimer's disease patients, further improvements are necessary for understanding the detailed neurodegenerative processes as well as the mechanism and side effects of potential active pharmaceutical ingredients (API in the neuronal system. In this context, there is a lack of suitable complex in vitro cell culture models recapitulating major aspects of taupathological degenerative processes in sufficient time and reproducible manner.Herewith, we describe a novel 3D SH-SY5Y cell-based, tauopathy model that shows advanced characteristics of matured neurons in comparison to monolayer cultures without the need of artificial differentiation promoting agents. Moreover, the recombinant expression of a novel highly pathologic fourfold mutated human tau variant lead to a fast and emphasized degeneration of neuritic processes. The neurodegenerative effects could be analyzed in real time and with high sensitivity using our unique microcavity array-based impedance spectroscopy measurement system. We were able to quantify a time- and concentration-dependent relative impedance decrease when Alzheimer's disease-like tau pathology was induced in the neuronal 3D cell culture model. In combination with the collected optical information, the degenerative processes within each 3D-culture could be monitored and analyzed. More strikingly, tau-specific regenerative effects caused by tau-focused active pharmaceutical ingredients could be quantitatively monitored by impedance spectroscopy.Bringing together our novel complex 3

Real-time monitoring of sucrose, sorbitol, d-glucose and d-fructose concentration by electromagnetic sensing.

Science.gov (United States)

Harnsoongnoen, Supakorn; Wanthong, Anuwat

2017-10-01

Magnetic sensing at microwave frequencies for real-time monitoring of sucrose, sorbitol, d-glucose and d-fructose concentrations is reported. The sensing element was designed based on a coplanar waveguide (CPW) loaded with a split ring resonator (SRR), which was fabricated on a DiClad 880 substrate with a thickness of 1.6mm and relative permittivity (ε r ) of 2.2. The magnetic sensor was connected to a Vector Network Analyzer (VNA) and the electromagnetic interaction between the samples and sensor was analyzed. The magnitude of the transmission coefficient (S 21 ) was used as an indicator to detect the solution sample concentrations ranging from 0.04 to 0.20g/ml. The experimental results confirmed that the developed system using microwaves for the real-time monitoring of sucrose, sorbitol, d-glucose and d-fructose concentrations gave unique results for each solution type and concentration. Moreover, the proposed sensor has a wide dynamic range, high linearity, fast operation and low-cost. Copyright © 2017 Elsevier Ltd. All rights reserved.

Real-time Pedestrian Crossing Recognition for Assistive Outdoor Navigation.

Science.gov (United States)

Fontanesi, Simone; Frigerio, Alessandro; Fanucci, Luca; Li, William

2015-01-01

Navigation in urban environments can be difficult for people who are blind or visually impaired. In this project, we present a system and algorithms for recognizing pedestrian crossings in outdoor environments. Our goal is to provide navigation cues for crossing the street and reaching an island or sidewalk safely. Using a state-of-the-art Multisense S7S sensor, we collected 3D pointcloud data for real-time detection of pedestrian crossing and generation of directional guidance. We demonstrate improvements to a baseline, monocular-camera-based system by integrating 3D spatial prior information extracted from the pointcloud. Our system's parameters can be set to the actual dimensions of real-world settings, which enables robustness of occlusion and perspective transformation. The system works especially well in non-occlusion situations, and is reasonably accurate under different kind of conditions. As well, our large dataset of pedestrian crossings, organized by different types and situations of pedestrian crossings in order to reflect real-word environments, is publicly available in a commonly used format (ROS bagfiles) for further research.

An Evolutionary Real-Time 3D Route Planner for Aircraft

Institute of Scientific and Technical Information of China (English)

郑昌文; 丁明跃; 周成平

2003-01-01

A novel evolutionary route planner for aircraft is proposed in this paper. In the new planner, individual candidates are evaluated with respect to the workspace, thus the computation of the configuration space is not required. By using problem-specific chromosome structure and genetic operators, the routes are generated in real time,with different mission constraints such as minimum route leg length and flying altitude, maximum turning angle, maximum climbing/diving angle and route distance constraint taken into account.

3D+time acquisitions of 3D cell culture by means of lens-free tomographic microscopy

Science.gov (United States)

Berdeu, Anthony; Laperrousaz, Bastien; Bordy, Thomas; Morales, S.; Gidrol, Xavier; Picollet-D'hahan, Nathalie; Allier, Cédric

2018-02-01

We propose a three-dimensional (3D) imaging platform based on lens-free microscopy to perform multi-angle acquisitions on 3D cell cultures embedded in extracellular matrix (ECM). We developed algorithms based on the Fourier diffraction theorem to perform fully 3D reconstructions of biological samples and we adapted the lens-free microscope to incubator conditions. Here we demonstrate for the first time, 3D+time lens-free acquisitions of 3D cell culture over 8 days directly into the incubator. The 3D reconstructed volume is as large as 5 mm3 and provides a unique way to observe in the same 3D cell culture experiment multiple cell migration strategies. Namely, in a 3D cell culture of prostate epithelial cells embedded within a Matrigel® matrix, we are able to distinguish single cell 'leaders', migration of cell clusters, migration of large aggregates of cells, and also close-gap and large-scale branching. In addition, we observe long-scale 3D deformations of the ECM that modify the geometry of the 3D cell culture. Interestingly, we also observed the opposite, i.e. we found that large aggregates of cells may deform the ECM by generating traction forces over very long distances. In sum we put forward a novel 3D lens-free microscopy tomographic technique to study the single and collective cell migrations, the cell-to-cell interactions and the cell-to-matrix interactions.

Computational hologram synthesis and representation on spatial light modulators for real-time 3D holographic imaging

International Nuclear Information System (INIS)

Reichelt, Stephan; Leister, Norbert

2013-01-01

In dynamic computer-generated holography that utilizes spatial light modulators, both hologram synthesis and hologram representation are essential in terms of fast computation and high reconstruction quality. For hologram synthesis, i.e. the computation step, Fresnel transform based or point-source based raytracing methods can be applied. In the encoding step, the complex wave-field has to be optimally represented by the SLM with its given modulation capability. For proper hologram reconstruction that implies a simultaneous and independent amplitude and phase modulation of the input wave-field by the SLM. In this paper, we discuss full complex hologram representation methods on SLMs by considering inherent SLM parameter such as modulation type and bit depth on their reconstruction performance such as diffraction efficiency and SNR. We review the three implementation schemes of Burckhardt amplitude-only representation, phase-only macro-pixel representation, and two-phase interference representation. Besides the optical performance we address their hardware complexity and required computational load. Finally, we experimentally demonstrate holographic reconstructions of different representation schemes as obtained by functional prototypes utilizing SeeReal's viewing-window holographic display technology. The proposed hardware implementations enable a fast encoding of complex-valued hologram data and thus will pave the way for commercial real-time holographic 3D imaging in the near future.

Combining 3D structure of real video and synthetic objects

Science.gov (United States)

Kim, Man-Bae; Song, Mun-Sup; Kim, Do-Kyoon

1998-04-01

This paper presents a new approach of combining real video and synthetic objects. The purpose of this work is to use the proposed technology in the fields of advanced animation, virtual reality, games, and so forth. Computer graphics has been used in the fields previously mentioned. Recently, some applications have added real video to graphic scenes for the purpose of augmenting the realism that the computer graphics lacks in. This approach called augmented or mixed reality can produce more realistic environment that the entire use of computer graphics. Our approach differs from the virtual reality and augmented reality in the manner that computer- generated graphic objects are combined to 3D structure extracted from monocular image sequences. The extraction of the 3D structure requires the estimation of 3D depth followed by the construction of a height map. Graphic objects are then combined to the height map. The realization of our proposed approach is carried out in the following steps: (1) We derive 3D structure from test image sequences. The extraction of the 3D structure requires the estimation of depth and the construction of a height map. Due to the contents of the test sequence, the height map represents the 3D structure. (2) The height map is modeled by Delaunay triangulation or Bezier surface and each planar surface is texture-mapped. (3) Finally, graphic objects are combined to the height map. Because 3D structure of the height map is already known, Step (3) is easily manipulated. Following this procedure, we produced an animation video demonstrating the combination of the 3D structure and graphic models. Users can navigate the realistic 3D world whose associated image is rendered on the display monitor.

Mitigating Space Weather Impacts on the Power Grid in Real-Time: Applying 3-D EarthScope Magnetotelluric Data to Forecasting Reactive Power Loss in Power Transformers

Science.gov (United States)

Schultz, A.; Bonner, L. R., IV

2017-12-01

Current efforts to assess risk to the power grid from geomagnetic disturbances (GMDs) that result in geomagnetically induced currents (GICs) seek to identify potential "hotspots," based on statistical models of GMD storm scenarios and power distribution grounding models that assume that the electrical conductivity of the Earth's crust and mantle varies only with depth. The NSF-supported EarthScope Magnetotelluric (MT) Program operated by Oregon State University has mapped 3-D ground electrical conductivity structure across more than half of the continental US. MT data, the naturally occurring time variations in the Earth's vector electric and magnetic fields at ground level, are used to determine the MT impedance tensor for each site (the ratio of horizontal vector electric and magnetic fields at ground level expressed as a complex-valued frequency domain quantity). The impedance provides information on the 3-D electrical conductivity structure of the Earth's crust and mantle. We demonstrate that use of 3-D ground conductivity information significantly improves the fidelity of GIC predictions over existing 1-D approaches. We project real-time magnetic field data streams from US Geological Survey magnetic observatories into a set of linear filters that employ the impedance data and that generate estimates of ground level electric fields at the locations of MT stations. The resulting ground electric fields are projected to and integrated along the path of power transmission lines. This serves as inputs to power flow models that represent the power transmission grid, yielding a time-varying set of quasi-real-time estimates of reactive power loss at the power transformers that are critical infrastructure for power distribution. We demonstrate that peak reactive power loss and hence peak risk for transformer damage from GICs does not necessarily occur during peak GMD storm times, but rather depends on the time-evolution of the polarization of the GMD's inducing fields

Two-dimensional and 3-D images of thick tissue using time-constrained times-of-flight and absorbance spectrophotometry

Science.gov (United States)

Benaron, David A.; Lennox, M.; Stevenson, David K.

1992-05-01

Reconstructing deep-tissue images in real time using spectrophotometric data from optically diffusing thick tissues has been problematic. Continuous wave applications (e.g., pulse oximetry, regional cerebral saturation) ignore both the multiple paths traveled by the photons through the tissue and the effects of scattering, allowing scalar measurements but only under limited conditions; interferometry works poorly in thick, highly-scattering media; frequency- modulated approaches may not allow full deconvolution of scattering and absorbance; and pulsed-light techniques allow for preservation of information regarding the multiple paths taken by light through the tissue, but reconstruction is both computation intensive and limited by the relative surface area available for detection of photons. We have developed a picosecond times-of-flight and absorbance (TOFA) optical system, time-constrained to measure only photons with a narrow range of path lengths and arriving within a narrow angel of the emitter-detector axis. The delay until arrival of the earliest arriving photons is a function of both the scattering and absorbance of the tissues in a direct line between the emitter and detector, reducing the influence of surrounding tissues. Measurement using a variety of emitter and detector locations produces spatial information which can be analyzed in a standard 2-D grid, or subject to computer reconstruction to produce tomographic images representing 3-D structure. Using such a technique, we have been able to demonstrate the principles of tc-TOFA, detect and localize diffusive and/or absorptive objects suspended in highly scattering media (such as blood admixed with yeast), and perform simple 3-D reconstructions using phantom objects. We are now attempting to obtain images in vivo. Potential future applications include use as a research tool, and as a continuous, noninvasive, nondestructive monitor in diagnostic imaging, fetal monitoring, neurologic and cardiac

Direct modulation of aberrant brain network connectivity through real-time NeuroFeedback.

Science.gov (United States)

Ramot, Michal; Kimmich, Sara; Gonzalez-Castillo, Javier; Roopchansingh, Vinai; Popal, Haroon; White, Emily; Gotts, Stephen J; Martin, Alex

2017-09-16

The existence of abnormal connectivity patterns between resting state networks in neuropsychiatric disorders, including Autism Spectrum Disorder (ASD), has been well established. Traditional treatment methods in ASD are limited, and do not address the aberrant network structure. Using real-time fMRI neurofeedback, we directly trained three brain nodes in participants with ASD, in which the aberrant connectivity has been shown to correlate with symptom severity. Desired network connectivity patterns were reinforced in real-time, without participants' awareness of the training taking place. This training regimen produced large, significant long-term changes in correlations at the network level, and whole brain analysis revealed that the greatest changes were focused on the areas being trained. These changes were not found in the control group. Moreover, changes in ASD resting state connectivity following the training were correlated to changes in behavior, suggesting that neurofeedback can be used to directly alter complex, clinically relevant network connectivity patterns.

Direct modulation of aberrant brain network connectivity through real-time NeuroFeedback

Science.gov (United States)

Kimmich, Sara; Gonzalez-Castillo, Javier; Roopchansingh, Vinai; Popal, Haroon; White, Emily; Gotts, Stephen J; Martin, Alex

2017-01-01

The existence of abnormal connectivity patterns between resting state networks in neuropsychiatric disorders, including Autism Spectrum Disorder (ASD), has been well established. Traditional treatment methods in ASD are limited, and do not address the aberrant network structure. Using real-time fMRI neurofeedback, we directly trained three brain nodes in participants with ASD, in which the aberrant connectivity has been shown to correlate with symptom severity. Desired network connectivity patterns were reinforced in real-time, without participants’ awareness of the training taking place. This training regimen produced large, significant long-term changes in correlations at the network level, and whole brain analysis revealed that the greatest changes were focused on the areas being trained. These changes were not found in the control group. Moreover, changes in ASD resting state connectivity following the training were correlated to changes in behavior, suggesting that neurofeedback can be used to directly alter complex, clinically relevant network connectivity patterns. PMID:28917059

An inkjet-printed buoyant 3-D lagrangian sensor for real-time flood monitoring

KAUST Repository

Farooqui, Muhammad Fahad; Claudel, Christian G.; Shamim, Atif

2014-01-01

A 3-D (cube-shaped) Lagrangian sensor, inkjet printed on a paper substrate, is presented for the first time. The sensor comprises a transmitter chip with a microcontroller completely embedded in the cube, along with a $1.5 \\lambda 0 dipole

Real-time visualization of joint cavitation.

Directory of Open Access Journals (Sweden)

Gregory N Kawchuk

Full Text Available Cracking sounds emitted from human synovial joints have been attributed historically to the sudden collapse of a cavitation bubble formed as articular surfaces are separated. Unfortunately, bubble collapse as the source of joint cracking is inconsistent with many physical phenomena that define the joint cracking phenomenon. Here we present direct evidence from real-time magnetic resonance imaging that the mechanism of joint cracking is related to cavity formation rather than bubble collapse. In this study, ten metacarpophalangeal joints were studied by inserting the finger of interest into a flexible tube tightened around a length of cable used to provide long-axis traction. Before and after traction, static 3D T1-weighted magnetic resonance images were acquired. During traction, rapid cine magnetic resonance images were obtained from the joint midline at a rate of 3.2 frames per second until the cracking event occurred. As traction forces increased, real-time cine magnetic resonance imaging demonstrated rapid cavity inception at the time of joint separation and sound production after which the resulting cavity remained visible. Our results offer direct experimental evidence that joint cracking is associated with cavity inception rather than collapse of a pre-existing bubble. These observations are consistent with tribonucleation, a known process where opposing surfaces resist separation until a critical point where they then separate rapidly creating sustained gas cavities. Observed previously in vitro, this is the first in-vivo macroscopic demonstration of tribonucleation and as such, provides a new theoretical framework to investigate health outcomes associated with joint cracking.

SU-E-J-240: Development of a Novel 4D MRI Sequence for Real-Time Liver Tumor Tracking During Radiotherapy

Energy Technology Data Exchange (ETDEWEB)

Zhuang, L; Burmeister, J [Department of Oncology, Wayne State Univ School of Medicine, Detroit, MI (United States); Ye, Y [Department of Radiology, Wayne State Univ School of Medicine, Detroit, MI (United States)

2015-06-15

Purpose: To develop a Novel 4D MRI Technique that is feasible for realtime liver tumor tracking during radiotherapy. Methods: A volunteer underwent an abdominal 2D fast EPI coronal scan on a 3.0T MRI scanner (Siemens Inc., Germany). An optimal set of parameters was determined based on image quality and scan time. A total of 23 slices were scanned to cover the whole liver in the test scan. For each scan position, the 2D images were retrospectively sorted into multiple phases based on breathing signal extracted from the images. Consequently the 2D slices with same phase numbers were stacked to form one 3D image. Multiple phases of 3D images formed the 4D MRI sequence representing one breathing cycle. Results: The optimal set of scan parameters were: TR= 57ms, TE= 19ms, FOV read= 320mm and flip angle= 30°, which resulted in a total scan time of 14s for 200 frames (FMs) per slice and image resolution of (2.5mm,2.5mm,5.0mm) in three directions. Ten phases of 3D images were generated, each of which had 23 slices. Based on our test scan, only 100FMs were necessary for the phase sorting process which may lower the scan time to 7s/100FMs/slice. For example, only 5 slices/35s are necessary for a 4D MRI scan to cover liver tumor size ≤ 2cm leading to the possibility of tumor trajectory tracking every 35s during treatment. Conclusion: The novel 4D MRI technique we developed can reconstruct a 4D liver MRI sequence representing one breathing cycle (7s/ slice) without an external monitor. This technique can potentially be used for real-time liver tumor tracking during radiotherapy.

Direct-write/cure conductive polymer nanocomposites for 3D structural electronics

Energy Technology Data Exchange (ETDEWEB)

Lu, Yanfeng; Vatani, Morteza; Choi, Jae Won [The University of Akron, Akron, Ohio (United States)

2013-10-15

The use of direct-write (DW) in the fabrication of conductive structures offers dramatic benefits over traditional technologies in terms of low-cost, print-on-demand conformal manufacturing. This DW process can be combined with direct-cure (DC) process as one-step manufacturing of conducting elements, whereas conventional methods need a manufacturing process of conducting elements followed by a relatively long time post-curing/baking process. A hybrid technology combined with direct-write/cure (DWC) and projection microstereolithography (PμSL) is presented in this work. Carbon nanotubes (CNTs) were dispersed in a photopolymer solution to introduce conductivity. The developed PμSL was used to create 3D structures, and DWC of conductive photopolymers with CNTs was utilized to produce conductive paths. To show the capabilities of the developed system and materials, a 3D structure with embedded conductive paths was designed and fabricated. Based on the experiments, it is thought that the suggested manufacturing process and materials are promising to produce 3D structural electronics.

Direct-write/cure conductive polymer nanocomposites for 3D structural electronics

International Nuclear Information System (INIS)

Lu, Yanfeng; Vatani, Morteza; Choi, Jae Won

2013-01-01

The use of direct-write (DW) in the fabrication of conductive structures offers dramatic benefits over traditional technologies in terms of low-cost, print-on-demand conformal manufacturing. This DW process can be combined with direct-cure (DC) process as one-step manufacturing of conducting elements, whereas conventional methods need a manufacturing process of conducting elements followed by a relatively long time post-curing/baking process. A hybrid technology combined with direct-write/cure (DWC) and projection microstereolithography (PμSL) is presented in this work. Carbon nanotubes (CNTs) were dispersed in a photopolymer solution to introduce conductivity. The developed PμSL was used to create 3D structures, and DWC of conductive photopolymers with CNTs was utilized to produce conductive paths. To show the capabilities of the developed system and materials, a 3D structure with embedded conductive paths was designed and fabricated. Based on the experiments, it is thought that the suggested manufacturing process and materials are promising to produce 3D structural electronics.

Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery.

Science.gov (United States)

Kowalczuk, Jędrzej; Meyer, Avishai; Carlson, Jay; Psota, Eric T; Buettner, Shelby; Pérez, Lance C; Farritor, Shane M; Oleynikov, Dmitry

2012-12-01

Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.

Quantification of Artifact Reduction With Real-Time Cine Four-Dimensional Computed Tomography Acquisition Methods

International Nuclear Information System (INIS)

Langner, Ulrich W.; Keall, Paul J.

2010-01-01

Purpose: To quantify the magnitude and frequency of artifacts in simulated four-dimensional computed tomography (4D CT) images using three real-time acquisition methods- direction-dependent displacement acquisition, simultaneous displacement and phase acquisition, and simultaneous displacement and velocity acquisition- and to compare these methods with commonly used retrospective phase sorting. Methods and Materials: Image acquisition for the four 4D CT methods was simulated with different displacement and velocity tolerances for spheres with radii of 0.5 cm, 1.5 cm, and 2.5 cm, using 58 patient-measured tumors and respiratory motion traces. The magnitude and frequency of artifacts, CT doses, and acquisition times were computed for each method. Results: The mean artifact magnitude was 50% smaller for the three real-time methods than for retrospective phase sorting. The dose was ∼50% lower, but the acquisition time was 20% to 100% longer for the real-time methods than for retrospective phase sorting. Conclusions: Real-time acquisition methods can reduce the frequency and magnitude of artifacts in 4D CT images, as well as the imaging dose, but they increase the image acquisition time. The results suggest that direction-dependent displacement acquisition is the preferred real-time 4D CT acquisition method, because on average, the lowest dose is delivered to the patient and the acquisition time is the shortest for the resulting number and magnitude of artifacts.

Real-time RGB-D image stitching using multiple Kinects for improved field of view

Directory of Open Access Journals (Sweden)

Hengyu Li

2017-03-01

Full Text Available This article concerns the problems of a defective depth map and limited field of view of Kinect-style RGB-D sensors. An anisotropic diffusion based hole-filling method is proposed to recover invalid depth data in the depth map. The field of view of the Kinect-style RGB-D sensor is extended by stitching depth and color images from several RGB-D sensors. By aligning the depth map with the color image, the registration data calculated by registering color images can be used to stitch depth and color images into a depth and color panoramic image concurrently in real time. Experiments show that the proposed stitching method can generate a RGB-D panorama with no invalid depth data and little distortion in real time and can be extended to incorporate more RGB-D sensors to construct even a 360° field of view panoramic RGB-D image.

Real-time Avatar Animation from a Single Image.

Science.gov (United States)

Saragih, Jason M; Lucey, Simon; Cohn, Jeffrey F

2011-01-01

A real time facial puppetry system is presented. Compared with existing systems, the proposed method requires no special hardware, runs in real time (23 frames-per-second), and requires only a single image of the avatar and user. The user's facial expression is captured through a real-time 3D non-rigid tracking system. Expression transfer is achieved by combining a generic expression model with synthetically generated examples that better capture person specific characteristics. Performance of the system is evaluated on avatars of real people as well as masks and cartoon characters.

Real-time monitoring of cisplatin cytotoxicity on three-dimensional spheroid tumor cells

Directory of Open Access Journals (Sweden)

Baek NH

2016-07-01

visualized only 4 days after treatment. In 293T cells, CDDP failed to kill entirely the culture and ATP generation was only partially blocked after 1 day. This suggests potential CDDP resistance of 293T cells or metabolic clearance of the drug. Real-time monitoring and ATP measurements directly confirmed the cytotoxicity of CDDP, indicating that CDDP may interfere with mitochondrial activity. Keywords: cisplatin, real-time monitoring, cytotoxicity, 3D spheroids, ATP productions

Real-time capture and reconstruction system with multiple GPUs for a 3D live scene by a generation from 4K IP images to 8K holograms.

Science.gov (United States)

Ichihashi, Yasuyuki; Oi, Ryutaro; Senoh, Takanori; Yamamoto, Kenji; Kurita, Taiichiro

2012-09-10

We developed a real-time capture and reconstruction system for three-dimensional (3D) live scenes. In previous research, we used integral photography (IP) to capture 3D images and then generated holograms from the IP images to implement a real-time reconstruction system. In this paper, we use a 4K (3,840 × 2,160) camera to capture IP images and 8K (7,680 × 4,320) liquid crystal display (LCD) panels for the reconstruction of holograms. We investigate two methods for enlarging the 4K images that were captured by integral photography to 8K images. One of the methods increases the number of pixels of each elemental image. The other increases the number of elemental images. In addition, we developed a personal computer (PC) cluster system with graphics processing units (GPUs) for the enlargement of IP images and the generation of holograms from the IP images using fast Fourier transform (FFT). We used the Compute Unified Device Architecture (CUDA) as the development environment for the GPUs. The Fast Fourier transform is performed using the CUFFT (CUDA FFT) library. As a result, we developed an integrated system for performing all processing from the capture to the reconstruction of 3D images by using these components and successfully used this system to reconstruct a 3D live scene at 12 frames per second.

3-D tracking in a miniature time projection chamber

Energy Technology Data Exchange (ETDEWEB)

Vahsen, S.E., E-mail: sevahsen@hawaii.edu [University of Hawaii, 2505 Correa Road, Honolulu, HI 96822 (United States); Hedges, M.T.; Jaegle, I.; Ross, S.J.; Seong, I.S.; Thorpe, T.N.; Yamaoka, J. [University of Hawaii, 2505 Correa Road, Honolulu, HI 96822 (United States); Kadyk, J.A.; Garcia-Sciveres, M. [Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720 (United States)

2015-07-11

The three-dimensional (3-D) detection of millimeter-scale ionization trails is of interest for detecting nuclear recoils in directional fast neutron detectors and in direction-sensitive searches for weakly interacting massive particles (WIMPs), which may constitute the Dark Matter of the universe. We report on performance characterization of a miniature gas target Time Projection Chamber (TPC) where the drift charge is avalanche-multiplied with Gas Electron Multipliers (GEMs) and detected with the ATLAS FE-I3 Pixel Application Specific Integrated Circuit (ASIC). We report on measurements of gain, gain resolution, point resolution, diffusion, angular resolution, and energy resolution with low-energy X-rays, cosmic rays, and alpha particles, using the gases Ar:CO{sub 2} (70:30) and He:CO{sub 2} (70:30) at atmospheric pressure. We discuss the implications for future, larger directional neutron and Dark Matter detectors. With an eye to designing and selecting components for these, we generalize our results into analytical expressions for detector performance whenever possible. We conclude by demonstrating the 3-D directional detection of a fast neutron source.

Real-time multiple networked viewer capability of the DIII-D EC data acquisition system

International Nuclear Information System (INIS)

Ponce, D.; Gorelov, I.A.; Chiu, H.K.; Baity, F.W.

2005-01-01

A data acquisition system (DAS) which permits real-time viewing by multiple locally networked operators is being implemented for the electron cyclotron (EC) heating and current drive system at DIII-D. The DAS is expected to demonstrate performance equivalent to standalone oscilloscopes. Participation by remote viewers, including throughout the greater DIII-D facility, can also be incorporated. The real-time system uses one computer-controlled DAS per gyrotron. The DAS computers send their data to a central data server using individual and dedicated 200 Mbps fully duplexed Ethernet connections. The server has a dedicated 10 krpm hard drive for each gyrotron DAS. Selected channels can then be reprocessed and distributed to viewers over a standard local area network (LAN). They can also be bridged from the LAN to the internet. Calculations indicate that the hardware will support real-time writing of each channel at full resolution to the server hard drives. The data will be re-sampled for distribution to multiple viewers over the LAN in real-time. The hardware for this system is in place. The software is under development. This paper will present the design details and up-to-date performance metrics of the system

Real-time luminescence from Al2O3 fiber dosimeters

International Nuclear Information System (INIS)

Polf, J.C.; Yukihara, E.G.; Akselrod, M.S.; McKeever, S.W.S.

2004-01-01

The real-time luminescence signal from Al 2 O 3 single crystal fibers, monitored during simultaneous irradiation and optical stimulation, was investigated using computer simulations and experimental measurements. Both radioluminescence (RL) and optically stimulated luminescence (OSL) signals were studied. The simulations were performed initially using a simple one-trap/one-recombination-center energy band model, and then extended to include shallow and deep electron traps as well. Real-time luminescence experiments were performed for different radiation dose rates and optical stimulation powers using periodic laser stimulation of the samples through a fiber optic cable, and the experimental results were compared with the predictions from the computer simulations. The luminescence signal was observed, both theoretically and experimentally, to increase from its initial value to a steady-state level. The steady-state RL and OSL levels were found to be dependent on dose rate, the steady-state level of the real-time OSL being independent of laser power. It was also shown that the total integrated absorbed dose throughout the irradiation period can be determined by correcting the real-time OSL signal for depletion caused by each laser stimulation pulse. The effects of the shallow and deep traps on the time-dependence of the real-time luminescence signal were studied comparing the experimental data from several Al 2 O 3 fibers known to have different trapping state concentrations. The additional traps were found to slow the response of the real-time luminescence such that the time to reach steady state was increased as the additional traps were added

SU-F-I-11: Software Development for 4D-CBCT Research of Real-Time-Image Gated Spot Scanning Proton Therapy

Energy Technology Data Exchange (ETDEWEB)

Fujii, T; Fujii, Y; Shimizu, S; Shirato, H [Graduate School of Medicine, Hokkaido University, Sapporo, Hokkaido (Japan); Matsuura, T; Umegaki, K [Faculty of Engineering, Hokkaido University, Sapporo, Hokkaido (Japan); Takao, S; Miyamoto, N; Matsuzaki, Y [Proton Beam Therapy Center, Hokkaido University Hospital, Sapporo, Hokkaido (Japan)

2016-06-15

Purpose: To acquire correct information for inside the body in patient positioning of Real-time-image Gated spot scanning Proton Therapy (RGPT), utilization of tomographic image at exhale phase of patient respiration obtained from 4-dimensional Cone beam CT (4D-CBCT) has been desired. We developed software named “Image Analysis Platform” for 4D-CBCT researches which has technique to segment projection-images based on 3D marker position in the body. The 3D marker position can be obtained by using two axes CBCT system at Hokkaido University Hospital Proton Therapy Center. Performance verification of the software was implemented. Methods: The software calculates 3D marker position retrospectively by using matching positions on pair projection-images obtained by two axes fluoroscopy mode of CBCT system. Log data of 3D marker tracking are outputted after the tracking. By linking the Log data and gantry-angle file of projection-image, all projection-images are equally segmented to spatial five-phases according to marker 3D position of SI direction and saved to specified phase folder. Segmented projection-images are used for CBCT reconstruction of each phase. As performance verification of the software, test of segmented projection-images was implemented for sample CT phantom (Catphan) image acquired by two axes fluoroscopy mode of CBCT. Dummy marker was added on the images. Motion of the marker was modeled to move in 3D space. Motion type of marker is sin4 wave function has amplitude 10.0 mm/5.0 mm/0 mm, cycle 4 s/4 s/0 s for SI/AP/RL direction. Results: The marker was tracked within 0.58 mm accuracy in 3D for all images, and it was confirmed that all projection-images were segmented and saved to each phase folder correctly. Conclusion: We developed software for 4D-CBCT research which can segment projection-image based on 3D marker position. It will be helpful to create high quality of 4D-CBCT reconstruction image for RGPT.

Real-time three-dimensional imaging of epidermal splitting and removal by high-definition optical coherence tomography

DEFF Research Database (Denmark)

Boone, Marc; Draye, Jean Pierre; Verween, Gunther

2014-01-01

While real-time 3-D evaluation of human skin constructs is needed, only 2-D non-invasive imaging techniques are available. The aim of this paper is to evaluate the potential of high-definition optical coherence tomography (HD-OCT) for real-time 3-D assessment of the epidermal splitting and decell......While real-time 3-D evaluation of human skin constructs is needed, only 2-D non-invasive imaging techniques are available. The aim of this paper is to evaluate the potential of high-definition optical coherence tomography (HD-OCT) for real-time 3-D assessment of the epidermal splitting...... before and after incubation. Real-time 3-D HD-OCT assessment was compared with 2-D en face assessment by reflectance confocal microscopy (RCM). (Immuno) histopathology was used as control. HD-OCT imaging allowed real-time 3-D visualization of the impact of selected agents on epidermal splitting, dermo......-epidermal junction, dermal architecture, vascular spaces and cellularity. RCM has a better resolution (1 μm) than HD-OCT (3 μm), permitting differentiation of different collagen fibres, but HD-OCT imaging has deeper penetration (570 μm) than RCM imaging (200 μm). Dispase II and NaCl treatments were found...

Four-dimensional (4D) flow of the whole heart and great vessels using real-time respiratory self-gating

DEFF Research Database (Denmark)

Uribe, Sergio; Beerbaum, Philipp; Sørensen, Thomas Sangild

2009-01-01

Four-dimensional (4D) flow imaging has been used to study flow patterns and pathophysiology, usually focused on specific thoracic vessels and cardiac chambers. Whole-heart 4D flow at high measurement accuracy covering the entire thoracic cardiovascular system would be desirable to simplify...... and improve hemodynamic assessment. This has been a challenge because compensation of respiratory motion is difficult to achieve, but it is paramount to limit artifacts and improve accuracy. In this work we propose a self-gating technique for respiratory motion-compensation integrated into a whole-heart 4D...... flow acquisition that overcomes these challenges. Flow components are measured in all three directions for each pixel over the complete cardiac cycle, and 1D volume projections are obtained at certain time intervals for respiratory gating in real time during the acquisition. The technique was tested...

Network Dynamics with BrainX3: A Large-Scale Simulation of the Human Brain Network with Real-Time Interaction

OpenAIRE

Xerxes D. Arsiwalla; Riccardo eZucca; Alberto eBetella; Enrique eMartinez; David eDalmazzo; Pedro eOmedas; Gustavo eDeco; Gustavo eDeco; Paul F.M.J. Verschure; Paul F.M.J. Verschure

2015-01-01

BrainX3 is a large-scale simulation of human brain activity with real-time interaction, rendered in 3D in a virtual reality environment, which combines computational power with human intuition for the exploration and analysis of complex dynamical networks. We ground this simulation on structural connectivity obtained from diffusion spectrum imaging data and model it on neuronal population dynamics. Users can interact with BrainX3 in real-time by perturbing brain regions with transient stimula...

Network dynamics with BrainX3: a large-scale simulation of the human brain network with real-time interaction

OpenAIRE

Arsiwalla, Xerxes D.; Zucca, Riccardo; Betella, Alberto; Martínez, Enrique, 1961-; Dalmazzo, David; Omedas, Pedro; Deco, Gustavo; Verschure, Paul F. M. J.

2015-01-01

BrainX3 is a large-scale simulation of human brain activity with real-time interaction, rendered in 3D in a virtual reality environment, which combines computational power with human intuition for the exploration and analysis of complex dynamical networks. We ground this simulation on structural connectivity obtained from diffusion spectrum imaging data and model it on neuronal population dynamics. Users can interact with BrainX3 in real-time by perturbing brain regions with transient stimula...

Helicopter Flight Test of a Compact, Real-Time 3-D Flash Lidar for Imaging Hazardous Terrain During Planetary Landing

Science.gov (United States)

Roback, VIncent E.; Amzajerdian, Farzin; Brewster, Paul F.; Barnes, Bruce W.; Kempton, Kevin S.; Reisse, Robert A.; Bulyshev, Alexander E.

2013-01-01

A second generation, compact, real-time, air-cooled 3-D imaging Flash Lidar sensor system, developed from a number of cutting-edge components from industry and NASA, is lab characterized and helicopter flight tested under the Autonomous Precision Landing and Hazard Detection and Avoidance Technology (ALHAT) project. The ALHAT project is seeking to develop a guidance, navigation, and control (GN&C) and sensing system based on lidar technology capable of enabling safe, precise crewed or robotic landings in challenging terrain on planetary bodies under any ambient lighting conditions. The Flash Lidar incorporates a 3-D imaging video camera based on Indium-Gallium-Arsenide Avalanche Photo Diode and novel micro-electronic technology for a 128 x 128 pixel array operating at a video rate of 20 Hz, a high pulse-energy 1.06 µm Neodymium-doped: Yttrium Aluminum Garnet (Nd:YAG) laser, a remote laser safety termination system, high performance transmitter and receiver optics with one and five degrees field-of-view (FOV), enhanced onboard thermal control, as well as a compact and self-contained suite of support electronics housed in a single box and built around a PC-104 architecture to enable autonomous operations. The Flash Lidar was developed and then characterized at two NASA-Langley Research Center (LaRC) outdoor laser test range facilities both statically and dynamically, integrated with other ALHAT GN&C subsystems from partner organizations, and installed onto a Bell UH-1H Iroquois "Huey" helicopter at LaRC. The integrated system was flight tested at the NASA-Kennedy Space Center (KSC) on simulated lunar approach to a custom hazard field consisting of rocks, craters, hazardous slopes, and safe-sites near the Shuttle Landing Facility runway starting at slant ranges of 750 m. In order to evaluate different methods of achieving hazard detection, the lidar, in conjunction with the ALHAT hazard detection and GN&C system, operates in both a narrow 1deg FOV raster

Usefulness of real-time three-dimensional ultrasonography in percutaneous nephrostomy: an animal study.

Science.gov (United States)

Hongzhang, Hong; Xiaojuan, Qin; Shengwei, Zhang; Feixiang, Xiang; Yujie, Xu; Haibing, Xiao; Gallina, Kazobinka; Wen, Ju; Fuqing, Zeng; Xiaoping, Zhang; Mingyue, Ding; Huageng, Liang; Xuming, Zhang

2018-05-17

To evaluate the effect of real-time three-dimensional (3D) ultrasonography (US) in guiding percutaneous nephrostomy (PCN). A hydronephrosis model was devised in which the ureters of 16 beagles were obstructed. The beagles were divided equally into groups 1 and 2. In group 1, the PCN was performed using real-time 3D US guidance, while in group 2 the PCN was guided using two-dimensional (2D) US. Visualization of the needle tract, length of puncture time and number of puncture times were recorded for the two groups. In group 1, score for visualization of the needle tract, length of puncture time and number of puncture times were 3, 7.3 ± 3.1 s and one time, respectively. In group 2, the respective results were 1.4 ± 0.5, 21.4 ± 5.8 s and 2.1 ± 0.6 times. The visualization of needle tract in group 1 was superior to that in group 2, and length of puncture time and number of puncture times were both lower in group 1 than in group 2. Real-time 3D US-guided PCN is superior to 2D US-guided PCN in terms of visualization of needle tract and the targeted pelvicalyceal system, leading to quick puncture. Real-time 3D US-guided puncture of the kidney holds great promise for clinical implementation in PCN. © 2018 The Authors BJU International © 2018 BJU International Published by John Wiley & Sons Ltd.

Time Demand and Radiation Dose in 3D-Fluoroscopy-based Navigation-assisted 3D-Fluoroscopy-controlled Pedicle Screw Instrumentations.

Science.gov (United States)

Balling, Horst

2018-05-01

Prospective single-center cohort study to record additional time requirements and radiation dose in navigation-assisted O-arm-controlled pedicle screw (PS) instrumentations. The aim of this study was to evaluate amount of extra-time and radiation dose for navigation-assisted PS instrumentations of the thoracolumbosacral spine using O-arm 3D-real-time-navigation (O3DN) compared to non-navigated spinal procedures (NNSPs) with a single C-arm and postoperative computed tomography (CT) scan for controlling PS positions. 3D-navigation is reported to enhance PS insertion accuracy. But time-consuming navigational steps and considerable additional radiation doses seem to limit this modern technique's attraction. A detailed analysis of additional time demand and extra-radiation dose in 3D-navigated spine surgery is not provided in literature, yet. From February 2011 through July 2015, 306 consecutive posterior instrumentations were performed in vertebral levels T10-S1 using O3DN for PS insertion. The duration of procedure-specific navigational steps of the overall collective (I) and the last cohort of 50 consecutive O3DN-surgeries (II) was compared to the average duration of analogous surgical steps in 100 consecutive NNSP using a single C-arm. 3D-radiation dose (dose-length-product, DLP) of navigational and postinstrumentation O-arm scans in group I and II was compared to the average DLP of 100 diagnostic lumbar CT scans. The average presurgical time from patient positioning on the operating table to skin incision was 46.2 ± 10.1 minutes (O3DN, I) and 40.6 ± 9.8 minutes (O3DN, II) versus 30.6 ± 8.3 minutes (NNSP) (P demand of 13.0 minutes compared to NNSP, and with a total DLP below that of a diagnostic lumbar CT scan (P ≈ 0.81). 4.

The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System

DEFF Research Database (Denmark)

Stopczynski, Arkadiusz; Stahlhut, Carsten; Larsen, Jakob Eg

2014-01-01

Combining low-cost wireless EEG sensors with smartphones offers novel opportunities for mobile brain imaging in an everyday context. Here we present the technical details and validation of a framework for building multi-platform, portable EEG applications with real-time 3D source reconstruction....... The system – Smartphone Brain Scanner – combines an off-the-shelf neuroheadset or EEG cap with a smartphone or tablet, and as such represents the first fully portable system for real-time 3D EEG imaging. We discuss the benefits and challenges, including technical limitations as well as details of real...

Real-Time Motion Capture Toolbox (RTMocap): an open-source code for recording 3-D motion kinematics to study action-effect anticipations during motor and social interactions.

Science.gov (United States)

Lewkowicz, Daniel; Delevoye-Turrell, Yvonne

2016-03-01

We present here a toolbox for the real-time motion capture of biological movements that runs in the cross-platform MATLAB environment (The MathWorks, Inc., Natick, MA). It provides instantaneous processing of the 3-D movement coordinates of up to 20 markers at a single instant. Available functions include (1) the setting of reference positions, areas, and trajectories of interest; (2) recording of the 3-D coordinates for each marker over the trial duration; and (3) the detection of events to use as triggers for external reinforcers (e.g., lights, sounds, or odors). Through fast online communication between the hardware controller and RTMocap, automatic trial selection is possible by means of either a preset or an adaptive criterion. Rapid preprocessing of signals is also provided, which includes artifact rejection, filtering, spline interpolation, and averaging. A key example is detailed, and three typical variations are developed (1) to provide a clear understanding of the importance of real-time control for 3-D motion in cognitive sciences and (2) to present users with simple lines of code that can be used as starting points for customizing experiments using the simple MATLAB syntax. RTMocap is freely available (http://sites.google.com/site/RTMocap/) under the GNU public license for noncommercial use and open-source development, together with sample data and extensive documentation.

Real-time three-dimensional transesophageal echocardiography in the assessment of mechanical prosthetic mitral valve ring thrombosis.

Science.gov (United States)

Ozkan, Mehmet; Gürsoy, Ozan Mustafa; Astarcıoğlu, Mehmet Ali; Gündüz, Sabahattin; Cakal, Beytullah; Karakoyun, Süleyman; Kalçık, Macit; Kahveci, Gökhan; Duran, Nilüfer Ekşi; Yıldız, Mustafa; Cevik, Cihan

2013-10-01

Although 2-dimensional (2D) transesophageal echocardiography (TEE) is the gold standard for the diagnosis of prosthetic valve thrombosis, nonobstructive clots located on mitral valve rings can be missed. Real-time 3-dimensional (3D) TEE has incremental value in the visualization of mitral prosthesis. The aim of this study was to investigate the utility of real-time 3D TEE in the diagnosis of mitral prosthetic ring thrombosis. The clinical outcomes of these patients in relation to real-time 3D transesophageal echocardiographic findings were analyzed. Of 1,263 patients who underwent echocardiographic studies, 174 patients (37 men, 137 women) with mitral ring thrombosis detected by real-time 3D TEE constituted the main study population. Patients were followed prospectively on oral anticoagulation for 25 ± 7 months. Eighty-nine patients (51%) had thrombi that were missed on 2D TEE and depicted only on real-time 3D TEE. The remaining cases were partially visualized with 2D TEE but completely visualized with real-time 3D TEE. Thirty-seven patients (21%) had thromboembolism. The mean thickness of the ring thrombosis in patients with thromboembolism was greater than that in patients without thromboembolism (3.8 ± 0.9 vs 2.8 ± 0.7 mm, p 3D TEE during follow-up. There were no thrombi in 39 patients (25%); 45 (29%) had regression of thrombi, and there was no change in thrombus size in 68 patients (44%). Thrombus size increased in 3 patients (2%). Thrombosis was confirmed surgically and histopathologically in 12 patients (7%). In conclusion, real-time 3D TEE can detect prosthetic mitral ring thrombosis that could be missed on 2D TEE and cause thromboembolic events. Copyright © 2013 Elsevier Inc. All rights reserved.

Methodology for time-domain estimation of storm time geoelectric fields using the 3-D magnetotelluric response tensors

Science.gov (United States)

Kelbert, Anna; Balch, Christopher C.; Pulkkinen, Antti; Egbert, Gary D.; Love, Jeffrey J.; Rigler, E. Joshua; Fujii, Ikuko

2017-07-01

Geoelectric fields at the Earth's surface caused by magnetic storms constitute a hazard to the operation of electric power grids and related infrastructure. The ability to estimate these geoelectric fields in close to real time and provide local predictions would better equip the industry to mitigate negative impacts on their operations. Here we report progress toward this goal: development of robust algorithms that convolve a magnetic storm time series with a frequency domain impedance for a realistic three-dimensional (3-D) Earth, to estimate the local, storm time geoelectric field. Both frequency domain and time domain approaches are presented and validated against storm time geoelectric field data measured in Japan. The methods are then compared in the context of a real-time application.

Recent achievements in real-time computational seismology in Taiwan

Science.gov (United States)

Lee, S.; Liang, W.; Huang, B.

2012-12-01

Real-time computational seismology is currently possible to be achieved which needs highly connection between seismic database and high performance computing. We have developed a real-time moment tensor monitoring system (RMT) by using continuous BATS records and moment tensor inversion (CMT) technique. The real-time online earthquake simulation service is also ready to open for researchers and public earthquake science education (ROS). Combine RMT with ROS, the earthquake report based on computational seismology can provide within 5 minutes after an earthquake occurred (RMT obtains point source information ROS completes a 3D simulation real-time now. For more information, welcome to visit real-time computational seismology earthquake report webpage (RCS).

SU-E-P-35: Real-Time Patient Transit Dose Verification of Volumetric Modulated Arc Radiotherapy by a 2D Ionization Chamber Array

Energy Technology Data Exchange (ETDEWEB)

Liu, X

2015-06-15

Purpose: To explore the real-time dose verification method in volumetric modulated arc radiotherapy (VMAT) with a 2D array ion chamber array. Methods: The 2D ion chamber array was fixed on the panel of electronic portal imaging device (EPID). Source-detector distance (SDD)was 140cm. 8mm RW3 solid water was added to the detector panel to achieve maximum readings.The patient plans for esophageal, prostate and liver cancers were selected to deliver on the cylindrical Cheese phantom 5 times in order to validate the reproducibility of doses. Real-time patient transit dose measurements were performed at each fraction. Dose distributions wereevaluated using gamma index criteria of 3mm DTA and 3% dose difference referred to the firsttime Result. Results: The gamma index pass rate in the Cheese phantom were about 98%; The gamma index pass rate for esophageal, liver and prostate cancer patient were about 92%,94%, and 92%, respectively; Gamma pass rate for all single fraction were more than 90%. Conclusion: The 2D array is capable of monitoring the real time transit doses during VMAT delivery. It is helpful to improve the treatment accuracy.

In-situ, real-time, studies of film growth processes using ion scattering and direct recoil spectroscopy techniques.

Energy Technology Data Exchange (ETDEWEB)

Smentkowski, V. S.

1999-04-22

Time-of-flight ion scattering and recoil spectroscopy (TOF-ISARS) enables the characterization of the composition and structure of surfaces with 1-2 monolayer specificity. It will be shown that surface analysis is possible at ambient pressures greater than 3 mTorr using TOF-ISARS techniques; allowing for real-time, in situ studies of film growth processes. TOF-ISARS comprises three analytical techniques: ion scattering spectroscopy (ISS), which detects the backscattered primary ion beam; direct recoil spectroscopy (DRS), which detects the surface species recoiled into the forward scattering direction; and mass spectroscopy of recoiled ions (MSRI), which is 3 variant of DRS capable of isotopic resolution for all surface species--including H and He. The advantages and limitations of each of these techniques will be discussed. The use of the three TOF-ISARS methods for real-time, in situ film growth studies at high ambient pressures will be illustrated. It will be shown that MSRI analysis is possible during sputter deposition. It will be also be demonstrated that the analyzer used for MSRI can also be used for time of flight secondary ion mass spectroscopy (TOF-SIMS) under high vacuum conditions. The use of a single analyzer to perform the complimentary surface analytical techniques of MSRI and SIMS is unique. The dwd functionality of the MSRI analyzer provides surface information not obtained when either MSRI or SIMS is used independently.

An Indoor Scene Recognition-Based 3D Registration Mechanism for Real-Time AR-GIS Visualization in Mobile Applications

Directory of Open Access Journals (Sweden)

Wei Ma

2018-03-01

Full Text Available Mobile Augmented Reality (MAR systems are becoming ideal platforms for visualization, permitting users to better comprehend and interact with spatial information. Subsequently, this technological development, in turn, has prompted efforts to enhance mechanisms for registering virtual objects in real world contexts. Most existing AR 3D Registration techniques lack the scene recognition capabilities needed to describe accurately the positioning of virtual objects in scenes representing reality. Moreover, the application of such registration methods in indoor AR-GIS systems is further impeded by the limited capacity of these systems to detect the geometry and semantic information in indoor environments. In this paper, we propose a novel method for fusing virtual objects and indoor scenes, based on indoor scene recognition technology. To accomplish scene fusion in AR-GIS, we first detect key points in reference images. Then, we perform interior layout extraction using a Fully Connected Networks (FCN algorithm to acquire layout coordinate points for the tracking targets. We detect and recognize the target scene in a video frame image to track targets and estimate the camera pose. In this method, virtual 3D objects are fused precisely to a real scene, according to the camera pose and the previously extracted layout coordinate points. Our results demonstrate that this approach enables accurate fusion of virtual objects with representations of real world indoor environments. Based on this fusion technique, users can better grasp virtual three-dimensional representations on an AR-GIS platform.

PHISICS/RELAP5-3D Adaptive Time-Step Method Demonstrated for the HTTR LOFC#1 Simulation

Energy Technology Data Exchange (ETDEWEB)

Baker, Robin Ivey [Idaho National Lab. (INL), Idaho Falls, ID (United States); Balestra, Paolo [Univ. of Rome (Italy); Strydom, Gerhard [Idaho National Lab. (INL), Idaho Falls, ID (United States)

2017-05-01

A collaborative effort between Japan Atomic Energy Agency (JAEA) and Idaho National Laboratory (INL) as part of the Civil Nuclear Energy Working Group is underway to model the high temperature engineering test reactor (HTTR) loss of forced cooling (LOFC) transient that was performed in December 2010. The coupled version of RELAP5-3D, a thermal fluids code, and PHISICS, a neutronics code, were used to model the transient. The focus of this report is to summarize the changes made to the PHISICS-RELAP5-3D code for implementing an adaptive time step methodology into the code for the first time, and to test it using the full HTTR PHISICS/RELAP5-3D model developed by JAEA and INL and the LOFC simulation. Various adaptive schemes are available based on flux or power convergence criteria that allow significantly larger time steps to be taken by the neutronics module. The report includes a description of the HTTR and the associated PHISICS/RELAP5-3D model test results as well as the University of Rome sub-contractor report documenting the adaptive time step theory and methodology implemented in PHISICS/RELAP5-3D. Two versions of the HTTR model were tested using 8 and 26 energy groups. It was found that most of the new adaptive methods lead to significant improvements in the LOFC simulation time required without significant accuracy penalties in the prediction of the fission power and the fuel temperature. In the best performing 8 group model scenarios, a LOFC simulation of 20 hours could be completed in real-time, or even less than real-time, compared with the previous version of the code that completed the same transient 3-8 times slower than real-time. A few of the user choice combinations between the methodologies available and the tolerance settings did however result in unacceptably high errors or insignificant gains in simulation time. The study is concluded with recommendations on which methods to use for this HTTR model. An important caveat is that these findings

With the advent of domestic 3-dimensional (3D) printers and their associated reduced cost, is it now time for every medical school to have their own 3D printer?

Science.gov (United States)

Balestrini, Christopher; Campo-Celaya, Tatiana

2016-01-01

Anatomy is the backbone of medical education and new techniques to improve learning are frequently explored. With the introduction of 3D printers specifically for the home market, the price of this technology has reached affordable levels. Using patient scan data, accurate 3D models can be printed that represent real human variation in anatomy to provide an innovative, inexpensive and valuable adjunct to anatomical teaching. Is it now time for every medical school to have their own 3D printer?

Direct and real time probe of photoinduced structure transition in colossal magnetoresistive material

Energy Technology Data Exchange (ETDEWEB)

Li, Junjie [Physics Department, Florida State University, Tallahassee, Florida 32310 (United States); National High Magnetic Field Laboratory, Tallahassee, Florida 32310 (United States); Condensed Matter Physics and Materials Science Department, Brookhaven National Laboratory, Upton, New York 11973 (United States); Wang, Xuan [Institute of physics, Chinese Academy of Sciences, P.O. Box 603, Beijing 100190 (China); Zhou, Haidong [National High Magnetic Field Laboratory, Tallahassee, Florida 32310 (United States); Zhou, Jun; Cao, Jianming, E-mail: jcao@magnet.fsu.edu [Physics Department, Florida State University, Tallahassee, Florida 32310 (United States); National High Magnetic Field Laboratory, Tallahassee, Florida 32310 (United States); Cheng, J. G. [Texas Materials Institute, University of Texas at Austin, Austin, Texas 78712 (United States)

2016-07-25

We report a direct and real time measurement of photoinduced structure phase transition in single crystal La{sub 0.84}Sr{sub 0.16}MnO{sub 3} using femtosecond electron diffraction. The melting of orthorhombic lattice ordering under femtosecond optical excitation is found involving two distinct processes with different time scales, an initial fast melting of orthorhombic phase in about 4 ps and a subsequent slower transformation in 90 ps and longer timescales. The fast process is designated as the initial melting of orthorhombic phase induced by the Mn-O bond change that is most likely driven by the quenching of the dynamic Jahn-Teller distortion following the photo-excitation. The slow process is attributed to the growing of newly formed structure domain from the photo-excited sites to the neighboring non-excited orthorhombic sites.

Real Time Seismic Prediction while Drilling

Science.gov (United States)

Schilling, F. R.; Bohlen, T.; Edelmann, T.; Kassel, A.; Heim, A.; Gehring, M.; Lüth, S.; Giese, R.; Jaksch, K.; Rechlin, A.; Kopf, M.; Stahlmann, J.; Gattermann, J.; Bruns, B.

2009-12-01

Efficient and safe drilling is a prerequisite to enhance the mobility of people and goods, to improve the traffic as well as utility infrastructure of growing megacities, and to ensure the growing energy demand while building geothermal and in hydroelectric power plants. Construction within the underground is often building within the unknown. An enhanced risk potential for people and the underground building may arise if drilling enters fracture zones, karsts, brittle rocks, mixed solid and soft rocks, caves, or anthropogenic obstacles. Knowing about the material behavior ahead of the drilling allows reducing the risk during drilling and construction operation. In drilling operations direct observations from boreholes can be complemented with geophysical investigations. In this presentation we focus on “real time” seismic prediction while drilling which is seen as a prerequisite while using geophysical methods in modern drilling operations. In solid rocks P- and S-wave velocity, refraction and reflection as well as seismic wave attenuation can be used for the interpretation of structures ahead of the drilling. An Integrated Seismic Imaging System (ISIS) for exploration ahead of a construction is used, where a pneumatic hammer or a magnetostrictive vibration source generate repetitive signals behind the tunneling machine. Tube waves are generated which travel along the tunnel to the working face. There the tube waves are converted to mainly S- but also P-Waves which interact with the formation ahead of the heading face. The reflected or refracted waves travel back to the working front are converted back to tube waves and recorded using three-component geophones which are fit into the tips of anchor rods. In near real time, the ISIS software allows for an integrated 3D imaging and interpretation of the observed data, geological and geotechnical parameters. Fracture zones, heterogeneities, and variations in the rock properties can be revealed during the drilling

Bi-directional vibration control of offshore wind turbines using a 3D pendulum tuned mass damper

Science.gov (United States)

Sun, C.; Jahangiri, V.

2018-05-01

Offshore wind turbines suffer from excessive bi-directional vibrations due to wind-wave misalignment and vortex induced vibrations. However, most of existing research focus on unidirectional vibration attenuation which is inadequate for real applications. The present paper proposes a three dimensional pendulum tuned mass damper (3d-PTMD) to mitigate the tower and nacelle dynamic response in the fore-aft and side-side directions. An analytical model of the wind turbine coupled with the 3d-PTMD is established wherein the interaction between the blades, the tower and the 3d-PTMD is modeled. Aerodynamic loading is computed using the Blade Element Momentum method where the Prandtls tip loss factor and the Glauert correction are considered. JONSWAP spectrum is adopted to generate wave data. Wave loading is computed using Morisons equation in collaboration with the strip theory. Via a numerical search approach, the design formula of the 3d-PTMD is obtained and examined on a National Renewable Energy Lab (NREL) monopile 5 MW baseline wind turbine model under misaligned wind, wave and seismic loading. Dual linear tuned mass dampers (TMDs) deployed in the fore-aft and side-side directions are utilized for comparison. It is found that the 3d-PTMD with a mass ratio of 2 % can improve the mitigation of the root mean square and peak response by around 10 % when compared with the dual linear TMDs in controlling the bi-directional vibration of the offshore wind turbines under misaligned wind, wave and seismic loading.

An improved ultrafast 2D NMR experiment: Towards atom-resolved real-time studies of protein kinetics at multi-Hz rates

International Nuclear Information System (INIS)

Gal, Maayan; Kern, Thomas; Schanda, Paul; Frydman, Lucio; Brutscher, Bernhard

2009-01-01

Multidimensional NMR spectroscopy is a well-established technique for the characterization of structure and fast-time-scale dynamics of highly populated ground states of biological macromolecules. The investigation of short-lived excited states that are important for molecular folding, misfolding and function, however, remains a challenge for modern biomolecular NMR techniques. Off-equilibrium real-time kinetic NMR methods allow direct observation of conformational or chemical changes by following peak positions and intensities in a series of spectra recorded during a kinetic event. Because standard multidimensional NMR methods required to yield sufficient atom-resolution are intrinsically time-consuming, many interesting phenomena are excluded from real-time NMR analysis. Recently, spatially encoded ultrafast 2D NMR techniques have been proposed that allow one to acquire a 2D NMR experiment within a single transient. In addition, when combined with the SOFAST technique, such ultrafast experiments can be repeated at high rates. One of the problems detected for such ultrafast protein NMR experiments is related to the heteronuclear decoupling during detection with interferences between the pulses and the oscillatory magnetic field gradients arising in this scheme. Here we present a method for improved ultrafast data acquisition yielding higher signal to noise and sharper lines in single-scan 2D NMR spectra. In combination with a fast-mixing device, the recording of 1 H- 15 N correlation spectra with repetition rates of up to a few Hertz becomes feasible, enabling real-time studies of protein kinetics occurring on time scales down to a few seconds

Micromachined silicon acoustic delay line with improved structural stability and acoustic directivity for real-time photoacoustic tomography

Science.gov (United States)

Cho, Young; Kumar, Akhil; Xu, Song; Zou, Jun

2017-03-01

Recent studies have shown that micromachined silicon acoustic delay lines can provide a promising solution to achieve real-time photoacoustic tomography without the need for complex transducer arrays and data acquisition electronics. However, as its length increases to provide longer delay time, the delay line becomes more vulnerable to structural instability due to reduced mechanical stiffness. In addition, the small cross-section area of the delay line results in a large acoustic acceptance angle and therefore poor directivity. To address these two issues, this paper reports the design, fabrication, and testing of a new silicon acoustic delay line enhanced with 3D printed polymer micro linker structures. First, mechanical deformation of the silicon acoustic delay line (with and without linker structures) under gravity was simulated by using finite element method. Second, the acoustic crosstalk and acoustic attenuation caused by the polymer micro linker structures were evaluated with both numerical simulation and ultrasound transmission testing. The result shows that the use of the polymer micro linker structures significantly improves the structural stability of the silicon acoustic delay lines without creating additional acoustic attenuation and crosstalk. In addition, a new tapered design for the input terminal of the delay line was also investigate to improve its acoustic directivity by reducing the acoustic acceptance angle. These two improvements are expected to provide an effective solution to eliminate current limitations on the achievable acoustic delay time and out-of-plane imaging resolution of micromachined silicon acoustic delay line arrays.

Real-time 3D transesophageal echocardiography-guided closure of a complicated patent ductus arteriosus in a dog.

Science.gov (United States)

Doocy, K R; Nelson, D A; Saunders, A B

2017-06-01

Advanced imaging modalities are becoming more widely available in veterinary cardiology, including the use of transesophageal echocardiography (TEE) during occlusion of patent ductus arteriosus (PDA) in dogs. The dog in this report had a complex history of attempted ligation and a large PDA that initially precluded device placement thereby limiting the options for PDA closure. Following a second thoracotomy and partial ligation, the morphology of the PDA was altered and device occlusion was an option. Angiographic assessment of the PDA was limited by the presence of hemoclips, and the direction of ductal flow related to the change in anatomy following ligature placement. Intra-operative TEE, in particular real-time three-dimensional imaging, was pivotal for assessing the PDA morphology, monitoring during the procedure, selecting the device size, and confirming device placement. The TEE images increased operator confidence that the size and location of the device were appropriate before release despite the unusual position. This report highlights the benefit of intra-operative TEE, in particular real-time three-dimensional imaging, for successful PDA occlusion in a complicated case. Copyright © 2017 Elsevier B.V. All rights reserved.

An Innovative Direct-Interaction-Enabled Augmented-Reality 3D System

Directory of Open Access Journals (Sweden)

Sheng-Hsiung Chang

2013-01-01

Full Text Available Previous augmented-reality (AR applications have required users to observe the integration of real and virtual images on a display. This study proposes a novel concept regarding AR applications. By integrating AR techniques with marker identification, virtual-image output, imaging, and image-interaction processes, this study rendered virtual images that can interact with predefined markers in a real three-dimensional (3D environment.

Left-ventricle segmentation in real-time 3D echocardiography using a hybrid active shape model and optimal graph search approach

Science.gov (United States)

Zhang, Honghai; Abiose, Ademola K.; Campbell, Dwayne N.; Sonka, Milan; Martins, James B.; Wahle, Andreas

2010-03-01

Quantitative analysis of the left ventricular shape and motion patterns associated with left ventricular mechanical dyssynchrony (LVMD) is essential for diagnosis and treatment planning in congestive heart failure. Real-time 3D echocardiography (RT3DE) used for LVMD analysis is frequently limited by heavy speckle noise or partially incomplete data, thus a segmentation method utilizing learned global shape knowledge is beneficial. In this study, the endocardial surface of the left ventricle (LV) is segmented using a hybrid approach combining active shape model (ASM) with optimal graph search. The latter is used to achieve landmark refinement in the ASM framework. Optimal graph search translates the 3D segmentation into the detection of a minimum-cost closed set in a graph and can produce a globally optimal result. Various information-gradient, intensity distributions, and regional-property terms-are used to define the costs for the graph search. The developed method was tested on 44 RT3DE datasets acquired from 26 LVMD patients. The segmentation accuracy was assessed by surface positioning error and volume overlap measured for the whole LV as well as 16 standard LV regions. The segmentation produced very good results that were not achievable using ASM or graph search alone.

MonoSLAM: real-time single camera SLAM.

Science.gov (United States)

Davison, Andrew J; Reid, Ian D; Molton, Nicholas D; Stasse, Olivier

2007-06-01

We present a real-time algorithm which can recover the 3D trajectory of a monocular camera, moving rapidly through a previously unknown scene. Our system, which we dub MonoSLAM, is the first successful application of the SLAM methodology from mobile robotics to the "pure vision" domain of a single uncontrolled camera, achieving real time but drift-free performance inaccessible to Structure from Motion approaches. The core of the approach is the online creation of a sparse but persistent map of natural landmarks within a probabilistic framework. Our key novel contributions include an active approach to mapping and measurement, the use of a general motion model for smooth camera movement, and solutions for monocular feature initialization and feature orientation estimation. Together, these add up to an extremely efficient and robust algorithm which runs at 30 Hz with standard PC and camera hardware. This work extends the range of robotic systems in which SLAM can be usefully applied, but also opens up new areas. We present applications of MonoSLAM to real-time 3D localization and mapping for a high-performance full-size humanoid robot and live augmented reality with a hand-held camera.

Separate visualization of endolymphatic space, perilymphatic space and bone by a single pulse sequence; 3D-inversion recovery imaging utilizing real reconstruction after intratympanic Gd-DTPA administration at 3 tesla

International Nuclear Information System (INIS)

Naganawa, Shinji; Satake, Hiroko; Kawamura, Minako; Fukatsu, Hiroshi; Sone, Michihiko; Nakashima, Tsutomu

2008-01-01

Twenty-four hours after intratympanic administration of gadolinium contrast material (Gd), the Gd was distributed mainly in the perilymphatic space. Three-dimensional FLAIR can differentiate endolymphatic space from perilymphatic space, but not from surrounding bone. The purpose of this study was to evaluate whether 3D inversion-recovery turbo spin echo (3D-IR TSE) with real reconstruction could separate the signals of perilymphatic space (positive value), endolymphatic space (negative value) and bone (near zero) by setting the inversion time between the null point of Gd-containing perilymph fluid and that of the endolymph fluid without Gd. Thirteen patients with clinically suspected endolymphatic hydrops underwent intratympanic Gd injection and were scanned at 3 T. A 3D FLAIR and 3D-IR TSE with real reconstruction were obtained. In all patients, low signal of endolymphatic space in the labyrinth on 3D FLAIR was observed in the anatomically appropriate position, and it showed negative signal on 3D-IR TSE. The low signal area of surrounding bone on 3D FLAIR showed near zero signal on 3D-IR TSE. Gd-containing perilymphatic space showed high signal on 3D-IR TSE. In conclusion, by optimizing the inversion time, endolymphatic space, perilymphatic space and surrounding bone can be separately visualized on a single image using a 3D-IR TSE with real reconstruction. (orig.)

2D and 3D Traveling Salesman Problem

Science.gov (United States)

Haxhimusa, Yll; Carpenter, Edward; Catrambone, Joseph; Foldes, David; Stefanov, Emil; Arns, Laura; Pizlo, Zygmunt

2011-01-01

When a two-dimensional (2D) traveling salesman problem (TSP) is presented on a computer screen, human subjects can produce near-optimal tours in linear time. In this study we tested human performance on a real and virtual floor, as well as in a three-dimensional (3D) virtual space. Human performance on the real floor is as good as that on a…

Perfusion directed 3D mineral formation within cell-laden hydrogels.

Science.gov (United States)

Sawyer, Stephen William; Shridhar, Shivkumar Vishnempet; Zhang, Kairui; Albrecht, Lucas; Filip, Alex; Horton, Jason; Soman, Pranav

2018-06-08

Despite the promise of stem cell engineering and the new advances in bioprinting technologies, one of the major challenges in the manufacturing of large scale bone tissue scaffolds is the inability to perfuse nutrients throughout thick constructs. Here, we report a scalable method to create thick, perfusable bone constructs using a combination of cell-laden hydrogels and a 3D printed sacrificial polymer. Osteoblast-like Saos-2 cells were encapsulated within a gelatin methacrylate (GelMA) hydrogel and 3D printed polyvinyl alcohol (PVA) pipes were used to create perfusable channels. A custom-built bioreactor was used to perfuse osteogenic media directly through the channels in order to induce mineral deposition which was subsequently quantified via microCT. Histological staining was used to verify mineral deposition around the perfused channels, while COMSOL modeling was used to simulate oxygen diffusion between adjacent channels. This information was used to design a scaled-up construct containing a 3D array of perfusable channels within cell-laden GelMA. Progressive matrix mineralization was observed by cells surrounding perfused channels as opposed to random mineral deposition in static constructs. MicroCT confirmed that there was a direct relationship between channel mineralization within perfused constructs and time within the bioreactor. Furthermore, the scalable method presented in this work serves as a model on how large-scale bone tissue replacement constructs could be made using commonly available 3D printers, sacrificial materials, and hydrogels. © 2018 IOP Publishing Ltd.

NASA's "Eyes On The Solar System:" A Real-time, 3D-Interactive Tool to Teach the Wonder of Planetary Science

Science.gov (United States)

Hussey, K.

2014-12-01

NASA's Jet Propulsion Laboratory is using video game technology to immerse students, the general public and mission personnel in our solar system and beyond. "Eyes on the Solar System," a cross-platform, real-time, 3D-interactive application that can run on-line or as a stand-alone "video game," is of particular interest to educators looking for inviting tools to capture students interest in a format they like and understand. (eyes.nasa.gov). It gives users an extraordinary view of our solar system by virtually transporting them across space and time to make first-person observations of spacecraft, planetary bodies and NASA/ESA missions in action. Key scientific results illustrated with video presentations, supporting imagery and web links are imbedded contextually into the solar system. Educators who want an interactive, game-based approach to engage students in learning Planetary Science will see how "Eyes" can be effectively used to teach its principles to grades 3 through 14.The presentation will include a detailed demonstration of the software along with a description/demonstration of how this technology is being adapted for education. There will also be a preview of coming attractions. This work is being conducted by the Visualization Technology Applications and Development Group at NASA's Jet Propulsion Laboratory, the same team responsible for "Eyes on the Earth 3D," and "Eyes on Exoplanets," which can be viewed at eyes.nasa.gov/earth and eyes.nasa.gov/exoplanets.

Large holographic displays for real-time applications

Science.gov (United States)

Schwerdtner, A.; Häussler, R.; Leister, N.

2008-02-01

Holography is generally accepted as the ultimate approach to display three-dimensional scenes or objects. Principally, the reconstruction of an object from a perfect hologram would appear indistinguishable from viewing the corresponding real-world object. Up to now two main obstacles have prevented large-screen Computer-Generated Holograms (CGH) from achieving a satisfactory laboratory prototype not to mention a marketable one. The reason is a small cell pitch CGH resulting in a huge number of hologram cells and a very high computational load for encoding the CGH. These seemingly inevitable technological hurdles for a long time have not been cleared limiting the use of holography to special applications, such as optical filtering, interference, beam forming, digital holography for capturing the 3-D shape of objects, and others. SeeReal Technologies has developed a new approach for real-time capable CGH using the socalled Tracked Viewing Windows technology to overcome these problems. The paper will show that today's state of the art reconfigurable Spatial Light Modulators (SLM), especially today's feasible LCD panels are suited for reconstructing large 3-D scenes which can be observed from large viewing angles. For this to achieve the original holographic concept of containing information from the entire scene in each part of the CGH has been abandoned. This substantially reduces the hologram resolution and thus the computational load by several orders of magnitude making thus real-time computation possible. A monochrome real-time prototype measuring 20 inches has been built and demonstrated at last year's SID conference and exhibition 2007 and at several other events.

Accuracy and reliability of 3D stereophotogrammetry: A comparison to direct anthropometry and 2D photogrammetry.

Science.gov (United States)

Dindaroğlu, Furkan; Kutlu, Pınar; Duran, Gökhan Serhat; Görgülü, Serkan; Aslan, Erhan

2016-05-01

To evaluate the accuracy of three-dimensional (3D) stereophotogrammetry by comparing it with the direct anthropometry and digital photogrammetry methods. The reliability of 3D stereophotogrammetry was also examined. Six profile and four frontal parameters were directly measured on the faces of 80 participants. The same measurements were repeated using two-dimensional (2D) photogrammetry and 3D stereophotogrammetry (3dMDflex System, 3dMD, Atlanta, Ga) to obtain images of the subjects. Another observer made the same measurements for images obtained with 3D stereophotogrammetry, and interobserver reproducibility was evaluated for 3D images. Both observers remeasured the 3D images 1 month later, and intraobserver reproducibility was evaluated. Statistical analysis was conducted using the paired samples t-test, intraclass correlation coefficient, and Bland-Altman limits of agreement. The highest mean difference was 0.30 mm between direct measurement and photogrammetry, 0.21 mm between direct measurement and 3D stereophotogrammetry, and 0.5 mm between photogrammetry and 3D stereophotogrammetry. The lowest agreement value was 0.965 in the Sn-Pro parameter between the photogrammetry and 3D stereophotogrammetry methods. Agreement between the two observers varied from 0.90 (Ch-Ch) to 0.99 (Sn-Me) in linear measurements. For intraobserver agreement, the highest difference between means was 0.33 for observer 1 and 1.42 mm for observer 2. Measurements obtained using 3D stereophotogrammetry indicate that it may be an accurate and reliable imaging method for use in orthodontics.

Novel, high-definition 3-D endoscopy system with real-time compression communication system to aid diagnoses and treatment between hospitals in Thailand.

Science.gov (United States)

Uemura, Munenori; Kenmotsu, Hajime; Tomikawa, Morimasa; Kumashiro, Ryuichi; Yamashita, Makoto; Ikeda, Testuo; Yamashita, Hiromasa; Chiba, Toshio; Hayashi, Koichi; Sakae, Eiji; Eguchi, Mitsuo; Fukuyo, Tsuneo; Chittmittrapap, Soottiporn; Navicharern, Patpong; Chotiwan, Pornarong; Pattana-Arum, Jirawat; Hashizume, Makoto

2015-05-01

Traditionally, laparoscopy has been based on 2-D imaging, which represents a considerable challenge. As a result, 3-D visualization technology has been proposed as a way to better facilitate laparoscopy. We compared the latest 3-D systems with high-end 2-D monitors to validate the usefulness of new systems for endoscopic diagnoses and treatment in Thailand. We compared the abilities of our high-definition 3-D endoscopy system with real-time compression communication system with a conventional high-definition (2-D) endoscopy system by asking health-care staff to complete tasks. Participants answered questionnaires and whether procedures were easier using our system or the 2-D endoscopy system. Participants were significantly faster at suture insertion with our system (34.44 ± 15.91 s) than with the 2-D system (52.56 ± 37.51 s) (P < 0.01). Most surgeons thought that the 3-D system was good in terms of contrast, brightness, perception of the anteroposterior position of the needle, needle grasping, inserting the needle as planned, and needle adjustment during laparoscopic surgery. Several surgeons highlighted the usefulness of exposing and clipping the bile duct and gallbladder artery, as well as dissection from the liver bed during laparoscopic surgery. In an image-transfer experiment with RePure-L®, participants at Rajavithi Hospital could obtain reconstructed 3-D images that were non-inferior to conventional images from Chulalongkorn University Hospital (10 km away). These data suggest that our newly developed system could be of considerable benefit to the health-care system in Thailand. Transmission of moving endoscopic images from a center of excellence to a rural hospital could help in the diagnosis and treatment of various diseases. © 2015 Japan Society for Endoscopic Surgery, Asia Endosurgery Task Force and Wiley Publishing Asia Pty Ltd.

Solar Potential Analysis and Integration of the Time-Dependent Simulation Results for Semantic 3d City Models Using Dynamizers

Science.gov (United States)

Chaturvedi, K.; Willenborg, B.; Sindram, M.; Kolbe, T. H.

2017-10-01

Semantic 3D city models play an important role in solving complex real-world problems and are being adopted by many cities around the world. A wide range of application and simulation scenarios directly benefit from the adoption of international standards such as CityGML. However, most of the simulations involve properties, whose values vary with respect to time, and the current generation semantic 3D city models do not support time-dependent properties explicitly. In this paper, the details of solar potential simulations are provided operating on the CityGML standard, assessing and estimating solar energy production for the roofs and facades of the 3D building objects in different ways. Furthermore, the paper demonstrates how the time-dependent simulation results are better-represented inline within 3D city models utilizing the so-called Dynamizer concept. This concept not only allows representing the simulation results in standardized ways, but also delivers a method to enhance static city models by such dynamic property values making the city models truly dynamic. The dynamizer concept has been implemented as an Application Domain Extension of the CityGML standard within the OGC Future City Pilot Phase 1. The results are given in this paper.

Real-time dynamic analysis for complete loop of direct steam generation solar trough collector

International Nuclear Information System (INIS)

Guo, Su; Liu, Deyou; Chu, Yinghao; Chen, Xingying; Shen, Bingbing; Xu, Chang; Zhou, Ling; Wang, Pei

2016-01-01

Highlights: • A nonlinear distribution parameter dynamic model has been developed. • Real-time local heat transfer coefficient and friction coefficient are adopted. • The dynamic behavior of the solar trough collector loop are simulated. • High-frequency chattering of outlet fluid flow are analyzed and modeled. • Irradiance disturbance at subcooled water region generates larger influence. - Abstract: Direct steam generation is a potential approach to further reduce the levelized electricity cost of solar trough. Dynamic modeling of the collector loop is essential for operation and control of direct steam generation solar trough. However, the dynamic behavior of fluid based on direct steam generation is complex because of the two-phase flow in the pipeline. In this work, a nonlinear distribution parameter model has been developed to model the dynamic behaviors of direct steam generation parabolic trough collector loops under either full or partial solar irradiance disturbance. Compared with available dynamic model, the proposed model possesses two advantages: (1) real-time local values of heat transfer coefficient and friction resistance coefficient, and (2) considering of the complete loop of collectors, including subcooled water region, two-phase flow region and superheated steam region. The proposed model has shown superior performance, particularly in case of sensitivity study of fluid parameters when the pipe is partially shaded. The proposed model has been validated using experimental data from Solar Thermal Energy Laboratory of University of New South Wales, with an outlet fluid temperature relative error of only 1.91%. The validation results show that: (1) The proposed model successfully outperforms two reference models in predicting the behavior of direct steam generation solar trough. (2) The model theoretically predicts that, during solar irradiance disturbance, the discontinuities of fluid physical property parameters and the moving back and

Real-time interactive treatment planning

International Nuclear Information System (INIS)

Otto, Karl

2014-01-01

The goal of this work is to develop an interactive treatment planning platform that permits real-time manipulation of dose distributions including DVHs and other dose metrics. The hypothesis underlying the approach proposed here is that the process of evaluating potential dose distribution options and deciding on the best clinical trade-offs may be separated from the derivation of the actual delivery parameters used for the patient’s treatment. For this purpose a novel algorithm for deriving an Achievable Dose Estimate (ADE) was developed. The ADE algorithm is computationally efficient so as to update dose distributions in effectively real-time while accurately incorporating the limits of what can be achieved in practice. The resulting system is a software environment for interactive real-time manipulation of dose that permits the clinician to rapidly develop a fully customized 3D dose distribution. Graphical navigation of dose distributions is achieved by a sophisticated method of identifying contributing fluence elements, modifying those elements and re-computing the entire dose distribution. 3D dose distributions are calculated in ∼2–20 ms. Including graphics processing overhead, clinicians may visually interact with the dose distribution (e.g. ‘drag’ a DVH) and display updates of the dose distribution at a rate of more than 20 times per second. Preliminary testing on various sites shows that interactive planning may be completed in ∼1–5 min, depending on the complexity of the case (number of targets and OARs). Final DVHs are derived through a separate plan optimization step using a conventional VMAT planning system and were shown to be achievable within 2% and 4% in high and low dose regions respectively. With real-time interactive planning trade-offs between Target(s) and OARs may be evaluated efficiently providing a better understanding of the dosimetric options available to each patient in static or adaptive RT. (paper)

Impact of time-of-flight on indirect 3D and direct 4D parametric image reconstruction in the presence of inconsistent dynamic PET data

Science.gov (United States)

Kotasidis, F. A.; Mehranian, A.; Zaidi, H.

2016-05-01

Kinetic parameter estimation in dynamic PET suffers from reduced accuracy and precision when parametric maps are estimated using kinetic modelling following image reconstruction of the dynamic data. Direct approaches to parameter estimation attempt to directly estimate the kinetic parameters from the measured dynamic data within a unified framework. Such image reconstruction methods have been shown to generate parametric maps of improved precision and accuracy in dynamic PET. However, due to the interleaving between the tomographic and kinetic modelling steps, any tomographic or kinetic modelling errors in certain regions or frames, tend to spatially or temporally propagate. This results in biased kinetic parameters and thus limits the benefits of such direct methods. Kinetic modelling errors originate from the inability to construct a common single kinetic model for the entire field-of-view, and such errors in erroneously modelled regions could spatially propagate. Adaptive models have been used within 4D image reconstruction to mitigate the problem, though they are complex and difficult to optimize. Tomographic errors in dynamic imaging on the other hand, can originate from involuntary patient motion between dynamic frames, as well as from emission/transmission mismatch. Motion correction schemes can be used, however, if residual errors exist or motion correction is not included in the study protocol, errors in the affected dynamic frames could potentially propagate either temporally, to other frames during the kinetic modelling step or spatially, during the tomographic step. In this work, we demonstrate a new strategy to minimize such error propagation in direct 4D image reconstruction, focusing on the tomographic step rather than the kinetic modelling step, by incorporating time-of-flight (TOF) within a direct 4D reconstruction framework. Using ever improving TOF resolutions (580 ps, 440 ps, 300 ps and 160 ps), we demonstrate that direct 4D TOF image

Real-time dose calculation and visualization for the proton therapy of ocular tumours

Energy Technology Data Exchange (ETDEWEB)

Pfeiffer, Karsten [Medizinische Physik, Deutsches Krebsforschungszentrum, INF 280, D-69120 Heidelberg (Germany). E-mail: k.pfeiffer at dkfz.de; Bendl, Rolf [Medizinische Physik, Deutsches Krebsforschungszentrum, INF 280, D-69120 Heidelberg (Germany). E-mail: r.bendl at dkfz.de

2001-03-01

A new real-time dose calculation and visualization was developed as part of the new 3D treatment planning tool OCTOPUS for proton therapy of ocular tumours within a national research project together with the Hahn-Meitner Institut Berlin. The implementation resolves the common separation between parameter definition, dose calculation and evaluation and allows a direct examination of the expected dose distribution while adjusting the treatment parameters. The new tool allows the therapist to move the desired dose distribution under visual control in 3D to the appropriate place. The visualization of the resulting dose distribution as a 3D surface model, on any 2D slice or on the surface of specified ocular structures is done automatically when adapting parameters during the planning process. In addition, approximate dose volume histograms may be calculated with little extra time. The dose distribution is calculated and visualized in 200 ms with an accuracy of 6% for the 3D isodose surfaces and 8% for other objects. This paper discusses the advantages and limitations of this new approach. (author)

Real time software for the control and monitoring of DIII-D system interlocks

International Nuclear Information System (INIS)

Broesch, J.D.; Penaflor, B.G.; Coon, R.M.; Harris, J.J.; Scoville, J.T.

1996-10-01

This paper describes the real time, multi-tasking, multi-user software and communications of the E-Power Supply System Integrated Controller (EPSSIC) for the DIII-D tokamak. EPSSIC performs the DIII-D system wide go/no-go determination for the plasma sequencing. This paper discusses the data module handling, task work load balancing, and communications requirements. Operational experience with the new EPSSIC and recent improvements to this system are also described

Real Time Animation of Trees Based on BBSC in Computer Games

Directory of Open Access Journals (Sweden)

Xuefeng Ao

2009-01-01

Full Text Available That researchers in the field of computer games usually find it is difficult to simulate the motion of actual 3D model trees lies in the fact that the tree model itself has very complicated structure, and many sophisticated factors need to be considered during the simulation. Though there are some works on simulating 3D tree and its motion, few of them are used in computer games due to the high demand for real-time in computer games. In this paper, an approach of animating trees in computer games based on a novel tree model representation—Ball B-Spline Curves (BBSCs are proposed. By taking advantage of the good features of the BBSC-based model, physical simulation of the motion of leafless trees with wind blowing becomes easier and more efficient. The method can generate realistic 3D tree animation in real-time, which meets the high requirement for real time in computer games.

A novel asymptotic expansion homogenization analysis for 3-D composite with relieved periodicity in the thickness direction

KAUST Repository

Nasution, Muhammad Ridlo Erdata

2014-06-01

A new asymptotic expansion homogenization analysis is proposed to analyze 3-D composite in which thermomechanical and finite thickness effects are considered. Finite thickness effect is captured by relieving periodic boundary condition at the top and bottom of unit-cell surfaces. The mathematical treatment yields that only 2-D periodicity (i.e. in in-plane directions) is taken into account. A unit-cell representing the whole thickness of 3-D composite is built to facilitate the present method. The equivalent in-plane thermomechanical properties of 3-D orthogonal interlock composites are calculated by present method, and the results are compared with those obtained by standard homogenization method (with 3-D periodicity). Young\\'s modulus and Poisson\\'s ratio obtained by present method are also compared with experiments whereby a good agreement is particularly found for the Young\\'s modulus. Localization analysis is carried out to evaluate the stress responses within the unit-cell of 3-D composites for two cases: thermal and biaxial tensile loading. Standard finite element (FE) analysis is also performed to validate the stress responses obtained by localization analysis. It is found that present method results are in a good agreement with standard FE analysis. This fact emphasizes that relieving periodicity in the thickness direction is necessary to accurately simulate the real free-traction condition in 3-D composite. © 2014 Elsevier Ltd.

A novel asymptotic expansion homogenization analysis for 3-D composite with relieved periodicity in the thickness direction

KAUST Repository

Nasution, Muhammad Ridlo Erdata; Watanabe, Naoyuki; Kondo, Atsushi; Yudhanto, Arief

2014-01-01

A new asymptotic expansion homogenization analysis is proposed to analyze 3-D composite in which thermomechanical and finite thickness effects are considered. Finite thickness effect is captured by relieving periodic boundary condition at the top and bottom of unit-cell surfaces. The mathematical treatment yields that only 2-D periodicity (i.e. in in-plane directions) is taken into account. A unit-cell representing the whole thickness of 3-D composite is built to facilitate the present method. The equivalent in-plane thermomechanical properties of 3-D orthogonal interlock composites are calculated by present method, and the results are compared with those obtained by standard homogenization method (with 3-D periodicity). Young's modulus and Poisson's ratio obtained by present method are also compared with experiments whereby a good agreement is particularly found for the Young's modulus. Localization analysis is carried out to evaluate the stress responses within the unit-cell of 3-D composites for two cases: thermal and biaxial tensile loading. Standard finite element (FE) analysis is also performed to validate the stress responses obtained by localization analysis. It is found that present method results are in a good agreement with standard FE analysis. This fact emphasizes that relieving periodicity in the thickness direction is necessary to accurately simulate the real free-traction condition in 3-D composite. © 2014 Elsevier Ltd.

Frozen Gaussian approximation for 3D seismic tomography

Science.gov (United States)

Chai, Lihui; Tong, Ping; Yang, Xu

2018-05-01

Three-dimensional (3D) wave-equation-based seismic tomography is computationally challenging in large scales and high-frequency regime. In this paper, we apply the frozen Gaussian approximation (FGA) method to compute 3D sensitivity kernels and seismic tomography of high-frequency. Rather than standard ray theory used in seismic inversion (e.g. Kirchhoff migration and Gaussian beam migration), FGA is used to compute the 3D high-frequency sensitivity kernels for travel-time or full waveform inversions. Specifically, we reformulate the equations of the forward and adjoint wavefields for the purpose of convenience to apply FGA, and with this reformulation, one can efficiently compute the Green’s functions whose convolutions with source time function produce wavefields needed for the construction of 3D kernels. Moreover, a fast summation method is proposed based on local fast Fourier transform which greatly improves the speed of reconstruction as the last step of FGA algorithm. We apply FGA to both the travel-time adjoint tomography and full waveform inversion (FWI) on synthetic crosswell seismic data with dominant frequencies as high as those of real crosswell data, and confirm again that FWI requires a more sophisticated initial velocity model for the convergence than travel-time adjoint tomography. We also numerically test the accuracy of applying FGA to local earthquake tomography. This study paves the way to directly apply wave-equation-based seismic tomography methods into real data around their dominant frequencies.

A real-time virtual delivery system for photon radiotherapy delivery monitoring

Directory of Open Access Journals (Sweden)

Feng Shi

2014-03-01

Full Text Available Purpose: Treatment delivery monitoring is important for radiotherapy, which enables catching dosimetric error at the earliest possible opportunity. This project develops a virtual delivery system to monitor the dose delivery process of photon radiotherapy in real-time using GPU-based Monte Carlo (MC method.Methods: The simulation process consists of 3 parallel CPU threads. A thread T1 is responsible for communication with a linac, which acquires a set of linac status parameters, e.g. gantry angles, MLC configurations, and beam MUs every 20 ms. Since linac vendors currently do not offer interface to acquire data in real time, we mimic this process by fetching information from a linac dynalog file at the set frequency. Instantaneous beam fluence map (FM is calculated based. A FM buffer is also created in T1 and the instantaneous FM is accumulated to it. This process continues, until a ready signal is received from thread T2 on which an in-house developed MC dose engine executes on GPU. At that moment, the accumulated FM is transferred to T2 for dose calculations, and the FM buffer in T1 is cleared. Once the dose calculation finishes, the resulting 3D dose distribution is directed to thread T3, which displays it in three orthogonal planes in color wash overlaid on the CT image. This process continues to monitor the 3D dose distribution in real-time.Results: An IMRT and a VMAT cases used in our patient-specific QA are studied. Maximum dose differences between our system and treatment planning system are 0.98% and 1.58% for the IMRT and VMAT cases, respectively. The update frequency is >10Hz and the relative uncertainty level is 2%.Conclusion: By embedding a GPU-based MC code in a novel data/work flow, it is possible to achieve real-time MC dose calculations to monitor delivery process.------------------------------Cite this article as: Shi F, Gu X, Graves YJ, Jiang S, Jia X. A real-time virtual delivery system for photon radiotherapy delivery

Real-Time Evaluation of 26-GBaud PAM-4 Intensity Modulation and Direct Detection Systems for Data-Center Interconnects

DEFF Research Database (Denmark)

Eiselt, Nicklas; Griesser, Helmut; Wei, Jinlong

2016-01-01

Real-time transmission with 26-GBaud PAM-4 as a promising modulation format for data-center interconnects with operation in C-band is evaluated. For an OSNR penalty below 2 dB a dispersion tolerance of up to 10 km of SSMF is achieved......Real-time transmission with 26-GBaud PAM-4 as a promising modulation format for data-center interconnects with operation in C-band is evaluated. For an OSNR penalty below 2 dB a dispersion tolerance of up to 10 km of SSMF is achieved...

Aerosol Emissions from Fuse-Deposition Modeling 3D Printers in a Chamber and in Real Indoor Environments.

Science.gov (United States)

Vance, Marina E; Pegues, Valerie; Van Montfrans, Schuyler; Leng, Weinan; Marr, Linsey C

2017-09-05

Three-dimensional (3D) printers are known to emit aerosols, but questions remain about their composition and the fundamental processes driving emissions. The objective of this work was to characterize the aerosol emissions from the operation of a fuse-deposition modeling 3D printer. We modeled the time- and size-resolved emissions of submicrometer aerosols from the printer in a chamber study, gained insight into the chemical composition of emitted aerosols using Raman spectroscopy, and measured the potential for exposure to the aerosols generated by 3D printers under real-use conditions in a variety of indoor environments. The average aerosol emission rates ranged from ∼10 8 to ∼10 11 particles min -1 , and the rates varied over the course of a print job. Acrylonitrile butadiene styrene (ABS) filaments generated the largest number of aerosols, and wood-infused polylactic acid (PLA) filaments generated the smallest amount. The emission factors ranged from 6 × 10 8 to 6 × 10 11 per gram of printed part, depending on the type of filament used. For ABS, the Raman spectra of the filament and the printed part were indistinguishable, while the aerosol spectra lacked important peaks corresponding to styrene and acrylonitrile, which are both present in ABS. This observation suggests that aerosols are not a result of volatilization and subsequent nucleation of ABS or direct release of ABS aerosols.

Performance Evaluation of a Synthetic Aperture Real-Time Ultrasound System

DEFF Research Database (Denmark)

Stuart, Matthias Bo; Tomov, Borislav Gueorguiev; Jensen, Jørgen Arendt

2011-01-01

This paper evaluates the signal-to-noise ratio, the time stability, and the phase difference of the sampling in the experimental ultrasound scanner SARUS: A synthetic aperture, real-time ultrasound system. SARUS has 1024 independent transmit and receive channels and is capable of handling 2D probes...... arrays (FPGAs) making it very flexible and allowing implementation of other real-time ultrasound processing methods in the future. For conventional B-mode imaging, a penetration depth around 7 cm for a 7 MHz transducer is obtained (signal-tonoise ratio of 0 dB), which is comparable to commercial...... for 3D ultrasound imaging. It samples at 12 bits per sample and has a sampling rate of 70 MHz with the possibility of decimating the sampling frequency at the input. SARUS is capable of advanced real-time computations such as synthetic aperture imaging. The system is built using fieldprogrammable gate...

Real-time 3-dimensional contrast-enhanced ultrasound in detecting hemorrhage of blunt renal trauma.

Science.gov (United States)

Xu, Rui-Xue; Li, Ye-Kuo; Li, Ting; Wang, Sha-Sha; Yuan, Gui-Zhong; Zhou, Qun-Fang; Zheng, Hai-Rong; Yan, Fei

2013-10-01

The objective of this study is to evaluate the diagnostic value of real-time 3-dimensional contrast-enhanced ultrasound in the hemorrhage of blunt renal trauma. Eighteen healthy New Zealand white rabbits were randomly divided into 3 groups. Blunt renal trauma was performed on each group by using minitype striker. Ultrasonography, color Doppler flow imaging, and contrast-enhanced 2-dimensional and real-time 3-dimensional ultrasound were applied before and after the strike. The time to shock and blood pressure were subjected to statistical analysis. Then, a comparative study of ultrasound and pathology was carried out. All the struck kidneys were traumatic. In the ultrasonography, free fluid was found under the renal capsule. In the color Doppler flow imaging, active hemorrhage was not identified. In 2-dimensional contrast-enhanced ultrasound, active hemorrhage of the damaged kidney was characterized. Real-time 3-dimensional contrast-enhanced ultrasound showed a real-time and stereoscopic ongoing bleeding of the injured kidney. The wider the hemorrhage area in 4-dimensional contrast-enhanced ultrasound was, the faster the blood pressure decreased. Real-time 3-dimensional contrast-enhanced ultrasound is a promising noninvasive tool for stereoscopically and vividly detecting ongoing hemorrhage of blunt renal trauma in real time. © 2013.

Application of the Real-Time Time-Dependent Density Functional Theory to Excited-State Dynamics of Molecules and 2D Materials

Science.gov (United States)

Miyamoto, Yoshiyuki; Rubio, Angel

2018-04-01

We review our recent developments in the ab initio simulation of excited-state dynamics within the framework of time-dependent density functional theory (TDDFT). Our targets range from molecules to 2D materials, although the methods are general and can be applied to any other finite and periodic systems. We discuss examples of excited-state dynamics obtained by real-time TDDFT coupled with molecular dynamics (MD) and the Ehrenfest approximation, including photoisomerization in molecules, photoenhancement of the weak interatomic attraction of noble gas atoms, photoenhancement of the weak interlayer interaction of 2D materials, pulse-laser-induced local bond breaking of adsorbed atoms on 2D sheets, modulation of UV light intensity by graphene nanoribbons at terahertz frequencies, and collision of high-speed ions with the 2D material to simulate the images taken by He ion microscopy. We illustrate how the real-time TDDFT approach is useful for predicting and understanding non-equilibrium dynamics in condensed matter. We also discuss recent developments that address the excited-state dynamics of systems out of equilibrium and future challenges in this fascinating field of research.

3D direct writing fabrication of electrodes for electrochemical storage devices

Science.gov (United States)

Wei, Min; Zhang, Feng; Wang, Wei; Alexandridis, Paschalis; Zhou, Chi; Wu, Gang

2017-06-01

Among different printing techniques, direct ink writing is commonly used to fabricate 3D battery and supercapacitor electrodes. The major advantages of using the direct ink writing include effectively building 3D structure for energy storage devices and providing higher power density and higher energy density than traditional techniques due to the increased surface area of electrode. Nevertheless, direct ink writing has high standards for the printing inks, which requires high viscosity, high yield stress under shear and compression, and well-controlled viscoelasticity. Recently, a number of 3D-printed energy storage devices have been reported, and it is very important to understand the printing process and the ink preparation process for further material design and technology development. We discussed current progress of direct ink writing technologies by using various electrode materials including carbon nanotube-based material, graphene-based material, LTO (Li4Ti5O12), LFP (LiFePO4), LiMn1-xFexPO4, and Zn-based metallic oxide. Based on achieve electrochemical performance, these 3D-printed devices deliver performance comparable to the energy storage device fabricated using traditional methods still leaving large room for further improvement. Finally, perspectives are provided on the potential future direction of 3D printing for all solid-state electrochemical energy storage devices.

Real-time decreased sensitivity to an audio-visual illusion during goal-directed reaching.

Directory of Open Access Journals (Sweden)

Luc Tremblay

Full Text Available In humans, sensory afferences are combined and integrated by the central nervous system (Ernst MO, Bülthoff HH (2004 Trends Cogn. Sci. 8: 162-169 and appear to provide a holistic representation of the environment. Empirical studies have repeatedly shown that vision dominates the other senses, especially for tasks with spatial demands. In contrast, it has also been observed that sound can strongly alter the perception of visual events. For example, when presented with 2 flashes and 1 beep in a very brief period of time, humans often report seeing 1 flash (i.e. fusion illusion, Andersen TS, Tiippana K, Sams M (2004 Brain Res. Cogn. Brain Res. 21: 301-308. However, it is not known how an unfolding movement modulates the contribution of vision to perception. Here, we used the audio-visual illusion to demonstrate that goal-directed movements can alter visual information processing in real-time. Specifically, the fusion illusion was linearly reduced as a function of limb velocity. These results suggest that cue combination and integration can be modulated in real-time by goal-directed behaviors; perhaps through sensory gating (Chapman CE, Beauchamp E (2006 J. Neurophysiol. 96: 1664-1675 and/or altered sensory noise (Ernst MO, Bülthoff HH (2004 Trends Cogn. Sci. 8: 162-169 during limb movements.

Rapid process development of chromatographic process using direct analysis in real time mass spectrometry as a process analytical technology tool.

Science.gov (United States)

Yan, Binjun; Chen, Teng; Xu, Zhilin; Qu, Haibin

2014-06-01

The concept of quality by design (QbD) is widely applied in the process development of pharmaceuticals. However, the additional cost and time have caused some resistance about QbD implementation. To show a possible solution, this work proposed a rapid process development method, which used direct analysis in real time mass spectrometry (DART-MS) as a process analytical technology (PAT) tool for studying the chromatographic process of Ginkgo biloba L., as an example. The breakthrough curves were fast determined by DART-MS at-line. A high correlation coefficient of 0.9520 was found between the concentrations of ginkgolide A determined by DART-MS and HPLC. Based on the PAT tool, the impacts of process parameters on the adsorption capacity were discovered rapidly, which showed a decreased adsorption capacity with the increase of the flow rate. This work has shown the feasibility and advantages of integrating PAT into QbD implementation for rapid process development. Copyright © 2014 Elsevier B.V. All rights reserved.

Accelerating volumetric cine MRI (VC-MRI) using undersampling for real-time 3D target localization/tracking in radiation therapy: a feasibility study

Science.gov (United States)

Harris, Wendy; Yin, Fang-Fang; Wang, Chunhao; Zhang, You; Cai, Jing; Ren, Lei

2018-01-01

Purpose. To accelerate volumetric cine MRI (VC-MRI) using undersampled 2D-cine MRI to provide real-time 3D guidance for gating/target tracking in radiotherapy. Methods. 4D-MRI is acquired during patient simulation. One phase of the prior 4D-MRI is selected as the prior images, designated as MRIprior. The on-board VC-MRI at each time-step is considered a deformation of the MRIprior. The deformation field map is represented as a linear combination of the motion components extracted by principal component analysis from the prior 4D-MRI. The weighting coefficients of the motion components are solved by matching the corresponding 2D-slice of the VC-MRI with the on-board undersampled 2D-cine MRI acquired. Undersampled Cartesian and radial k-space acquisition strategies were investigated. The effects of k-space sampling percentage (SP) and distribution, tumor sizes and noise on the VC-MRI estimation were studied. The VC-MRI estimation was evaluated using XCAT simulation of lung cancer patients and data from liver cancer patients. Volume percent difference (VPD) and Center of Mass Shift (COMS) of the tumor volumes and tumor tracking errors were calculated. Results. For XCAT, VPD/COMS were 11.93  ±  2.37%/0.90  ±  0.27 mm and 11.53  ±  1.47%/0.85  ±  0.20 mm among all scenarios with Cartesian sampling (SP  =  10%) and radial sampling (21 spokes, SP  =  5.2%), respectively. When tumor size decreased, higher sampling rate achieved more accurate VC-MRI than lower sampling rate. VC-MRI was robust against noise levels up to SNR  =  20. For patient data, the tumor tracking errors in superior-inferior, anterior-posterior and lateral (LAT) directions were 0.46  ±  0.20 mm, 0.56  ±  0.17 mm and 0.23  ±  0.16 mm, respectively, for Cartesian-based sampling with SP  =  20% and 0.60  ±  0.19 mm, 0.56  ±  0.22 mm and 0.42  ±  0.15 mm, respectively, for

Management of three-dimensional intrafraction motion through real-time DMLC tracking

International Nuclear Information System (INIS)

Sawant, Amit; Venkat, Raghu; Srivastava, Vikram; Carlson, David; Povzner, Sergey; Cattell, Herb; Keall, Paul

2008-01-01

Tumor tracking using a dynamic multileaf collimator (DMLC) represents a promising approach for intrafraction motion management in thoracic and abdominal cancer radiotherapy. In this work, we develop, empirically demonstrate, and characterize a novel 3D tracking algorithm for real-time, conformal, intensity modulated radiotherapy (IMRT) and volumetric modulated arc therapy (VMAT)-based radiation delivery to targets moving in three dimensions. The algorithm obtains real-time information of target location from an independent position monitoring system and dynamically calculates MLC leaf positions to account for changes in target position. Initial studies were performed to evaluate the geometric accuracy of DMLC tracking of 3D target motion. In addition, dosimetric studies were performed on a clinical linac to evaluate the impact of real-time DMLC tracking for conformal, step-and-shoot (S-IMRT), dynamic (D-IMRT), and VMAT deliveries to a moving target. The efficiency of conformal and IMRT delivery in the presence of tracking was determined. Results show that submillimeter geometric accuracy in all three dimensions is achievable with DMLC tracking. Significant dosimetric improvements were observed in the presence of tracking for conformal and IMRT deliveries to moving targets. A gamma index evaluation with a 3%-3 mm criterion showed that deliveries without DMLC tracking exhibit between 1.7 (S-IMRT) and 4.8 (D-IMRT) times more dose points that fail the evaluation compared to corresponding deliveries with tracking. The efficiency of IMRT delivery, as measured in the lab, was observed to be significantly lower in case of tracking target motion perpendicular to MLC leaf travel compared to motion parallel to leaf travel. Nevertheless, these early results indicate that accurate, real-time DMLC tracking of 3D tumor motion is feasible and can potentially result in significant geometric and dosimetric advantages leading to more effective management of intrafraction motion

Fast analysis of glycosides based on HKUST-1-coated monolith solid-phase microextraction and direct analysis in real-time mass spectrometry.

Science.gov (United States)

Li, Xianjiang; Wang, Xin; Ma, Wen; Ai, Wanpeng; Bai, Yu; Ding, Li; Liu, Huwei

2017-04-01

Glycosides are a kind of highly important natural aromatic precursors in tobacco leaves. In this study, a novel HKUST-1-coated monolith dip-it sampler was designed for the fast and sensitive analysis of trace glycosides using direct analysis in real-time mass spectrometry. This device was prepared in two steps: in situ polymerization of monolith in a glass capillary of dip-it and layer-by-layer growth of HKUST-1 on the surface of monolith. Sufficient extraction was realized by immersing the tip to solution and in situ desorption was carried out by plasma direct analysis in real time. Compared with traditional solid-phase microextraction protocols, sample desorption was not needed anymore, and only extraction conditions were needed to be optimized in this method, including the gas temperature of direct analysis in real time, extraction time, and CH 3 COONH 4 additive concentration. This method enabled the simultaneous detection of six kinds of glycosides with the limits of detection of 0.02-0.05 μg/mL and the linear ranges covering two orders of magnitude with the limits of quantitation of 0.05-0.1 μg/mL. Moreover, the developed method was applied for the glycosides analysis of three tobacco samples, which only took about 2 s for every sample. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Direct fourier methods in 3D-reconstruction from cone-beam data

International Nuclear Information System (INIS)

Axelsson, C.

1994-01-01

The problem of 3D-reconstruction is encountered in both medical and industrial applications of X-ray tomography. A method able to utilize a complete set of projections complying with Tuys condition was proposed by Grangeat. His method is mathematically exact and consists of two distinct phases. In phase 1 cone-beam projection data are used to produce the derivative of the radon transform. In phase 2, after interpolation, the radon transform data are used to reconstruct the three-dimensional object function. To a large extent our method is an extension of the Grangeat method. Our aim is to reduce the computational complexity, i.e. to produce a faster method. The most taxing procedure during phase 1 is computation of line-integrals in the detector plane. By applying the direct Fourier method in reverse for this computation, we reduce the complexity of phase 1 from O(N 4 ) to O(N 3 logN). Phase 2 can be performed either as a straight 3D-reconstruction or as a sequence of two 2D-reconstructions in vertical and horizontal planes, respectively. Direct Fourier methods can be applied for the 2D- and for the 3D-reconstruction, which reduces the complexity of phase 2 from O(N 4 ) to O(N 3 logN) as well. In both cases, linogram techniques are applied. For 3D-reconstruction the inversion formula contains the second derivative filter instead of the well-known ramp-filter employed in the 2D-case. The derivative filter is more well-behaved than the 2D ramp-filter. This implies that less zeropadding is necessary which brings about a further reduction of the computational efforts. The method has been verified by experiments on simulated data. The image quality is satisfactory and independent of cone-beam angles. For a 512 3 volume we estimate that our method is ten times faster than Grangeats method

Real-time ultrasound image classification for spine anesthesia using local directional Hadamard features.

Science.gov (United States)

Pesteie, Mehran; Abolmaesumi, Purang; Ashab, Hussam Al-Deen; Lessoway, Victoria A; Massey, Simon; Gunka, Vit; Rohling, Robert N

2015-06-01

Injection therapy is a commonly used solution for back pain management. This procedure typically involves percutaneous insertion of a needle between or around the vertebrae, to deliver anesthetics near nerve bundles. Most frequently, spinal injections are performed either blindly using palpation or under the guidance of fluoroscopy or computed tomography. Recently, due to the drawbacks of the ionizing radiation of such imaging modalities, there has been a growing interest in using ultrasound imaging as an alternative. However, the complex spinal anatomy with different wave-like structures, affected by speckle noise, makes the accurate identification of the appropriate injection plane difficult. The aim of this study was to propose an automated system that can identify the optimal plane for epidural steroid injections and facet joint injections. A multi-scale and multi-directional feature extraction system to provide automated identification of the appropriate plane is proposed. Local Hadamard coefficients are obtained using the sequency-ordered Hadamard transform at multiple scales. Directional features are extracted from local coefficients which correspond to different regions in the ultrasound images. An artificial neural network is trained based on the local directional Hadamard features for classification. The proposed method yields distinctive features for classification which successfully classified 1032 images out of 1090 for epidural steroid injection and 990 images out of 1052 for facet joint injection. In order to validate the proposed method, a leave-one-out cross-validation was performed. The average classification accuracy for leave-one-out validation was 94 % for epidural and 90 % for facet joint targets. Also, the feature extraction time for the proposed method was 20 ms for a native 2D ultrasound image. A real-time machine learning system based on the local directional Hadamard features extracted by the sequency-ordered Hadamard transform for

Image-guided radiotherapy in near real time with intensity-modulated radiotherapy megavoltage treatment beam imaging.

Science.gov (United States)

Mao, Weihua; Hsu, Annie; Riaz, Nadeem; Lee, Louis; Wiersma, Rodney; Luxton, Gary; King, Christopher; Xing, Lei; Solberg, Timothy

2009-10-01

To utilize image-guided radiotherapy (IGRT) in near real time by obtaining and evaluating the online positions of implanted fiducials from continuous electronic portal imaging device (EPID) imaging of prostate intensity-modulated radiotherapy (IMRT) delivery. Upon initial setup using two orthogonal images, the three-dimensional (3D) positions of all implanted fiducial markers are obtained, and their expected two-dimensional (2D) locations in the beam's-eye-view (BEV) projection are calculated for each treatment field. During IMRT beam delivery, EPID images of the megavoltage treatment beam are acquired in cine mode and subsequently analyzed to locate 2D locations of fiducials in the BEV. Simultaneously, 3D positions are estimated according to the current EPID image, information from the setup portal images, and images acquired at other gantry angles (the completed treatment fields). The measured 2D and 3D positions of each fiducial are compared with their expected 2D and 3D setup positions, respectively. Any displacements larger than a predefined tolerance may cause the treatment system to suspend the beam delivery and direct the therapists to reposition the patient. Phantom studies indicate that the accuracy of 2D BEV and 3D tracking are better than 1 mm and 1.4 mm, respectively. A total of 7330 images from prostate treatments were acquired and analyzed, showing a maximum 2D displacement of 6.7 mm and a maximum 3D displacement of 6.9 mm over 34 fractions. This EPID-based, real-time IGRT method can be implemented on any external beam machine with portal imaging capabilities without purchasing any additional equipment, and there is no extra dose delivered to the patient.

Real-time geometric scene estimation for RGBD images using a 3D box shape grammar

Science.gov (United States)

Willis, Andrew R.; Brink, Kevin M.

2016-06-01

This article describes a novel real-time algorithm for the purpose of extracting box-like structures from RGBD image data. In contrast to conventional approaches, the proposed algorithm includes two novel attributes: (1) it divides the geometric estimation procedure into subroutines having atomic incremental computational costs, and (2) it uses a generative "Block World" perceptual model that infers both concave and convex box elements from detection of primitive box substructures. The end result is an efficient geometry processing engine suitable for use in real-time embedded systems such as those on an UAVs where it is intended to be an integral component for robotic navigation and mapping applications.

Direct real-time neural evidence for task-set inertia.

Science.gov (United States)

Evans, Lisa H; Herron, Jane E; Wilding, Edward L

2015-03-01

One influential explanation for the costs incurred when switching between tasks is that they reflect interference arising from completing the previous task-known as task-set inertia. We report a novel approach for assessing task-set inertia in a memory experiment using event-related potentials (ERPs). After a study phase, participants completed a test block in which they switched between a memory task (retrieving information from the study phase) and a perceptual task. These tasks alternated every two trials. An ERP index of the retrieval of study information was evident in the memory task. It was also present on the first trial of the perceptual task but was markedly attenuated on the second. Moreover, this task-irrelevant ERP activity was positively correlated with a behavioral cost associated with switching between tasks. This real-time measure of neural activity thus provides direct evidence of task-set inertia, its duration, and the functional role it plays in switch costs. © The Author(s) 2015.

Geomagnetic Observatory Data for Real-Time Applications

Science.gov (United States)

Love, J. J.; Finn, C. A.; Rigler, E. J.; Kelbert, A.; Bedrosian, P.

2015-12-01

The global network of magnetic observatories represents a unique collective asset for the scientific community. Historically, magnetic observatories have supported global magnetic-field mapping projects and fundamental research of the Earth's interior and surrounding space environment. More recently, real-time data streams from magnetic observatories have become an important contributor to multi-sensor, operational monitoring of evolving space weather conditions, especially during magnetic storms. In this context, the U.S. Geological Survey (1) provides real-time observatory data to allied space weather monitoring projects, including those of NOAA, the U.S. Air Force, NASA, several international agencies, and private industry, (2) collaborates with Schlumberger to provide real-time geomagnetic data needed for directional drilling for oil and gas in Alaska, (3) develops products for real-time evaluation of hazards for the electric-power grid industry that are associated with the storm-time induction of geoelectric fields in the Earth's conducting lithosphere. In order to implement strategic priorities established by the USGS Natural Hazards Mission Area and the National Science and Technology Council, and with a focus on developing new real-time products, the USGS is (1) leveraging data management protocols already developed by the USGS Earthquake Program, (2) developing algorithms for mapping geomagnetic activity, a collaboration with NASA and NOAA, (3) supporting magnetotelluric surveys and developing Earth conductivity models, a collaboration with Oregon State University and the NSF's EarthScope Program, (4) studying the use of geomagnetic activity maps and Earth conductivity models for real-time estimation of geoelectric fields, (5) initiating geoelectric monitoring at several observatories, (6) validating real-time estimation algorithms against historical geomagnetic and geoelectric data. The success of these long-term projects is subject to funding constraints

A fast time-difference inverse solver for 3D EIT with application to lung imaging.

Science.gov (United States)

Javaherian, Ashkan; Soleimani, Manuchehr; Moeller, Knut

2016-08-01

A class of sparse optimization techniques that require solely matrix-vector products, rather than an explicit access to the forward matrix and its transpose, has been paid much attention in the recent decade for dealing with large-scale inverse problems. This study tailors application of the so-called Gradient Projection for Sparse Reconstruction (GPSR) to large-scale time-difference three-dimensional electrical impedance tomography (3D EIT). 3D EIT typically suffers from the need for a large number of voxels to cover the whole domain, so its application to real-time imaging, for example monitoring of lung function, remains scarce since the large number of degrees of freedom of the problem extremely increases storage space and reconstruction time. This study shows the great potential of the GPSR for large-size time-difference 3D EIT. Further studies are needed to improve its accuracy for imaging small-size anomalies.

The effect of background and illumination on color identification of real, 3D objects.

Science.gov (United States)

Allred, Sarah R; Olkkonen, Maria

2013-01-01

For the surface reflectance of an object to be a useful cue to object identity, judgments of its color should remain stable across changes in the object's environment. In 2D scenes, there is general consensus that color judgments are much more stable across illumination changes than background changes. Here we investigate whether these findings generalize to real 3D objects. Observers made color matches to cubes as we independently varied both the illumination impinging on the cube and the 3D background of the cube. As in 2D scenes, we found relatively high but imperfect stability of color judgments under an illuminant shift. In contrast to 2D scenes, we found that background had little effect on average color judgments. In addition, variability of color judgments was increased by an illuminant shift and decreased by embedding the cube within a background. Taken together, these results suggest that in real 3D scenes with ample cues to object segregation, the addition of a background may improve stability of color identification.

The effect of background and illumination on color identification of real, 3D objects

Directory of Open Access Journals (Sweden)

Sarah Ray Allred

2013-11-01

Full Text Available For the surface reflectance of an object to be a useful cue to object identity, judgments of its color should remain stable across changes in the object's environment. In 2D scenes, there is general consensus that color judgments are much more stable across illumination changes than background changes. Here we investigate whether these findings generalize to real 3D objects. Observers made color matches to cubes as we independently varied both the illumination impinging on the cube and the 3D background of the cube. As in 2D scenes, we found relatively high but imperfect stability of color judgments under an illuminant shift. In contrast to 2D scenes, we found that background had little effect on average color judgments. In addition, variability of color judgments was increased by an illuminant shift and decreased by embedding the cube within a background. Taken together, these results suggest that in real 3D scenes with ample cues to object segregation, the addition of a background may improve stability of color identification.

Upgrade of the COMPASS tokamak real-time control system

Czech Academy of Sciences Publication Activity Database

Janky, Filip; Havlíček, Josef; Batista, A.J.N.; Kudláček, Ondřej; Seidl, Jakub; Neto, A.C.; Pipek, Jan; Hron, Martin; Mikulín, Ondřej; Duarte, A.S.; Carvalho, B.B.; Stöckel, Jan; Pánek, Radomír

2014-01-01

Roč. 89, č. 3 (2014), s. 186-194 ISSN 0920-3796 R&D Projects: GA ČR GAP205/11/2470; GA MŠk 7G10072; GA MŠk(CZ) LM2011021 Institutional support: RVO:61389021 Keywords : Real-time * Feedback control * Real-time framework * MARTe * COMPASS tokamak Subject RIV: BL - Plasma and Gas Discharge Physics Impact factor: 1.152, year: 2014 http://www.sciencedirect.com/science/article/pii/S0920379613007564

An experimentally verified model for estimating the distance resolution capability of direct time of flight 3D optical imaging systems

International Nuclear Information System (INIS)

Nguyen, K Q K; Fisher, E M D; Walton, A J; Underwood, I

2013-01-01

This report introduces a new statistical model for time-resolved photon detection in a generic single-photon-sensitive sensor array. The model is validated by comparing modelled data with experimental data collected on a single-photon avalanche diode sensor array. Data produced by the model are used alongside corresponding experimental data to calculate, for the first time, the effective distance resolution of a pulsed direct time of flight 3D optical imaging system over a range of conditions using four peak-detection algorithms. The relative performance of the algorithms is compared. The model can be used to improve the system design process and inform selection of the optimal peak-detection algorithm. (paper)

Real Time Structured Light and Applications

DEFF Research Database (Denmark)

Wilm, Jakob

Structured light scanning is a versatile method for 3D shape acquisition. While much faster than most competing measurement techniques, most high-end structured light scans still take in the order of seconds to complete. Low-cost sensors such as Microsoft Kinect and time of flight cameras have made......, increased processing power, and methods presented in this thesis, it is possible to perform structured light scans in real time with 20 depth measurements per second. This offers new opportunities for studying dynamic scenes, quality control, human-computer interaction and more. This thesis discusses...... several aspects of real time structured light systems and presents contributions within calibration, scene coding and motion correction aspects. The problem of reliable and fast calibration of such systems is addressed with a novel calibration scheme utilising radial basis functions [Contribution B...

YouDash3D: exploring stereoscopic 3D gaming for 3D movie theaters

Science.gov (United States)

Schild, Jonas; Seele, Sven; Masuch, Maic

2012-03-01

Along with the success of the digitally revived stereoscopic cinema, events beyond 3D movies become attractive for movie theater operators, i.e. interactive 3D games. In this paper, we present a case that explores possible challenges and solutions for interactive 3D games to be played by a movie theater audience. We analyze the setting and showcase current issues related to lighting and interaction. Our second focus is to provide gameplay mechanics that make special use of stereoscopy, especially depth-based game design. Based on these results, we present YouDash3D, a game prototype that explores public stereoscopic gameplay in a reduced kiosk setup. It features live 3D HD video stream of a professional stereo camera rig rendered in a real-time game scene. We use the effect to place the stereoscopic effigies of players into the digital game. The game showcases how stereoscopic vision can provide for a novel depth-based game mechanic. Projected trigger zones and distributed clusters of the audience video allow for easy adaptation to larger audiences and 3D movie theater gaming.

Visualisasi Hasil Mesin Uji Tarik Gotech GT-7010-D2E dalam Bentuk Grafik secara Real Time

Directory of Open Access Journals (Sweden)

Anggoro Suryo Pramudyo

2014-03-01

Full Text Available Gotech GT-7010-D2E is a tensile testing machine used in Metallurgical Engineering Laboratory UNTIRTA. The machine are used both for practical and Materials Engineering specimen testing demanded by several industries. The machine can perform tensile tests well, but for the analysis is done manually, so it requires a lot of time and accuracy of the analysis results are not very accurate. Therefore, it’s needed a software that can analyze the results of the tensile test in the form of graphs in real time. Software visualization is created using Visual Basic 6.0 and data from tensile testing machine is stored using Microsoft Access database. The software is designed to record any characters that appear in the LCD on the control panel of a tensile testing machine and then process them to be a graphic. Based on the results of the implementation of the specimen plate and wire observations prove that the difference between the use of visualization software is more accurate and effective in their use of time, compared to manual observation that requires further analysis of the test results. In software visualization results of tensile test, the mechanical properties can be analyzed directly from the test results and graphs of data obtained in real time.

A Smartphone Interface for a Wireless EEG Headset with Real-Time 3D Reconstruction

DEFF Research Database (Denmark)

Stopczynski, Arkadiusz; Larsen, Jakob Eg; Stahlhut, Carsten

2011-01-01

We demonstrate a fully functional handheld brain scanner consisting of a low-cost 14-channel EEG headset with a wireless connec- tion to a smartphone, enabling minimally invasive EEG monitoring in naturalistic settings. The smartphone provides a touch-based interface with real-time brain state...

3D Markov Process for Traffic Flow Prediction in Real-Time

Directory of Open Access Journals (Sweden)

Eunjeong Ko

2016-01-01

Full Text Available Recently, the correct estimation of traffic flow has begun to be considered an essential component in intelligent transportation systems. In this paper, a new statistical method to predict traffic flows using time series analyses and geometric correlations is proposed. The novelty of the proposed method is two-fold: (1 a 3D heat map is designed to describe the traffic conditions between roads, which can effectively represent the correlations between spatially- and temporally-adjacent traffic states; and (2 the relationship between the adjacent roads on the spatiotemporal domain is represented by cliques in MRF and the clique parameters are obtained by example-based learning. In order to assess the validity of the proposed method, it is tested using data from expressway traffic that are provided by the Korean Expressway Corporation, and the performance of the proposed method is compared with existing approaches. The results demonstrate that the proposed method can predict traffic conditions with an accuracy of 85%, and this accuracy can be improved further.

Towards real-time regional earthquake simulation I: real-time moment tensor monitoring (RMT) for regional events in Taiwan

Science.gov (United States)

Lee, Shiann-Jong; Liang, Wen-Tzong; Cheng, Hui-Wen; Tu, Feng-Shan; Ma, Kuo-Fong; Tsuruoka, Hiroshi; Kawakatsu, Hitoshi; Huang, Bor-Shouh; Liu, Chun-Chi

2014-01-01

We have developed a real-time moment tensor monitoring system (RMT) which takes advantage of a grid-based moment tensor inversion technique and real-time broad-band seismic recordings to automatically monitor earthquake activities in the vicinity of Taiwan. The centroid moment tensor (CMT) inversion technique and a grid search scheme are applied to obtain the information of earthquake source parameters, including the event origin time, hypocentral location, moment magnitude and focal mechanism. All of these source parameters can be determined simultaneously within 117 s after the occurrence of an earthquake. The monitoring area involves the entire Taiwan Island and the offshore region, which covers the area of 119.3°E to 123.0°E and 21.0°N to 26.0°N, with a depth from 6 to 136 km. A 3-D grid system is implemented in the monitoring area with a uniform horizontal interval of 0.1° and a vertical interval of 10 km. The inversion procedure is based on a 1-D Green's function database calculated by the frequency-wavenumber (fk) method. We compare our results with the Central Weather Bureau (CWB) catalogue data for earthquakes occurred between 2010 and 2012. The average differences between event origin time and hypocentral location are less than 2 s and 10 km, respectively. The focal mechanisms determined by RMT are also comparable with the Broadband Array in Taiwan for Seismology (BATS) CMT solutions. These results indicate that the RMT system is realizable and efficient to monitor local seismic activities. In addition, the time needed to obtain all the point source parameters is reduced substantially compared to routine earthquake reports. By connecting RMT with a real-time online earthquake simulation (ROS) system, all the source parameters will be forwarded to the ROS to make the real-time earthquake simulation feasible. The RMT has operated offline (2010-2011) and online (since January 2012 to present) at the Institute of Earth Sciences (IES), Academia Sinica

SU-G-JeP2-04: Comparison Between Fricke-Type 3D Radiochromic Dosimeters for Real-Time Dose Distribution Measurements in MR-Guided Radiation Therapy

International Nuclear Information System (INIS)

Lee, H; Alqathami, M; Wang, J; Ibbott, G; Kadbi, M; Blencowe, A

2016-01-01

Purpose: To assess MR signal contrast for different ferrous ion compounds used in Fricke-type gel dosimeters for real-time dose measurements for MR-guided radiation therapy applications. Methods: Fricke-type gel dosimeters were prepared in 4% w/w gelatin prior to irradiation in an integrated 1.5 T MRI and 7 MV linear accelerator system (MR-Linac). 4 different ferrous ion (Fe2?) compounds (referred to as A, B, C, and D) were investigated for this study. Dosimeter D consisted of ferrous ammonium sulfate (FAS), which is conventionally used for Fricke dosimeters. Approximately half of each cylindrical dosimeter (45 mm diameter, 80 mm length) was irradiated to ∼17 Gy. MR imaging during irradiation was performed with the MR-Linac using a balanced-FFE sequence of TR/TE = 5/2.4 ms. An approximate uncertainty of 5% in our dose delivery was anticipated since the MR-Linac had not yet been fully commissioned. Results: The signal intensities (SI) increased between the un-irradiated and irradiated regions by approximately 8.6%, 4.4%, 3.2%, and 4.3% after delivery of ∼2.8 Gy for dosimeters A, B, C, and D, respectively. After delivery of ∼17 Gy, the SI had increased by 24.4%, 21.0%, 3.1%, and 22.2% compared to the un-irradiated regions. The increase in SI with respect to dose was linear for dosimeters A, B, and D with slopes of 0.0164, 0.0251, and 0.0236 Gy"−"1 (R"2 = 0.92, 0.97, and 0.96), respectively. Visually, dosimeter A had the greatest optical contrast from yellow to purple in the irradiated region. Conclusion: This study demonstrated the feasibility of using Fricke-type dosimeters for real-time dose measurements with the greatest optical and MR contrast for dosimeter A. We also demonstrated the need to investigate Fe"2"+ compounds beyond the conventionally utilized FAS compound in order to improve the MR signal contrast in 3D dosimeters used for MR-guided radiation therapy. This material is based upon work supported by the National Science Foundation Graduate

SU-G-JeP2-04: Comparison Between Fricke-Type 3D Radiochromic Dosimeters for Real-Time Dose Distribution Measurements in MR-Guided Radiation Therapy

Energy Technology Data Exchange (ETDEWEB)

Lee, H; Alqathami, M; Wang, J; Ibbott, G [UT MD Anderson Cancer Center, Houston, TX (United States); Kadbi, M [MR Therapy, Philips healthTech, Cleveland, OH (United States); Blencowe, A [The University of South Australia, South Australia, SA (Australia)

2016-06-15

Purpose: To assess MR signal contrast for different ferrous ion compounds used in Fricke-type gel dosimeters for real-time dose measurements for MR-guided radiation therapy applications. Methods: Fricke-type gel dosimeters were prepared in 4% w/w gelatin prior to irradiation in an integrated 1.5 T MRI and 7 MV linear accelerator system (MR-Linac). 4 different ferrous ion (Fe2?) compounds (referred to as A, B, C, and D) were investigated for this study. Dosimeter D consisted of ferrous ammonium sulfate (FAS), which is conventionally used for Fricke dosimeters. Approximately half of each cylindrical dosimeter (45 mm diameter, 80 mm length) was irradiated to ∼17 Gy. MR imaging during irradiation was performed with the MR-Linac using a balanced-FFE sequence of TR/TE = 5/2.4 ms. An approximate uncertainty of 5% in our dose delivery was anticipated since the MR-Linac had not yet been fully commissioned. Results: The signal intensities (SI) increased between the un-irradiated and irradiated regions by approximately 8.6%, 4.4%, 3.2%, and 4.3% after delivery of ∼2.8 Gy for dosimeters A, B, C, and D, respectively. After delivery of ∼17 Gy, the SI had increased by 24.4%, 21.0%, 3.1%, and 22.2% compared to the un-irradiated regions. The increase in SI with respect to dose was linear for dosimeters A, B, and D with slopes of 0.0164, 0.0251, and 0.0236 Gy{sup −1} (R{sup 2} = 0.92, 0.97, and 0.96), respectively. Visually, dosimeter A had the greatest optical contrast from yellow to purple in the irradiated region. Conclusion: This study demonstrated the feasibility of using Fricke-type dosimeters for real-time dose measurements with the greatest optical and MR contrast for dosimeter A. We also demonstrated the need to investigate Fe{sup 2+} compounds beyond the conventionally utilized FAS compound in order to improve the MR signal contrast in 3D dosimeters used for MR-guided radiation therapy. This material is based upon work supported by the National Science Foundation

Self-Regulation of the Primary Auditory Cortex Attention Via Directed Attention Mediated By Real Time fMRI Neurofeedback

Science.gov (United States)

2017-05-05

NELSON FROM: 59 MDW /SGYU SUBJECT: Professional Presentation Approval 1. Your paper, entitled Self - regulation of the Primary Auditory Cortex Attention via...DATE Sherwood - p.1 Self - regulation of the primary auditory cortex attention via directed attention mediated by real-time fMRI neurofeedback M S...auditory cortex hyperactivity by self - regulation of the primary auditory cortex (A 1) based on real-time functional magnetic resonance imaging neurofeedback

Real-Time Tropospheric Product Establishment and Accuracy Assessment in China

Science.gov (United States)

Chen, M.; Guo, J.; Wu, J.; Song, W.; Zhang, D.

2018-04-01

Tropospheric delay has always been an important issue in Global Navigation Satellite System (GNSS) processing. Empirical tropospheric delay models are difficult to simulate complex and volatile atmospheric environments, resulting in poor accuracy of the empirical model and difficulty in meeting precise positioning demand. In recent years, some scholars proposed to establish real-time tropospheric product by using real-time or near-real-time GNSS observations in a small region, and achieved some good results. This paper uses real-time observing data of 210 Chinese national GNSS reference stations to estimate the tropospheric delay, and establishes ZWD grid model in the country wide. In order to analyze the influence of tropospheric grid product on wide-area real-time PPP, this paper compares the method of taking ZWD grid product as a constraint with the model correction method. The results show that the ZWD grid product estimated based on the national reference stations can improve PPP accuracy and convergence speed. The accuracy in the north (N), east (E) and up (U) direction increase by 31.8 %,15.6 % and 38.3 %, respectively. As with the convergence speed, the accuracy of U direction experiences the most improvement.

De toekomst van Real Time Intelligence

NARCIS (Netherlands)

Broek, J. van den; Berg, C.H. van den

2013-01-01

Al direct vanaf de start van de Nationale Politie is gewerkt aan het opzetten van tien real-time intelligence centra in Nederland. Van daaruit worden 24 uur per dag en zeven dagen in de week agenten op straat actief ondersteund met real-time informatie bij de melding waar ze op af gaan. In de visie

Experimental Investigations of 3-D-/4-D-CAP Modulation With Directly Modulated VCSELs

DEFF Research Database (Denmark)

Binti Othman, Maisara; Zhang, Xu; Deng, Lei

2012-01-01

correction limit of 2.8 × 10-3 for error-free reception is achieved after 20 km of SSMF transmission. Spectral efficiencies of 2.68 and 2.08 b/s/Hz are reported for 3-D-CAP and 4-D-CAP, respectively. We believe that multidimensional modulation formats represent an attractive solution for providing more......In this letter, we present experimental investigations of multidimensional multilevel carrierless amplitude phase (CAP) modulation with directly modulated vertical cavity surface-emitting lasers. The signals are transmitted over 20 km of standard single-mode fiber (SSMF). For multilevel 3-D...

Streaming video-based 3D reconstruction method compatible with existing monoscopic and stereoscopic endoscopy systems

Science.gov (United States)

Bouma, Henri; van der Mark, Wannes; Eendebak, Pieter T.; Landsmeer, Sander H.; van Eekeren, Adam W. M.; ter Haar, Frank B.; Wieringa, F. Pieter; van Basten, Jean-Paul

2012-06-01

Compared to open surgery, minimal invasive surgery offers reduced trauma and faster recovery. However, lack of direct view limits space perception. Stereo-endoscopy improves depth perception, but is still restricted to the direct endoscopic field-of-view. We describe a novel technology that reconstructs 3D-panoramas from endoscopic video streams providing a much wider cumulative overview. The method is compatible with any endoscope. We demonstrate that it is possible to generate photorealistic 3D-environments from mono- and stereoscopic endoscopy. The resulting 3D-reconstructions can be directly applied in simulators and e-learning. Extended to real-time processing, the method looks promising for telesurgery or other remote vision-guided tasks.

The Analysis of Task and Data Characteristic and the Collaborative Processing Method in Real-Time Visualization Pipeline of Urban 3DGIS

Directory of Open Access Journals (Sweden)

Dongbo Zhou

2017-03-01

Full Text Available Parallel processing in the real-time visualization of three-dimensional Geographic Information Systems (3DGIS has tended to concentrate on algorithm levels in recent years, and most of the existing methods employ multiple threads in a Central Processing Unit (CPU or kernel in a Graphics Processing Unit (GPU to improve efficiency in the computation of the Level of Details (LODs for three-dimensional (3D Models and in the display of Digital Elevation Models (DEMs and Digital Orthphoto Maps (DOMs. The systematic analysis of the task and data characteristics of parallelism in the real-time visualization of 3DGIS continues to fall behind the development of hardware. In this paper, the basic procedures of real-time visualization of urban 3DGIS are first reviewed, and then the real-time visualization pipeline is analyzed. Further, the pipeline is decomposed into different task stages based on the task order and the input-output dependency. Based on the analysis of task parallelism in different pipeline stages, the data parallelism characteristics in each task are summarized by studying the involved algorithms. Finally, this paper proposes a parallel co-processing mode and a collaborative strategy for real-time visualization of urban 3DGIS. It also provides a fundamental basis for developing parallel algorithms and strategies in 3DGIS.

A comparison of EGFR mutation testing methods in lung carcinoma: direct sequencing, real-time PCR and immunohistochemistry.

Directory of Open Access Journals (Sweden)

Bárbara Angulo

Full Text Available The objective of this study is to compare two EGFR testing methodologies (a commercial real-time PCR kit and a specific EGFR mutant immunohistochemistry, with direct sequencing and to investigate the limit of detection (LOD of both PCR-based methods. We identified EGFR mutations in 21 (16% of the 136 tumours analyzed by direct sequencing. Interestingly, the Therascreen EGFR Mutation Test kit was able to characterize as wild-type one tumour that could not be analyzed by direct sequencing of the PCR product. We then compared the LOD of the kit and that of direct sequencing using the available mutant tumours. The kit was able to detect the presence of a mutation in a 1% dilution of the total DNA in nine of the 18 tumours (50%, which tested positive with the real-time quantitative PCR method. In all cases, EGFR mutation was identified at a dilution of 5%. Where the mutant DNA represented 30% of the total DNA, sequencing was able to detect mutations in 12 out of 19 cases (63%. Additional experiments with genetically defined standards (EGFR ΔE746-A750/+ and EGFR L858R/+ yielded similar results. Immunohistochemistry (IHC staining with exon 19-specific antibody was seen in eight out of nine cases with E746-A750del detected by direct sequencing. Neither of the two tumours with complex deletions were positive. Of the five L858R-mutated tumours detected by the PCR methods, only two were positive for the exon 21-specific antibody. The specificity was 100% for both antibodies. The LOD of the real-time PCR method was lower than that of direct sequencing. The mutation specific IHC produced excellent specificity.

PENGGUNAAN AUGMENTED REALITY UNTUK MENSIMULASIKAN DEKORASI RUANGAN SECARA REAL TIME

Directory of Open Access Journals (Sweden)

Ulva Erida Nur Rochmah

2016-12-01

Full Text Available Abstrak Mendekorasi ruangan merupakan kegiatan  yang memakan banyak waktu dan tenaga, terutama jika objek yang digunakan besar dan berat. Akan merepotkan jika seseorang harus menggeser setiap objek untuk menentukan letak yang sesuai. Hal ini dapat dihindari dengan menggunakan aplikasi berbasis Augmented Reality. Augmented Reality merupakan sebuah teknologi untuk menggabungkan dunia nyata dan dunia virtual dengan cara menampilkan objek-objek virtual di dunia nyata secara real time. Tujuan utama dari penelitian ini adalah untuk menciptakan suatu aplikasi Android dengan menggunakan Augmented Reality yang dapat digunakan untuk menggantikan objek nyata dengan objek virtual 3D sehingga memudahkan pengguna dalam mensimulasikan dekorasi ruangan. Aplikasi ini bekerja dengan cara memindai marker yang sudah dicetak pada selembar kertas. Jika marker telah terdeteksi, objek 3D berupa perabot akan ditampilkan di kamera aplikasi. Pengguna dapat memindah lokasi, memutar, dan mengubah ukuran objek untuk mensimulasikan tata letak ruangan. Hasil penelitian ini adalah aplikasi Android berbasis Augmented Reality yang dapat digunakan untuk mensimulasikan dekorasi ruangan secara real time. Kata Kunci: augmented reality, dekorasi, interior, marker Abstract Decorating the room is an activity that takes a lot of time and effort, especially if the object is large and heavy. It would be inconvenient if someone has to drag each object to determine the appropriate location. This problem can be avoided using an Augmented Reality-based application. Augmented reality is a technology that combine the real world and the virtual world by displaying virtual object in real world. The main purpose of this research is to create an Android application using Augmented reality  that can be used to replace the real object with virtual 3D object, making it easier for the user to simulate the decoration of the room. This application works by scanning the marker that has been printed on a

Image-Guided Radiotherapy in Near Real Time With Intensity-Modulated Radiotherapy Megavoltage Treatment Beam Imaging

International Nuclear Information System (INIS)

Mao Weihua; Hsu, Annie; Riaz, Nadeem; Lee, Louis; Wiersma, Rodney; Luxton, Gary; King, Christopher; Xing Lei; Solberg, Timothy

2009-01-01

Purpose: To utilize image-guided radiotherapy (IGRT) in near real time by obtaining and evaluating the online positions of implanted fiducials from continuous electronic portal imaging device (EPID) imaging of prostate intensity-modulated radiotherapy (IMRT) delivery. Methods and Materials: Upon initial setup using two orthogonal images, the three-dimensional (3D) positions of all implanted fiducial markers are obtained, and their expected two-dimensional (2D) locations in the beam's-eye-view (BEV) projection are calculated for each treatment field. During IMRT beam delivery, EPID images of the megavoltage treatment beam are acquired in cine mode and subsequently analyzed to locate 2D locations of fiducials in the BEV. Simultaneously, 3D positions are estimated according to the current EPID image, information from the setup portal images, and images acquired at other gantry angles (the completed treatment fields). The measured 2D and 3D positions of each fiducial are compared with their expected 2D and 3D setup positions, respectively. Any displacements larger than a predefined tolerance may cause the treatment system to suspend the beam delivery and direct the therapists to reposition the patient. Results: Phantom studies indicate that the accuracy of 2D BEV and 3D tracking are better than 1 mm and 1.4 mm, respectively. A total of 7330 images from prostate treatments were acquired and analyzed, showing a maximum 2D displacement of 6.7 mm and a maximum 3D displacement of 6.9 mm over 34 fractions. Conclusions: This EPID-based, real-time IGRT method can be implemented on any external beam machine with portal imaging capabilities without purchasing any additional equipment, and there is no extra dose delivered to the patient.

Annular dynamics of memo3D annuloplasty ring evaluated by 3D transesophageal echocardiography.

Science.gov (United States)

Nishi, Hiroyuki; Toda, Koichi; Miyagawa, Shigeru; Yoshikawa, Yasushi; Fukushima, Satsuki; Yoshioka, Daisuke; Sawa, Yoshiki

2018-04-01

We assessed the mitral annular motion after mitral valve repair with the Sorin Memo 3D® (Sorin Group Italia S.r.L., Saluggia, Italy), which is a unique complete semirigid annuloplasty ring intended to restore the systolic profile of the mitral annulus while adapting to the physiologic dynamism of the annulus, using transesophageal real-time three-dimensional echocardiography. 17 patients (12 male; mean age 60.4 ± 14.9 years) who underwent mitral annuloplasty using the Memo 3D ring were investigated. Mitral annular motion was assessed using QLAB®version8 allowing for a full evaluation of the mitral annulus dynamics. The mitral annular dimensions were measured throughout the cardiac cycle using 4D MV assessment2® while saddle shape was assessed through sequential measurements by RealView®. Saddle shape configuration of the mitral annulus and posterior and anterior leaflet motion could be observed during systole and diastole. The mitral annular area changed during the cardiac cycle by 5.7 ± 1.8%.The circumference length and diameter also changed throughout the cardiac cycle. The annular height was significantly higher in mid-systole than in mid-diastole (p 3D ring maintained a physiological saddle-shape configuration throughout the cardiac cycle. Real-time three-dimensional echocardiography analysis confirmed the motion and flexibility of the Memo 3D ring upon implantation.

Simultaneous detection of Acidovorax avenae subsp. citrulli and Didymella bryoniae in cucurbit seedlots using magnetic capture hybridization and real-time polymerase chain reaction.

Science.gov (United States)

Ha, Y; Fessehaie, A; Ling, K S; Wechter, W P; Keinath, A P; Walcott, R R

2009-06-01

To improve the simultaneous detection of two pathogens in cucurbit seed, a combination of magnetic capture hybridization (MCH) and multiplex real-time polymerase chain reaction (PCR) was developed. Single-stranded DNA hybridization capture probes targeting DNA of Acidovorax avenae subsp. citrulli, causal agent of bacterial fruit blotch, and Didymella bryoniae, causal agent of gummy stem blight, were covalently attached to magnetic particles and used to selectively concentrate template DNA from cucurbit seed samples. Sequestered template DNAs were subsequently amplified by multiplex real-time PCR using pathogen-specific TaqMan PCR assays. The MCH multiplex real-time PCR assay displayed a detection threshold of A. avenae subsp. citrulli at 10 CFU/ml and D. bryoniae at 10(5) conidia/ml in mixtures of pure cultures of the two pathogens, which was 10-fold more sensitive than the direct real-time PCR assays for the two pathogens separately. Although the direct real-time PCR assay displayed a detection threshold for A. avenae subsp. citrulli DNA of 100 fg/microl in 25% (1/4 samples) of the samples assayed, MCH real-time PCR demonstrated 100% detection frequency (4/4 samples) at the same DNA concentration. MCH did not improve detection sensitivity for D. bryoniae relative to direct real-time PCR using conidial suspensions or seed washes from D. bryoniae-infested cucurbit seed. However, MCH real-time PCR facilitated detection of both target pathogens in watermelon and melon seed samples (n = 5,000 seeds/sample) in which 0.02% of the seed were infested with A. avenae subsp. citrulli and 0.02% were infested with D. bryoniae.

Application of Real-Time 3D Navigation System in CT-Guided Percutaneous Interventional Procedures: A Feasibility Study

Directory of Open Access Journals (Sweden)

Priya Bhattacharji

2017-01-01

Full Text Available Introduction. To evaluate the accuracy of a quantitative 3D navigation system for CT-guided interventional procedures in a two-part study. Materials and Methods. Twenty-two procedures were performed in abdominal and thoracic phantoms. Accuracies of the 3D anatomy map registration and navigation were evaluated. Time used for the navigated procedures was recorded. In the IRB approved clinical evaluation, 21 patients scheduled for CT-guided thoracic and hepatic biopsy and ablations were recruited. CT-guided procedures were performed without following the 3D navigation display. Accuracy of navigation as well as workflow fitness of the system was evaluated. Results. In phantoms, the average 3D anatomy map registration error was 1.79 mm. The average navigated needle placement accuracy for one-pass and two-pass procedures, respectively, was 2.0±0.7 mm and 2.8±1.1 mm in the liver and 2.7±1.7 mm and 3.0±1.4 mm in the lung. The average accuracy of the 3D navigation system in human subjects was 4.6 mm ± 3.1 for all procedures. The system fits the existing workflow of CT-guided interventions with minimum impact. Conclusion. A 3D navigation system can be performed along the existing workflow and has the potential to navigate precision needle placement in CT-guided interventional procedures.

Hardware Algorithms For Tile-Based Real-Time Rendering

NARCIS (Netherlands)

Crisu, D.

2012-01-01

In this dissertation, we present the GRAphics AcceLerator (GRAAL) framework for developing embedded tile-based rasterization hardware for mobile devices, meant to accelerate real-time 3-D graphics (OpenGL compliant) applications. The goal of the framework is a low-cost, low-power, high-performance

Real-time visual tracking of less textured three-dimensional objects on mobile platforms

Science.gov (United States)

Seo, Byung-Kuk; Park, Jungsik; Park, Hanhoon; Park, Jong-Il

2012-12-01

Natural feature-based approaches are still challenging for mobile applications (e.g., mobile augmented reality), because they are feasible only in limited environments such as highly textured and planar scenes/objects, and they need powerful mobile hardware for fast and reliable tracking. In many cases where conventional approaches are not effective, three-dimensional (3-D) knowledge of target scenes would be beneficial. We present a well-established framework for real-time visual tracking of less textured 3-D objects on mobile platforms. Our framework is based on model-based tracking that efficiently exploits partially known 3-D scene knowledge such as object models and a background's distinctive geometric or photometric knowledge. Moreover, we elaborate on implementation in order to make it suitable for real-time vision processing on mobile hardware. The performance of the framework is tested and evaluated on recent commercially available smartphones, and its feasibility is shown by real-time demonstrations.

Automatic real time drilling support on Ekofisk utilizing eDrilling

Energy Technology Data Exchange (ETDEWEB)

Rommetveit, Rolv; Bjorkevoll, Knut S.; Halsey, George W.; Kluge, Roald; Molde, Dag Ove; Odegard, Sven Inge [SINTEF Petroleum Research, Trondheim (Norway); Herbert, Mike [HITEC Products Drilling, Stavanger (Norway); ConocoPhillips Norge, Stavanger (Norway)

2008-07-01

eDrilling is a new and innovative system for real time drilling simulation, 3D visualization and control from a remote drilling expert centre. The concept uses all available real time drilling data (surface and downhole) in combination with real time modelling to monitor and optimize the drilling process. This information is used to visualize the wellbore in 3D in real time. eDrilling has been implemented in an Onshore Drilling Center in Norway. The system is composed of the following elements, some of which are unique and ground-breaking: an advanced and fast Integrated Drilling Simulator which is capable to model the different drilling sub-processes dynamically, and also the interaction between these sub-processes in real time; automatic quality check and corrections of drilling data; making them suitable for processing by computer models; real time supervision methodology for the drilling process using time based drilling data as well as drilling models / the integrated drilling simulator; methodology for diagnosis of the drilling state and conditions. This is obtained from comparing model predictions with measured data. Advisory technology for more optimal drilling. A Virtual Wellbore, with advanced visualization of the downhole process. Dat low and computer infrastructure. e-Drilling has been implemented in an Onshore Drilling Center on Ekofisk in Norway. The system is being used on drilling operations, and experiences from its use are presented. The supervision and diagnosis functionalities have been useful in particular, as the system has given early warnings on ECD and friction related problems. This paper will present the eDrilling system as well as experiences from its use. (author)

GPU-based, parallel-line, omni-directional integration of measured acceleration field to obtain the 3D pressure distribution

Science.gov (United States)

Wang, Jin; Zhang, Cao; Katz, Joseph

2016-11-01

A PIV based method to reconstruct the volumetric pressure field by direct integration of the 3D material acceleration directions has been developed. Extending the 2D virtual-boundary omni-directional method (Omni2D, Liu & Katz, 2013), the new 3D parallel-line omni-directional method (Omni3D) integrates the material acceleration along parallel lines aligned in multiple directions. Their angles are set by a spherical virtual grid. The integration is parallelized on a Tesla K40c GPU, which reduced the computing time from three hours to one minute for a single realization. To validate its performance, this method is utilized to calculate the 3D pressure fields in isotropic turbulence and channel flow using the JHU DNS Databases (http://turbulence.pha.jhu.edu). Both integration of the DNS acceleration as well as acceleration from synthetic 3D particles are tested. Results are compared to other method, e.g. solution to the Pressure Poisson Equation (e.g. PPE, Ghaemi et al., 2012) with Bernoulli based Dirichlet boundary conditions, and the Omni2D method. The error in Omni3D prediction is uniformly low, and its sensitivity to acceleration errors is local. It agrees with the PPE/Bernoulli prediction away from the Dirichlet boundary. The Omni3D method is also applied to experimental data obtained using tomographic PIV, and results are correlated with deformation of a compliant wall. ONR.

A real-time dynamic-MLC control algorithm for delivering IMRT to targets undergoing 2D rigid motion in the beam's eye view

International Nuclear Information System (INIS)

McMahon, Ryan; Berbeco, Ross; Nishioka, Seiko; Ishikawa, Masayori; Papiez, Lech

2008-01-01

An MLC control algorithm for delivering intensity modulated radiation therapy (IMRT) to targets that are undergoing two-dimensional (2D) rigid motion in the beam's eye view (BEV) is presented. The goal of this method is to deliver 3D-derived fluence maps over a moving patient anatomy. Target motion measured prior to delivery is first used to design a set of planned dynamic-MLC (DMLC) sliding-window leaf trajectories. During actual delivery, the algorithm relies on real-time feedback to compensate for target motion that does not agree with the motion measured during planning. The methodology is based on an existing one-dimensional (1D) algorithm that uses on-the-fly intensity calculations to appropriately adjust the DMLC leaf trajectories in real-time during exposure delivery [McMahon et al., Med. Phys. 34, 3211-3223 (2007)]. To extend the 1D algorithm's application to 2D target motion, a real-time leaf-pair shifting mechanism has been developed. Target motion that is orthogonal to leaf travel is tracked by appropriately shifting the positions of all MLC leaves. The performance of the tracking algorithm was tested for a single beam of a fractionated IMRT treatment, using a clinically derived intensity profile and a 2D target trajectory based on measured patient data. Comparisons were made between 2D tracking, 1D tracking, and no tracking. The impact of the tracking lag time and the frequency of real-time imaging were investigated. A study of the dependence of the algorithm's performance on the level of agreement between the motion measured during planning and delivery was also included. Results demonstrated that tracking both components of the 2D motion (i.e., parallel and orthogonal to leaf travel) results in delivered fluence profiles that are superior to those that track the component of motion that is parallel to leaf travel alone. Tracking lag time effects may lead to relatively large intensity delivery errors compared to the other sources of error investigated

Establish and Evaluate Ada Runtime Features of Interest for Real-Time Systems

Science.gov (United States)

1989-02-15

Runtime Features of Interest for Real - Time Systems -,-. CLEARED POR :)E,4 pUEL tCATLON SEP 2 0 19E19 ,CETM ORP t ’R RE LOO O Nt-U~HM- ANDQ SECURITY...ESTABLISH AND EVALUATE py ADA RUNTIME FEATURES OF INTEREST FOR REAL - TIME SYSTEMS CONTRACT NUMBER: MDA 903-87-D-0056 IITRI PROJECT NUMBER: T06168 PREPARED...2 2.0 SELECTION PROCESS OVERVIEW .................................... 3 2.1 REAL - TIME SYSTEMS IDENTIFICATION ........................... 4 2.2

Real-Time MENTAT programming language and architecture

Science.gov (United States)

Grimshaw, Andrew S.; Silberman, Ami; Liu, Jane W. S.

1989-01-01

Real-time MENTAT, a programming environment designed to simplify the task of programming real-time applications in distributed and parallel environments, is described. It is based on the same data-driven computation model and object-oriented programming paradigm as MENTAT. It provides an easy-to-use mechanism to exploit parallelism, language constructs for the expression and enforcement of timing constraints, and run-time support for scheduling and exciting real-time programs. The real-time MENTAT programming language is an extended C++. The extensions are added to facilitate automatic detection of data flow and generation of data flow graphs, to express the timing constraints of individual granules of computation, and to provide scheduling directives for the runtime system. A high-level view of the real-time MENTAT system architecture and programming language constructs is provided.

Monitoring Distributed Real-Time Systems: A Survey and Future Directions

Science.gov (United States)

Goodloe, Alwyn E.; Pike, Lee

2010-01-01

Runtime monitors have been proposed as a means to increase the reliability of safety-critical systems. In particular, this report addresses runtime monitors for distributed hard real-time systems. This class of systems has had little attention from the monitoring community. The need for monitors is shown by discussing examples of avionic systems failure. We survey related work in the field of runtime monitoring. Several potential monitoring architectures for distributed real-time systems are presented along with a discussion of how they might be used to monitor properties of interest.

Real-time soft tissue motion estimation for lung tumors during radiotherapy delivery

International Nuclear Information System (INIS)

Rottmann, Joerg; Berbeco, Ross; Keall, Paul

2013-01-01

Purpose: To provide real-time lung tumor motion estimation during radiotherapy treatment delivery without the need for implanted fiducial markers or additional imaging dose to the patient.Methods: 2D radiographs from the therapy beam's-eye-view (BEV) perspective are captured at a frame rate of 12.8 Hz with a frame grabber allowing direct RAM access to the image buffer. An in-house developed real-time soft tissue localization algorithm is utilized to calculate soft tissue displacement from these images in real-time. The system is tested with a Varian TX linear accelerator and an AS-1000 amorphous silicon electronic portal imaging device operating at a resolution of 512 × 384 pixels. The accuracy of the motion estimation is verified with a dynamic motion phantom. Clinical accuracy was tested on lung SBRT images acquired at 2 fps.Results: Real-time lung tumor motion estimation from BEV images without fiducial markers is successfully demonstrated. For the phantom study, a mean tracking error <1.0 mm [root mean square (rms) error of 0.3 mm] was observed. The tracking rms accuracy on BEV images from a lung SBRT patient (≈20 mm tumor motion range) is 1.0 mm.Conclusions: The authors demonstrate for the first time real-time markerless lung tumor motion estimation from BEV images alone. The described system can operate at a frame rate of 12.8 Hz and does not require prior knowledge to establish traceable landmarks for tracking on the fly. The authors show that the geometric accuracy is similar to (or better than) previously published markerless algorithms not operating in real-time

Real-time soft tissue motion estimation for lung tumors during radiotherapy delivery

Energy Technology Data Exchange (ETDEWEB)

Rottmann, Joerg; Berbeco, Ross [Brigham and Women' s Hospital, Dana Farber-Cancer Institute and Harvard Medical School, Boston, Massachusetts 02115 (United States); Keall, Paul [Radiation Physics Laboratory, Sydney Medical School, University of Sydney, Sydney NSW 2006 (Australia)

2013-09-15

Purpose: To provide real-time lung tumor motion estimation during radiotherapy treatment delivery without the need for implanted fiducial markers or additional imaging dose to the patient.Methods: 2D radiographs from the therapy beam's-eye-view (BEV) perspective are captured at a frame rate of 12.8 Hz with a frame grabber allowing direct RAM access to the image buffer. An in-house developed real-time soft tissue localization algorithm is utilized to calculate soft tissue displacement from these images in real-time. The system is tested with a Varian TX linear accelerator and an AS-1000 amorphous silicon electronic portal imaging device operating at a resolution of 512 × 384 pixels. The accuracy of the motion estimation is verified with a dynamic motion phantom. Clinical accuracy was tested on lung SBRT images acquired at 2 fps.Results: Real-time lung tumor motion estimation from BEV images without fiducial markers is successfully demonstrated. For the phantom study, a mean tracking error <1.0 mm [root mean square (rms) error of 0.3 mm] was observed. The tracking rms accuracy on BEV images from a lung SBRT patient (≈20 mm tumor motion range) is 1.0 mm.Conclusions: The authors demonstrate for the first time real-time markerless lung tumor motion estimation from BEV images alone. The described system can operate at a frame rate of 12.8 Hz and does not require prior knowledge to establish traceable landmarks for tracking on the fly. The authors show that the geometric accuracy is similar to (or better than) previously published markerless algorithms not operating in real-time.

New technique for real-time distortion-invariant multiobject recognition and classification

Science.gov (United States)

Hong, Rutong; Li, Xiaoshun; Hong, En; Wang, Zuyi; Wei, Hongan

2001-04-01

A real-time hybrid distortion-invariant OPR system was established to make 3D multiobject distortion-invariant automatic pattern recognition. Wavelet transform technique was used to make digital preprocessing of the input scene, to depress the noisy background and enhance the recognized object. A three-layer backpropagation artificial neural network was used in correlation signal post-processing to perform multiobject distortion-invariant recognition and classification. The C-80 and NOA real-time processing ability and the multithread programming technology were used to perform high speed parallel multitask processing and speed up the post processing rate to ROIs. The reference filter library was constructed for the distortion version of 3D object model images based on the distortion parameter tolerance measuring as rotation, azimuth and scale. The real-time optical correlation recognition testing of this OPR system demonstrates that using the preprocessing, post- processing, the nonlinear algorithm os optimum filtering, RFL construction technique and the multithread programming technology, a high possibility of recognition and recognition rate ere obtained for the real-time multiobject distortion-invariant OPR system. The recognition reliability and rate was improved greatly. These techniques are very useful to automatic target recognition.

Real-time systems

OpenAIRE

Badr, Salah M.; Bruztman, Donald P.; Nelson, Michael L.; Byrnes, Ronald Benton

1992-01-01

This paper presents an introduction to the basic issues involved in real-time systems. Both real-time operating sys and real-time programming languages are explored. Concurrent programming and process synchronization and communication are also discussed. The real-time requirements of the Naval Postgraduate School Autonomous Under Vehicle (AUV) are then examined. Autonomous underwater vehicle (AUV), hard real-time system, real-time operating system, real-time programming language, real-time sy...

Direct atmospheric pressure chemical ionization-tandem mass spectrometry for the continuous real-time trace analysis of benzene, toluene, ethylbenzene, and xylenes in ambient air.

Science.gov (United States)

Badjagbo, Koffi; Picard, Pierre; Moore, Serge; Sauvé, Sébastien

2009-05-01

Real-time monitoring of benzene, toluene, ethylbenzene, and xylenes (BTEX) in ambient air is essential for the early warning detection associated with the release of these hazardous chemicals and in estimating the potential exposure risks to humans and the environment. We have developed a tandem mass spectrometry (MS/MS) method for continuous real-time determination of ambient trace levels of BTEX. The technique is based on the sampling of air via an atmospheric pressure inlet directly into the atmospheric pressure chemical ionization (APCI) source. The method is linear over four orders of magnitude, with correlation coefficients greater than 0.996. Low limits of detection in the range 1-2 microg/m(3) are achieved for BTEX. The reliability of the method was confirmed through the evaluation of quality parameters such as repeatability and reproducibility (relative standard deviation below 8% and 10%, respectively) and accuracy (over 95%). The applicability of this method to real-world samples was evaluated through measurements of BTEX levels in real ambient air samples and results were compared with a reference GC-FID method. This direct APCI-MS/MS method is suitable for real-time analysis of BTEX in ambient air during regulation surveys as well as for the monitoring of industrial processes or emergency situations.

An interactive display system for large-scale 3D models

Science.gov (United States)

Liu, Zijian; Sun, Kun; Tao, Wenbing; Liu, Liman

2018-04-01

With the improvement of 3D reconstruction theory and the rapid development of computer hardware technology, the reconstructed 3D models are enlarging in scale and increasing in complexity. Models with tens of thousands of 3D points or triangular meshes are common in practical applications. Due to storage and computing power limitation, it is difficult to achieve real-time display and interaction with large scale 3D models for some common 3D display software, such as MeshLab. In this paper, we propose a display system for large-scale 3D scene models. We construct the LOD (Levels of Detail) model of the reconstructed 3D scene in advance, and then use an out-of-core view-dependent multi-resolution rendering scheme to realize the real-time display of the large-scale 3D model. With the proposed method, our display system is able to render in real time while roaming in the reconstructed scene and 3D camera poses can also be displayed. Furthermore, the memory consumption can be significantly decreased via internal and external memory exchange mechanism, so that it is possible to display a large scale reconstructed scene with over millions of 3D points or triangular meshes in a regular PC with only 4GB RAM.

LHCb base-line level-0 trigger 3D-Flow implementation

International Nuclear Information System (INIS)

Crosetto, Dario B.

1999-01-01

The LHCb Level-0 trigger implementation with the 3D-Flow system offers full programmability, allowing it to adapt to unexpected operating conditions and enabling new, unpredicted physics. The implementation is described in detail and refers to components and technology available today. The 3D-Flow Processor system is a new, technology-independent concept in very fast, real-time system architectures. Based on the replication of a single type of circuit of 100k gates, which communicates in six directions: bi-directional with North, East, West, and South neighbors, unidirectional from Top to Bottom, the system offers full programmability, modularity, ease of expansion and adaptation to the latest technology. A complete study of its applicability to the LHCb calorimeter triggers is presented. Full description of the input data handling, either in digital or mixed digital-analog form, of the data processing, and the transmission of results to the global level-0 trigger decision unit are provided. Any level-0 trigger algorithm (2x2, 3x3, 4x4, etc.) with up to 20 steps, can be implemented with zero dead-time, while sustaining input data rate (up to 32-bit per input channel, per bunch crossing) at 40 MHz. For each step, each 3D-Flow processor can execute up to 26 operations, inclusive of compare, ranging, finding local maxima, and efficient data exchange with neighboring channels. (One-to-one correspondence between input channel and trigger tower.) Populated with only two main types of components, front-end FPGAs and 3D-Flow processors, a single type of board, it is shown how the whole Level-0 calorimeter trigger can be accommodated into six crates (9U), each containing 16 identical boards. All 3D-Flow inter-chip Bottom to Top ports connection are all contained on the board (data are multiplexed 2 : 1, PCB traces are shorter than 6 cm); all 3D-flow inter-chip North, East, West, and South ports connections, between boards and crates, are multiplexed (8+2) : 1 and are

Valuing and timing R and D using a real options pricing framework; including an application to the development of Lunar Helium-3 fusion

International Nuclear Information System (INIS)

Ott, S.H.

1992-01-01

This dissertation uses the real options framework to study the valuation and optimal investment policies for R and D projects. The models developed integrate and extend the literature by taking into account the unique characteristics of such projects including uncertain investment in R and D, time-to-build, and multiple investment opportunities. The models were developed to examine the optimal R and D investment policy for the Lunar Helium-3 fusion project but have general applicability. Models are development which model R and D investment as an information gathering process where R and D investment remaining changes as investment is expended. The value of the project increased as the variance of required investment increases. An extension of this model combines a stochastic benefit with stochastic investment. Both the value of the R and D project and the region prescribing continued investment increased. The policy implications are significant: When uncertainty of R and D investment is ignored, the value of the project is underestimated and a tendency toward underinvestment in R and D will result; the existence of uncertainty in R and D investment will cause R and D projects to experience larger declines in value before discontinuation of investment. The model combining stochastic investment with the stochastic benefit is applied to the Lunar Helium-3 fusion project. Investment in fusion should continue at the maximum level of $1 billion annually given current levels of costs of alternative fuels and the perceived uncertainty of R and D investment in the project. A model is developed to examine the valuation and optimal split of funding between R and D projects when there are two competing new technologies. Without interaction between research expenditures and benefits across technologies, the optimal investment strategy is to invest in one or the other technology or neither. The multiple technology model is applied to analyze competing R and D projects, namely

Time-resolved measurements with intense ultrashort laser pulses: a 'molecular movie' in real time

International Nuclear Information System (INIS)

Rudenko, A; Ergler, Th; Feuerstein, B; Zrost, K; Schroeter, C D; Moshammer, R; Ullrich, J

2007-01-01

We report on the high-resolution multidimensional real-time mapping of H 2 + and D 2 + nuclear wave packets performed employing time-resolved three-dimensional Coulomb explosion imaging with intense laser pulses. Exploiting a combination of a 'reaction microscope' spectrometer and a pump-probe setup with two intense 6-7 fs laser pulses, we simultaneously visualize both vibrational and rotational motion of the molecule, and obtain a sequence of snapshots of the squared ro-vibrational wave function with time-step resolution of ∼ 0.3 fs, allowing us to reconstruct a real-time movie of the ultrafast molecular motion. We observe fast dephasing, or 'collapse' of the vibrational wave packet and its subsequent revival, as well as signatures of rotational excitation. For D 2 + we resolve also the fractional revivals resulting from the interference between the counter-propagating parts of the wave packet

Fast segmentation of stained nuclei in terabyte-scale, time resolved 3D microscopy image stacks.

Directory of Open Access Journals (Sweden)

Johannes Stegmaier

Full Text Available Automated analysis of multi-dimensional microscopy images has become an integral part of modern research in life science. Most available algorithms that provide sufficient segmentation quality, however, are infeasible for a large amount of data due to their high complexity. In this contribution we present a fast parallelized segmentation method that is especially suited for the extraction of stained nuclei from microscopy images, e.g., of developing zebrafish embryos. The idea is to transform the input image based on gradient and normal directions in the proximity of detected seed points such that it can be handled by straightforward global thresholding like Otsu's method. We evaluate the quality of the obtained segmentation results on a set of real and simulated benchmark images in 2D and 3D and show the algorithm's superior performance compared to other state-of-the-art algorithms. We achieve an up to ten-fold decrease in processing times, allowing us to process large data sets while still providing reasonable segmentation results.

Real-time digital control, data acquisition, and analysis system for the DIII-D multipulse Thomson scattering diagnostic

International Nuclear Information System (INIS)

Greenfield, C.M.; Campbell, G.L.; Carlstrom, T.N.; DeBoo, J.C.; Hsieh, C.; Snider, R.T.; Trost, P.K.

1990-01-01

A VME-based real-time computer system for laser control, data acquisition, and analysis for the DIII-D multipulse Thomson scattering diagnostic is described. The laser control task requires precise timing of up to eight Nd:YAG lasers, each with an average firing rate of 20 Hz. A cpu module in a real-time multiprocessing computer system will operate the lasers with evenly staggered laser pulses or in a ''burst mode,'' where all available (fully charged) lasers can be fired at 50--100 μs intervals upon receipt of an external event trigger signal. One or more cpu modules, along with a LeCroy FERA (fast encoding and readout ADC) system, will perform real-time data acquisition and analysis. Partial electron temperature and density profiles will be available for plasma feedback control within 1 ms following each laser pulse. The VME-based computer system consists of two or more target processor modules (25 MHz Motorola 68030) running the VMEexec real-time operating system connected to a Unix-based host system (also a 68030). All real-time software is fully interrupt driven to maximize system efficiency. Operator interaction and (non-real-time) data analysis takes place on a MicroVAX 3400 connected via DECnet

A real-time architecture for time-aware agents.

Science.gov (United States)

Prouskas, Konstantinos-Vassileios; Pitt, Jeremy V

2004-06-01

This paper describes the specification and implementation of a new three-layer time-aware agent architecture. This architecture is designed for applications and environments where societies of humans and agents play equally active roles, but interact and operate in completely different time frames. The architecture consists of three layers: the April real-time run-time (ART) layer, the time aware layer (TAL), and the application agents layer (AAL). The ART layer forms the underlying real-time agent platform. An original online, real-time, dynamic priority-based scheduling algorithm is described for scheduling the computation time of agent processes, and it is shown that the algorithm's O(n) complexity and scalable performance are sufficient for application in real-time domains. The TAL layer forms an abstraction layer through which human and agent interactions are temporally unified, that is, handled in a common way irrespective of their temporal representation and scale. A novel O(n2) interaction scheduling algorithm is described for predicting and guaranteeing interactions' initiation and completion times. The time-aware predicting component of a workflow management system is also presented as an instance of the AAL layer. The described time-aware architecture addresses two key challenges in enabling agents to be effectively configured and applied in environments where humans and agents play equally active roles. It provides flexibility and adaptability in its real-time mechanisms while placing them under direct agent control, and it temporally unifies human and agent interactions.

Real-time identification of the resistive-wall-mode in DIII-D with Kalman filter ELM discrimination

International Nuclear Information System (INIS)

Edgell, D.H.; Fransson, C.M.; Humphreys, D.A.; Ferron, J.R.; Garofalo, A.M.; Kim, J.S.; La Haye, R.J.; Okabayashi, M.; Reimerdes, H.; Strait, E.J.; Turnbull, A.D.

2004-01-01

The resistive-wall-mode (RWM) is a major performance-limiting instability in present-day tokamaks. Active control and stabilization of the mode will almost certainly be essential for the success of advanced tokamaks and for the economic viability of tokamak fusion reactors. High performance tokamak plasmas often experience edge-localized-modes (ELMs) which can interfere with RWM identification and control. If the RWM control scheme reacts to an ELM the RWM may be driven unstable instead of controlled. An algorithm for real-time identification of the RWM with discrimination of ELMs in the DIII-D tokamak has been developed using a combination of matched filter and Kalman filter methods. The algorithm has been implemented in DIII-D's real-time plasma control system (PCS) and is available to drive active mode control schemes

The first clinical treatment with kilovoltage intrafraction monitoring (KIM): A real-time image guidance method

DEFF Research Database (Denmark)

Keall, Paul J.; Aun Ng, Jin; O'Brien, Ricky

2015-01-01

on September 16, 2014. Methods: KIM uses current and prior 2D x-ray images to estimate the 3D target position during cancer radiotherapy treatment delivery. KIM software was written to process kilovoltage (kV) images streamed from a standard C-arm linear accelerator with a gantry-mounted kV x-ray imaging...... system. A 120° pretreatment kV imaging arc was acquired to build the patient-specific 2D to 3D motion correlation. The kV imager was activated during the megavoltage (MV) treatment, a dual arc VMAT prostate treatment, to estimate the 3D prostate position in real-time. All necessary ethics, legal......, and regulatory requirements were met for this clinical study. The quality assurance processes were completed and peer reviewed. Results: During treatment, a prostate position offset of nearly 3 mm in the posterior direction was observed with KIM. This position offset did not trigger a gating event. After...

Real-Time Large Scale 3d Reconstruction by Fusing Kinect and Imu Data

Science.gov (United States)

Huai, J.; Zhang, Y.; Yilmaz, A.

2015-08-01

Kinect-style RGB-D cameras have been used to build large scale dense 3D maps for indoor environments. These maps can serve many purposes such as robot navigation, and augmented reality. However, to generate dense 3D maps of large scale environments is still very challenging. In this paper, we present a mapping system for 3D reconstruction that fuses measurements from a Kinect and an inertial measurement unit (IMU) to estimate motion. Our major achievements include: (i) Large scale consistent 3D reconstruction is realized by volume shifting and loop closure; (ii) The coarse-to-fine iterative closest point (ICP) algorithm, the SIFT odometry, and IMU odometry are combined to robustly and precisely estimate pose. In particular, ICP runs routinely to track the Kinect motion. If ICP fails in planar areas, the SIFT odometry provides incremental motion estimate. If both ICP and the SIFT odometry fail, e.g., upon abrupt motion or inadequate features, the incremental motion is estimated by the IMU. Additionally, the IMU also observes the roll and pitch angles which can reduce long-term drift of the sensor assembly. In experiments on a consumer laptop, our system estimates motion at 8Hz on average while integrating color images to the local map and saving volumes of meshes concurrently. Moreover, it is immune to tracking failures, and has smaller drift than the state-of-the-art systems in large scale reconstruction.

3D display system using monocular multiview displays

Science.gov (United States)

Sakamoto, Kunio; Saruta, Kazuki; Takeda, Kazutoki

2002-05-01

A 3D head mounted display (HMD) system is useful for constructing a virtual space. The authors have researched the virtual-reality systems connected with computer networks for real-time remote control and developed a low-priced real-time 3D display for building these systems. We developed a 3D HMD system using monocular multi-view displays. The 3D displaying technique of this monocular multi-view display is based on the concept of the super multi-view proposed by Kajiki at TAO (Telecommunications Advancement Organization of Japan) in 1996. Our 3D HMD has two monocular multi-view displays (used as a visual display unit) in order to display a picture to the left eye and the right eye. The left and right images are a pair of stereoscopic images for the left and right eyes, then stereoscopic 3D images are observed.

Real-time colour hologram generation based on ray-sampling plane with multi-GPU acceleration.

Science.gov (United States)

Sato, Hirochika; Kakue, Takashi; Ichihashi, Yasuyuki; Endo, Yutaka; Wakunami, Koki; Oi, Ryutaro; Yamamoto, Kenji; Nakayama, Hirotaka; Shimobaba, Tomoyoshi; Ito, Tomoyoshi

2018-01-24

Although electro-holography can reconstruct three-dimensional (3D) motion pictures, its computational cost is too heavy to allow for real-time reconstruction of 3D motion pictures. This study explores accelerating colour hologram generation using light-ray information on a ray-sampling (RS) plane with a graphics processing unit (GPU) to realise a real-time holographic display system. We refer to an image corresponding to light-ray information as an RS image. Colour holograms were generated from three RS images with resolutions of 2,048 × 2,048; 3,072 × 3,072 and 4,096 × 4,096 pixels. The computational results indicate that the generation of the colour holograms using multiple GPUs (NVIDIA Geforce GTX 1080) was approximately 300-500 times faster than those generated using a central processing unit. In addition, the results demonstrate that 3D motion pictures were successfully reconstructed from RS images of 3,072 × 3,072 pixels at approximately 15 frames per second using an electro-holographic reconstruction system in which colour holograms were generated from RS images in real time.

Hardware Approach for Real Time Machine Stereo Vision

Directory of Open Access Journals (Sweden)

Michael Tornow

2006-02-01

Full Text Available Image processing is an effective tool for the analysis of optical sensor information for driver assistance systems and controlling of autonomous robots. Algorithms for image processing are often very complex and costly in terms of computation. In robotics and driver assistance systems, real-time processing is necessary. Signal processing algorithms must often be drastically modified so they can be implemented in the hardware. This task is especially difficult for continuous real-time processing at high speeds. This article describes a hardware-software co-design for a multi-object position sensor based on a stereophotogrammetric measuring method. In order to cover a large measuring area, an optimized algorithm based on an image pyramid is implemented in an FPGA as a parallel hardware solution for depth map calculation. Object recognition and tracking are then executed in real-time in a processor with help of software. For this task a statistical cluster method is used. Stabilization of the tracking is realized through use of a Kalman filter. Keywords: stereophotogrammetry, hardware-software co-design, FPGA, 3-d image analysis, real-time, clustering and tracking.

Modeling L2,3-Edge X-ray Absorption Spectroscopy with Real-Time Exact Two-Component Relativistic Time-Dependent Density Functional Theory.

Science.gov (United States)

Kasper, Joseph M; Lestrange, Patrick J; Stetina, Torin F; Li, Xiaosong

2018-04-10

X-ray absorption spectroscopy is a powerful technique to probe local electronic and nuclear structure. There has been extensive theoretical work modeling K-edge spectra from first principles. However, modeling L-edge spectra directly with density functional theory poses a unique challenge requiring further study. Spin-orbit coupling must be included in the model, and a noncollinear density functional theory is required. Using the real-time exact two-component method, we are able to variationally include one-electron spin-orbit coupling terms when calculating the absorption spectrum. The abilities of different basis sets and density functionals to model spectra for both closed- and open-shell systems are investigated using SiCl 4 and three transition metal complexes, TiCl 4 , CrO 2 Cl 2 , and [FeCl 6 ] 3- . Although we are working in the real-time framework, individual molecular orbital transitions can still be recovered by projecting the density onto the ground state molecular orbital space and separating contributions to the time evolving dipole moment.

Acquisition of a Multi-Domain Advanced Real-Time Simulator to Support DoD-focused Interdisciplinary Research at CSUB

Science.gov (United States)

2017-10-17

SECURITY CLASSIFICATION OF: 1. REPORT DATE (DD-MM-YYYY) 4. TITLE AND SUBTITLE 13. SUPPLEMENTARY NOTES 12. DISTRIBUTION AVAILIBILITY STATEMENT 6...0704-0188 3. DATES COVERED (From - To) - Approved for public release; distribution is unlimited. UU UU UU UU 17-10-2017 25-Jul-2016 24-Jul-2017 Final...Report: Acquisition of a Multi-Domain Advanced Real- Time Simulator to Support DoD-focused Interdisciplinary Research at CSUB The views, opinions and

Creating Machinima (3D) and Real Life Videos in an ESP Classroom

Science.gov (United States)

Ochoa Alpala, Carol Anne; Ortíz García, William Ricardo

2018-01-01

This research paper reports on the development of oral presentation skills in a 3D virtual world called "Moviestorm" machinima, in contrast with real-life videos. In this way, the implementation of both types of videos sought to promote the improvement of oral communication skills, specifically oral presentations in a foreign language,…

Quantitative real-time monitoring of multi-elements in airborne particulates by direct introduction into an inductively coupled plasma mass spectrometer

International Nuclear Information System (INIS)

Suzuki, Yoshinari; Sato, Hikaru; Hiyoshi, Katsuhiro; Furuta, Naoki

2012-01-01

A new calibration system for real-time determination of trace elements in airborne particulates was developed. Airborne particulates were directly introduced into an inductively coupled plasma mass spectrometer, and the concentrations of 15 trace elements were determined by means of an external calibration method. External standard solutions were nebulized by an ultrasonic nebulizer (USN) coupled with a desolvation system, and the resulting aerosol was introduced into the plasma. The efficiency of sample introduction via the USN was calculated by two methods: (1) the introduction of a Cr standard solution via the USN was compared with introduction of a Cr(CO) 6 standard gas via a standard gas generator and (2) the aerosol generated by the USN was trapped on filters and then analyzed. The Cr introduction efficiencies obtained by the two methods were the same, and the introduction efficiencies of the other elements were equal to the introduction efficiency of Cr. Our results indicated that our calibration method for introduction efficiency worked well for the 15 elements (Ti, V, Cr, Mn, Co, Ni, Cu, Zn, As, Mo, Sn, Sb, Ba, Tl and Pb). The real-time data and the filter-collection data agreed well for elements with low-melting oxides (V, Co, As, Mo, Sb, Tl, and Pb). In contrast, the real-time data were smaller than the filter-collection data for elements with high-melting oxides (Ti, Cr, Mn, Ni, Cu, Zn, Sn, and Ba). This result implies that the oxides of these 8 elements were not completely fused, vaporized, atomized, and ionized in the initial radiation zone of the inductively coupled plasma. However, quantitative real-time monitoring can be realized after correction for the element recoveries which can be calculated from the ratio of real-time data/filter-collection data. - Highlights: ► APs were directly introduced into ICP-MS and real-time analysis was performed. ► The real-time data were calibrated by a multi-element standard solution from USN. ► During real-time

Real-Time Engagement Area Development Program (READ-Pro)

National Research Council Canada - National Science Library

Burger, Joseph

2002-01-01

The Real Time Engagement Area Development Program (READ-Pro) is a PC-based prototype system which provides company-level commanders with real-time operational analysis tools to develop ENGAGEMENT AREAS(EA) for direct fire (DF) systems...

First online real-time evaluation of motion-induced 4D dose errors during radiotherapy delivery

DEFF Research Database (Denmark)

Ravkilde, Thomas; Skouboe, Simon; Hansen, Rune

2018-01-01

PURPOSE: In radiotherapy, dose deficits caused by tumor motion often far outweigh the discrepancies typically allowed in plan-specific quality assurance (QA). Yet, tumor motion is not usually included in present QA. We here present a novel method for online treatment verification by real......-time motion-including 4D dose reconstruction and dose evaluation and demonstrate its use during stereotactic body radiotherapy (SBRT) delivery with and without MLC tracking. METHODS: Five volumetric modulated arc therapy (VMAT) plans were delivered with and without MLC tracking to a motion stage carrying...... a Delta4 dosimeter. The VMAT plans have previously been used for (non-tracking) liver SBRT with intra-treatment tumor motion recorded by kilovoltage intrafraction monitoring (KIM). The motion stage reproduced the KIM-measured tumor motions in 3D while optical monitoring guided the MLC tracking. Linac...

Experimental ultrasound system for real-time synthetic imaging

DEFF Research Database (Denmark)

Jensen, Jørgen Arendt; Holm, Ole; Jensen, Lars Joost

1999-01-01

Digital signal processing is being employed more and more in modern ultrasound scanners. This has made it possible to do dynamic receive focusing for each sample and implement other advanced imaging methods. The processing, however, has to be very fast and cost-effective at the same time. Dedicated...... for synthetic aperture imaging, 2D and 3D B-mode and velocity imaging. The system can be used with 128 element transducers and can excite 128 channels and receive and sample data from 64 channels simultaneously at 40 MHz with 12 bits precision. Data can be processed in real time using the system's 80 signal...... chips are used in order to do real time processing. This often makes it difficult to implement radically different imaging strategies on one platform and makes the scanners less accessible for research purposes. Here flexibility is the prime concern, and the storage of data from all transducer elements...

Real-time Visualization of Tissue Dynamics during Embryonic Development and Malignant Transformation

Science.gov (United States)

Yamada, Kenneth

Tissues undergo dramatic changes in organization during embryonic development, as well as during cancer progression and invasion. Recent advances in microscopy now allow us to visualize and track directly the dynamic movements of tissues, their constituent cells, and cellular substructures. This behavior can now be visualized not only in regular tissue culture on flat surfaces (`2D' environments), but also in a variety of 3D environments that may provide physiological cues relevant to understanding dynamics within living organisms. Acquisition of imaging data using various microscopy modalities will provide rich opportunities for determining the roles of physical factors and for computational modeling of complex processes in living tissues. Direct visualization of real-time motility is providing insight into biology spanning multiple spatio-temporal scales. Many cells in our body are known to be in contact with connective tissue and other forms of extracellular matrix. They do so through microscopic cellular adhesions that bind to matrix proteins. In particular, fluorescence microscopy has revealed that cells dynamically probe and bend the matrix at the sites of cell adhesions, and that 3D matrix architecture, stiffness, and elasticity can each regulate migration of the cells. Conversely, cells remodel their local matrix as organs form or tumors invade. Cancer cells can invade tissues using microscopic protrusions that degrade the surrounding matrix; in this case, the local matrix protein concentration is more important for inducing the micro-invasive protrusions than stiffness. On the length scales of tissues, transiently high rates of individual cell movement appear to help establish organ architecture. In fact, isolated cells can self-organize to form tissue structures. In all of these cases, in-depth real-time visualization will ultimately provide the extensive data needed for computer modeling and for testing hypotheses in which physical forces interact