WorldWideScience

Sample records for uav video sequences

  1. Real-time UAV trajectory generation using feature points matching between video image sequences

    Science.gov (United States)

    Byun, Younggi; Song, Jeongheon; Han, Dongyeob

    2017-09-01

    Unmanned aerial vehicles (UAVs), equipped with navigation systems and video capability, are currently being deployed for intelligence, reconnaissance and surveillance mission. In this paper, we present a systematic approach for the generation of UAV trajectory using a video image matching system based on SURF (Speeded up Robust Feature) and Preemptive RANSAC (Random Sample Consensus). Video image matching to find matching points is one of the most important steps for the accurate generation of UAV trajectory (sequence of poses in 3D space). We used the SURF algorithm to find the matching points between video image sequences, and removed mismatching by using the Preemptive RANSAC which divides all matching points to outliers and inliers. The inliers are only used to determine the epipolar geometry for estimating the relative pose (rotation and translation) between image sequences. Experimental results from simulated video image sequences showed that our approach has a good potential to be applied to the automatic geo-localization of the UAVs system

  2. Low complexity video encoding for UAV inspection

    DEFF Research Database (Denmark)

    Søgaard, Jacob; Zhang, Ruo; Forchhammer, Søren

    2016-01-01

    In this work we present several methods for fast integer motion estimation of videos recorded aboard an Unmanned Aerial Vehicle (UAV). Different from related work, the field depth is not considered to be consistent. The novel methods designed for low complexity MV prediction in H.264/AVC and anal......In this work we present several methods for fast integer motion estimation of videos recorded aboard an Unmanned Aerial Vehicle (UAV). Different from related work, the field depth is not considered to be consistent. The novel methods designed for low complexity MV prediction in H.264/AVC...... for UAV infrared (IR) video are also provided....

  3. A method of intentional movement estimation of oblique small-UAV videos stabilized based on homography model

    Science.gov (United States)

    Guo, Shiyi; Mai, Ying; Zhao, Hongying; Gao, Pengqi

    2013-05-01

    The airborne video streams of small-UAVs are commonly plagued with distractive jittery and shaking motions, disorienting rotations, noisy and distorted images and other unwanted movements. These problems collectively make it very difficult for observers to obtain useful information from the video. Due to the small payload of small-UAVs, it is a priority to improve the image quality by means of electronic image stabilization. But when small-UAV makes a turn, affected by the flight characteristics of it, the video is easy to become oblique. This brings a lot of difficulties to electronic image stabilization technology. Homography model performed well in the oblique image motion estimation, while bringing great challenges to intentional motion estimation. Therefore, in this paper, we focus on solve the problem of the video stabilized when small-UAVs banking and turning. We attend to the small-UAVs fly along with an arc of a fixed turning radius. For this reason, after a series of experimental analysis on the flight characteristics and the path how small-UAVs turned, we presented a new method to estimate the intentional motion in which the path of the frame center was used to fit the video moving track. Meanwhile, the image sequences dynamic mosaic was done to make up for the limited field of view. At last, the proposed algorithm was carried out and validated by actual airborne videos. The results show that the proposed method is effective to stabilize the oblique video of small-UAVs.

  4. Heterogeneous CPU-GPU moving targets detection for UAV video

    Science.gov (United States)

    Li, Maowen; Tang, Linbo; Han, Yuqi; Yu, Chunlei; Zhang, Chao; Fu, Huiquan

    2017-07-01

    Moving targets detection is gaining popularity in civilian and military applications. On some monitoring platform of motion detection, some low-resolution stationary cameras are replaced by moving HD camera based on UAVs. The pixels of moving targets in the HD Video taken by UAV are always in a minority, and the background of the frame is usually moving because of the motion of UAVs. The high computational cost of the algorithm prevents running it at higher resolutions the pixels of frame. Hence, to solve the problem of moving targets detection based UAVs video, we propose a heterogeneous CPU-GPU moving target detection algorithm for UAV video. More specifically, we use background registration to eliminate the impact of the moving background and frame difference to detect small moving targets. In order to achieve the effect of real-time processing, we design the solution of heterogeneous CPU-GPU framework for our method. The experimental results show that our method can detect the main moving targets from the HD video taken by UAV, and the average process time is 52.16ms per frame which is fast enough to solve the problem.

  5. Automated UAV-based video exploitation using service oriented architecture framework

    Science.gov (United States)

    Se, Stephen; Nadeau, Christian; Wood, Scott

    2011-05-01

    Airborne surveillance and reconnaissance are essential for successful military missions. Such capabilities are critical for troop protection, situational awareness, mission planning, damage assessment, and others. Unmanned Aerial Vehicles (UAVs) gather huge amounts of video data but it is extremely labour-intensive for operators to analyze hours and hours of received data. At MDA, we have developed a suite of tools that can process the UAV video data automatically, including mosaicking, change detection and 3D reconstruction, which have been integrated within a standard GIS framework. In addition, the mosaicking and 3D reconstruction tools have also been integrated in a Service Oriented Architecture (SOA) framework. The Visualization and Exploitation Workstation (VIEW) integrates 2D and 3D visualization, processing, and analysis capabilities developed for UAV video exploitation. Visualization capabilities are supported through a thick-client Graphical User Interface (GUI), which allows visualization of 2D imagery, video, and 3D models. The GUI interacts with the VIEW server, which provides video mosaicking and 3D reconstruction exploitation services through the SOA framework. The SOA framework allows multiple users to perform video exploitation by running a GUI client on the operator's computer and invoking the video exploitation functionalities residing on the server. This allows the exploitation services to be upgraded easily and allows the intensive video processing to run on powerful workstations. MDA provides UAV services to the Canadian and Australian forces in Afghanistan with the Heron, a Medium Altitude Long Endurance (MALE) UAV system. On-going flight operations service provides important intelligence, surveillance, and reconnaissance information to commanders and front-line soldiers.

  6. Video change detection for fixed wing UAVs

    Science.gov (United States)

    Bartelsen, Jan; Müller, Thomas; Ring, Jochen; Mück, Klaus; Brüstle, Stefan; Erdnüß, Bastian; Lutz, Bastian; Herbst, Theresa

    2017-10-01

    In this paper we proceed the work of Bartelsen et al.1 We present the draft of a process chain for an image based change detection which is designed for videos acquired by fixed wing unmanned aerial vehicles (UAVs). From our point of view, automatic video change detection for aerial images can be useful to recognize functional activities which are typically caused by the deployment of improvised explosive devices (IEDs), e.g. excavations, skid marks, footprints, left-behind tooling equipment, and marker stones. Furthermore, in case of natural disasters, like flooding, imminent danger can be recognized quickly. Due to the necessary flight range, we concentrate on fixed wing UAVs. Automatic change detection can be reduced to a comparatively simple photogrammetric problem when the perspective change between the "before" and "after" image sets is kept as small as possible. Therefore, the aerial image acquisition demands a mission planning with a clear purpose including flight path and sensor configuration. While the latter can be enabled simply by a fixed and meaningful adjustment of the camera, ensuring a small perspective change for "before" and "after" videos acquired by fixed wing UAVs is a challenging problem. Concerning this matter, we have performed tests with an advanced commercial off the shelf (COTS) system which comprises a differential GPS and autopilot system estimating the repetition accuracy of its trajectory. Although several similar approaches have been presented,23 as far as we are able to judge, the limits for this important issue are not estimated so far. Furthermore, we design a process chain to enable the practical utilization of video change detection. It consists of a front-end of a database to handle large amounts of video data, an image processing and change detection implementation, and the visualization of the results. We apply our process chain on the real video data acquired by the advanced COTS fixed wing UAV and synthetic data. For the

  7. Extended image differencing for change detection in UAV video mosaics

    Science.gov (United States)

    Saur, Günter; Krüger, Wolfgang; Schumann, Arne

    2014-03-01

    Change detection is one of the most important tasks when using unmanned aerial vehicles (UAV) for video reconnaissance and surveillance. We address changes of short time scale, i.e. the observations are taken in time distances from several minutes up to a few hours. Each observation is a short video sequence acquired by the UAV in near-nadir view and the relevant changes are, e.g., recently parked or moved vehicles. In this paper we extend our previous approach of image differencing for single video frames to video mosaics. A precise image-to-image registration combined with a robust matching approach is needed to stitch the video frames to a mosaic. Additionally, this matching algorithm is applied to mosaic pairs in order to align them to a common geometry. The resulting registered video mosaic pairs are the input of the change detection procedure based on extended image differencing. A change mask is generated by an adaptive threshold applied to a linear combination of difference images of intensity and gradient magnitude. The change detection algorithm has to distinguish between relevant and non-relevant changes. Examples for non-relevant changes are stereo disparity at 3D structures of the scene, changed size of shadows, and compression or transmission artifacts. The special effects of video mosaicking such as geometric distortions and artifacts at moving objects have to be considered, too. In our experiments we analyze the influence of these effects on the change detection results by considering several scenes. The results show that for video mosaics this task is more difficult than for single video frames. Therefore, we extended the image registration by estimating an elastic transformation using a thin plate spline approach. The results for mosaics are comparable to that of single video frames and are useful for interactive image exploitation due to a larger scene coverage.

  8. Short-term change detection for UAV video

    Science.gov (United States)

    Saur, Günter; Krüger, Wolfgang

    2012-11-01

    In the last years, there has been an increased use of unmanned aerial vehicles (UAV) for video reconnaissance and surveillance. An important application in this context is change detection in UAV video data. Here we address short-term change detection, in which the time between observations ranges from several minutes to a few hours. We distinguish this task from video motion detection (shorter time scale) and from long-term change detection, based on time series of still images taken between several days, weeks, or even years. Examples for relevant changes we are looking for are recently parked or moved vehicles. As a pre-requisite, a precise image-to-image registration is needed. Images are selected on the basis of the geo-coordinates of the sensor's footprint and with respect to a certain minimal overlap. The automatic imagebased fine-registration adjusts the image pair to a common geometry by using a robust matching approach to handle outliers. The change detection algorithm has to distinguish between relevant and non-relevant changes. Examples for non-relevant changes are stereo disparity at 3D structures of the scene, changed length of shadows, and compression or transmission artifacts. To detect changes in image pairs we analyzed image differencing, local image correlation, and a transformation-based approach (multivariate alteration detection). As input we used color and gradient magnitude images. To cope with local misalignment of image structures we extended the approaches by a local neighborhood search. The algorithms are applied to several examples covering both urban and rural scenes. The local neighborhood search in combination with intensity and gradient magnitude differencing clearly improved the results. Extended image differencing performed better than both the correlation based approach and the multivariate alternation detection. The algorithms are adapted to be used in semi-automatic workflows for the ABUL video exploitation system of Fraunhofer

  9. No Reference Prediction of Quality Metrics for H.264 Compressed Infrared Image Sequences for UAV Applications

    DEFF Research Database (Denmark)

    Hossain, Kabir; Mantel, Claire; Forchhammer, Søren

    2018-01-01

    The framework for this research work is the acquisition of Infrared (IR) images from Unmanned Aerial Vehicles (UAV). In this paper we consider the No-Reference (NR) prediction of Full Reference Quality Metrics for Infrared (IR) video sequences which are compressed and thus distorted by an H.264...

  10. a Sensor Aided H.264/AVC Video Encoder for Aerial Video Sequences with in the Loop Metadata Correction

    Science.gov (United States)

    Cicala, L.; Angelino, C. V.; Ruatta, G.; Baccaglini, E.; Raimondo, N.

    2015-08-01

    Unmanned Aerial Vehicles (UAVs) are often employed to collect high resolution images in order to perform image mosaicking and/or 3D reconstruction. Images are usually stored on board and then processed with on-ground desktop software. In such a way the computational load, and hence the power consumption, is moved on ground, leaving on board only the task of storing data. Such an approach is important in the case of small multi-rotorcraft UAVs because of their low endurance due to the short battery life. Images can be stored on board with either still image or video data compression. Still image system are preferred when low frame rates are involved, because video coding systems are based on motion estimation and compensation algorithms which fail when the motion vectors are significantly long and when the overlapping between subsequent frames is very small. In this scenario, UAVs attitude and position metadata from the Inertial Navigation System (INS) can be employed to estimate global motion parameters without video analysis. A low complexity image analysis can be still performed in order to refine the motion field estimated using only the metadata. In this work, we propose to use this refinement step in order to improve the position and attitude estimation produced by the navigation system in order to maximize the encoder performance. Experiments are performed on both simulated and real world video sequences.

  11. A Benchmark and Simulator for UAV Tracking

    KAUST Repository

    Mueller, Matthias; Smith, Neil; Ghanem, Bernard

    2016-01-01

    In this paper, we propose a new aerial video dataset and benchmark for low altitude UAV target tracking, as well as, a photorealistic UAV simulator that can be coupled with tracking methods. Our benchmark provides the first evaluation of many state-of-the-art and popular trackers on 123 new and fully annotated HD video sequences captured from a low-altitude aerial perspective. Among the compared trackers, we determine which ones are the most suitable for UAV tracking both in terms of tracking accuracy and run-time. The simulator can be used to evaluate tracking algorithms in real-time scenarios before they are deployed on a UAV “in the field”, as well as, generate synthetic but photo-realistic tracking datasets with automatic ground truth annotations to easily extend existing real-world datasets. Both the benchmark and simulator are made publicly available to the vision community on our website to further research in the area of object tracking from UAVs. (https://ivul.kaust.edu.sa/Pages/pub-benchmark-simulator-uav.aspx.). © Springer International Publishing AG 2016.

  12. A Benchmark and Simulator for UAV Tracking

    KAUST Repository

    Mueller, Matthias

    2016-09-16

    In this paper, we propose a new aerial video dataset and benchmark for low altitude UAV target tracking, as well as, a photorealistic UAV simulator that can be coupled with tracking methods. Our benchmark provides the first evaluation of many state-of-the-art and popular trackers on 123 new and fully annotated HD video sequences captured from a low-altitude aerial perspective. Among the compared trackers, we determine which ones are the most suitable for UAV tracking both in terms of tracking accuracy and run-time. The simulator can be used to evaluate tracking algorithms in real-time scenarios before they are deployed on a UAV “in the field”, as well as, generate synthetic but photo-realistic tracking datasets with automatic ground truth annotations to easily extend existing real-world datasets. Both the benchmark and simulator are made publicly available to the vision community on our website to further research in the area of object tracking from UAVs. (https://ivul.kaust.edu.sa/Pages/pub-benchmark-simulator-uav.aspx.). © Springer International Publishing AG 2016.

  13. Persistent Aerial Tracking system for UAVs

    KAUST Repository

    Mueller, Matthias; Sharma, Gopal; Smith, Neil; Ghanem, Bernard

    2016-01-01

    In this paper, we propose a persistent, robust and autonomous object tracking system for unmanned aerial vehicles (UAVs) called Persistent Aerial Tracking (PAT). A computer vision and control strategy is applied to a diverse set of moving objects (e.g. humans, animals, cars, boats, etc.) integrating multiple UAVs with a stabilized RGB camera. A novel strategy is employed to successfully track objects over a long period, by ‘handing over the camera’ from one UAV to another. We evaluate several state-of-the-art trackers on the VIVID aerial video dataset and additional sequences that are specifically tailored to low altitude UAV target tracking. Based on the evaluation, we select the leading tracker and improve upon it by optimizing for both speed and performance, integrate the complete system into an off-the-shelf UAV, and obtain promising results showing the robustness of our solution in real-world aerial scenarios.

  14. Persistent Aerial Tracking system for UAVs

    KAUST Repository

    Mueller, Matthias

    2016-12-19

    In this paper, we propose a persistent, robust and autonomous object tracking system for unmanned aerial vehicles (UAVs) called Persistent Aerial Tracking (PAT). A computer vision and control strategy is applied to a diverse set of moving objects (e.g. humans, animals, cars, boats, etc.) integrating multiple UAVs with a stabilized RGB camera. A novel strategy is employed to successfully track objects over a long period, by ‘handing over the camera’ from one UAV to another. We evaluate several state-of-the-art trackers on the VIVID aerial video dataset and additional sequences that are specifically tailored to low altitude UAV target tracking. Based on the evaluation, we select the leading tracker and improve upon it by optimizing for both speed and performance, integrate the complete system into an off-the-shelf UAV, and obtain promising results showing the robustness of our solution in real-world aerial scenarios.

  15. Ubiquitous UAVs: a cloud based framework for storing, accessing and processing huge amount of video footage in an efficient way

    Science.gov (United States)

    Efstathiou, Nectarios; Skitsas, Michael; Psaroudakis, Chrysostomos; Koutras, Nikolaos

    2017-09-01

    Nowadays, video surveillance cameras are used for the protection and monitoring of a huge number of facilities worldwide. An important element in such surveillance systems is the use of aerial video streams originating from onboard sensors located on Unmanned Aerial Vehicles (UAVs). Video surveillance using UAVs represent a vast amount of video to be transmitted, stored, analyzed and visualized in a real-time way. As a result, the introduction and development of systems able to handle huge amount of data become a necessity. In this paper, a new approach for the collection, transmission and storage of aerial videos and metadata is introduced. The objective of this work is twofold. First, the integration of the appropriate equipment in order to capture and transmit real-time video including metadata (i.e. position coordinates, target) from the UAV to the ground and, second, the utilization of the ADITESS Versatile Media Content Management System (VMCMS-GE) for storing of the video stream and the appropriate metadata. Beyond the storage, VMCMS-GE provides other efficient management capabilities such as searching and processing of videos, along with video transcoding. For the evaluation and demonstration of the proposed framework we execute a use case where the surveillance of critical infrastructure and the detection of suspicious activities is performed. Collected video Transcodingis subject of this evaluation as well.

  16. Pricise Target Geolocation and Tracking Based on Uav Video Imagery

    Science.gov (United States)

    Hosseinpoor, H. R.; Samadzadegan, F.; Dadrasjavan, F.

    2016-06-01

    There is an increasingly large number of applications for Unmanned Aerial Vehicles (UAVs) from monitoring, mapping and target geolocation. However, most of commercial UAVs are equipped with low-cost navigation sensors such as C/A code GPS and a low-cost IMU on board, allowing a positioning accuracy of 5 to 10 meters. This low accuracy cannot be used in applications that require high precision data on cm-level. This paper presents a precise process for geolocation of ground targets based on thermal video imagery acquired by small UAV equipped with RTK GPS. The geolocation data is filtered using an extended Kalman filter, which provides a smoothed estimate of target location and target velocity. The accurate geo-locating of targets during image acquisition is conducted via traditional photogrammetric bundle adjustment equations using accurate exterior parameters achieved by on board IMU and RTK GPS sensors, Kalman filtering and interior orientation parameters of thermal camera from pre-flight laboratory calibration process. The results of this study compared with code-based ordinary GPS, indicate that RTK observation with proposed method shows more than 10 times improvement of accuracy in target geolocation.

  17. Automated UAV-based mapping for airborne reconnaissance and video exploitation

    Science.gov (United States)

    Se, Stephen; Firoozfam, Pezhman; Goldstein, Norman; Wu, Linda; Dutkiewicz, Melanie; Pace, Paul; Naud, J. L. Pierre

    2009-05-01

    Airborne surveillance and reconnaissance are essential for successful military missions. Such capabilities are critical for force protection, situational awareness, mission planning, damage assessment and others. UAVs gather huge amount of video data but it is extremely labour-intensive for operators to analyse hours and hours of received data. At MDA, we have developed a suite of tools towards automated video exploitation including calibration, visualization, change detection and 3D reconstruction. The on-going work is to improve the robustness of these tools and automate the process as much as possible. Our calibration tool extracts and matches tie-points in the video frames incrementally to recover the camera calibration and poses, which are then refined by bundle adjustment. Our visualization tool stabilizes the video, expands its field-of-view and creates a geo-referenced mosaic from the video frames. It is important to identify anomalies in a scene, which may include detecting any improvised explosive devices (IED). However, it is tedious and difficult to compare video clips to look for differences manually. Our change detection tool allows the user to load two video clips taken from two passes at different times and flags any changes between them. 3D models are useful for situational awareness, as it is easier to understand the scene by visualizing it in 3D. Our 3D reconstruction tool creates calibrated photo-realistic 3D models from video clips taken from different viewpoints, using both semi-automated and automated approaches. The resulting 3D models also allow distance measurements and line-of- sight analysis.

  18. Use of a UAV-mounted video camera to assess feeding behavior of Raramuri Criollo cows

    Science.gov (United States)

    Interest in use of unmanned aerial vehicles in science has increased in recent years. It is predicted that they will be a preferred remote sensing platform for applications that inform sustainable rangeland management in the future. The objective of this study was to determine whether UAV video moni...

  19. Robust UAV Mission Planning

    NARCIS (Netherlands)

    Evers, L.; Dollevoet, T.; Barros, A.I.; Monsuur, H.

    2014-01-01

    Unmanned Aerial Vehicles (UAVs) can provide significant contributions to information gathering in military missions. UAVs can be used to capture both full motion video and still imagery of specific target locations within the area of interest. In order to improve the effectiveness of a

  20. Robust UAV mission planning

    NARCIS (Netherlands)

    Evers, L.; Dollevoet, T.; Barros, A.I.; Monsuur, H.

    2011-01-01

    Unmanned Areal Vehicles (UAVs) can provide significant contributions to information gathering in military missions. UAVs can be used to capture both full motion video and still imagery of specific target locations within the area of interest. In order to improve the effectiveness of a reconnaissance

  1. Robust UAV Mission Planning

    NARCIS (Netherlands)

    Evers, L.; Dollevoet, T; Barros, A.I.; Monsuur, H.

    2011-01-01

    Unmanned Aerial Vehicles (UAVs) can provide significant contributions to information gathering in military missions. UAVs can be used to capture both full motion video and still imagery of specific target locations within the area of interest. In order to improve the effectiveness of a

  2. Robust UAV Mission Planning

    NARCIS (Netherlands)

    L. Evers (Lanah); T.A.B. Dollevoet (Twan); A.I. Barros (Ana); H. Monsuur (Herman)

    2011-01-01

    textabstractUnmanned Areal Vehicles (UAVs) can provide significant contributions to information gathering in military missions. UAVs can be used to capture both full motion video and still imagery of specific target locations within the area of interest. In order to improve the effectiveness of a

  3. Fast Aerial Video Stitching

    Directory of Open Access Journals (Sweden)

    Jing Li

    2014-10-01

    Full Text Available The highly efficient and robust stitching of aerial video captured by unmanned aerial vehicles (UAVs is a challenging problem in the field of robot vision. Existing commercial image stitching systems have seen success with offline stitching tasks, but they cannot guarantee high-speed performance when dealing with online aerial video sequences. In this paper, we present a novel system which has an unique ability to stitch high-frame rate aerial video at a speed of 150 frames per second (FPS. In addition, rather than using a high-speed vision platform such as FPGA or CUDA, our system is running on a normal personal computer. To achieve this, after the careful comparison of the existing invariant features, we choose the FAST corner and binary descriptor for efficient feature extraction and representation, and present a spatial and temporal coherent filter to fuse the UAV motion information into the feature matching. The proposed filter can remove the majority of feature correspondence outliers and significantly increase the speed of robust feature matching by up to 20 times. To achieve a balance between robustness and efficiency, a dynamic key frame-based stitching framework is used to reduce the accumulation errors. Extensive experiments on challenging UAV datasets demonstrate that our approach can break through the speed limitation and generate an accurate stitching image for aerial video stitching tasks.

  4. A mini-UAV VTOL Platform for Surveying Applications

    Directory of Open Access Journals (Sweden)

    Kuldeep Rawat

    2014-05-01

    Full Text Available In this paper we discuss implementation of a mini-Unmanned Aerial Vehicle (UAV vertical take-off and landing (VTOL platform for surveying activities related to highway construction. Recent advances in sensor and communication technologies have allowed scaling sizes of unmanned aerial platforms, and explore them for tasks that are economical and safe over populated or inhabited areas. In highway construction the capability of mini-UAVs to survey in hostile and/or hardly accessible areas can greatly reduce human risks. The project focused on developing a cost effective, remotely controlled, fuel powered mini-UAV VTOL (helicopter platform with certain payload capacity and configuration and demonstrated its use in surveying and monitoring activities required for highway planning and construction. With an on-board flight recorder global positioning system (GPS device, memory storage card, telemetry, inertial navigation sensors, and a video camera the mini-UAV can record flying coordinates and relay live video images to a remote ground receiver and surveyor. After all necessary integration and flight tests were done the mini-UAV helicopter was tested to operate and relay video from the areas where construction was underway. The mini-UAV can provide a platform for a range of sensors and instruments that directly support the operational requirements of transportation sector.

  5. Fast Orientation of Video Images of Buildings Acquired from a UAV without Stabilization

    Science.gov (United States)

    Kedzierski, Michal; Delis, Paulina

    2016-01-01

    The aim of this research was to assess the possibility of conducting an absolute orientation procedure for video imagery, in which the external orientation for the first image was typical for aerial photogrammetry whereas the external orientation of the second was typical for terrestrial photogrammetry. Starting from the collinearity equations, assuming that the camera tilt angle is equal to 90°, a simplified mathematical model is proposed. The proposed method can be used to determine the X, Y, Z coordinates of points based on a set of collinearity equations of a pair of images. The use of simplified collinearity equations can considerably shorten the processing tine of image data from Unmanned Aerial Vehicles (UAVs), especially in low cost systems. The conducted experiments have shown that it is possible to carry out a complete photogrammetric project of an architectural structure using a camera tilted 85°–90° (φ or ω) and simplified collinearity equations. It is also concluded that there is a correlation between the speed of the UAV and the discrepancy between the established and actual camera tilt angles. PMID:27347954

  6. Determination of Shift/Bias in Digital Aerial Triangulation of UAV Imagery Sequences

    Science.gov (United States)

    Wierzbicki, Damian

    2017-12-01

    Currently UAV Photogrammetry is characterized a largely automated and efficient data processing. Depicting from the low altitude more often gains on the meaning in the uses of applications as: cities mapping, corridor mapping, road and pipeline inspections or mapping of large areas e.g. forests. Additionally, high-resolution video image (HD and bigger) is more often use for depicting from the low altitude from one side it lets deliver a lot of details and characteristics of ground surfaces features, and from the other side is presenting new challenges in the data processing. Therefore, determination of elements of external orientation plays a substantial role the detail of Digital Terrain Models and artefact-free ortophoto generation. Parallel a research on the quality of acquired images from UAV and above the quality of products e.g. orthophotos are conducted. Despite so fast development UAV photogrammetry still exists the necessity of accomplishment Automatic Aerial Triangulation (AAT) on the basis of the observations GPS/INS and via ground control points. During low altitude photogrammetric flight, the approximate elements of external orientation registered by UAV are burdened with the influence of some shift/bias errors. In this article, methods of determination shift/bias error are presented. In the process of the digital aerial triangulation two solutions are applied. In the first method shift/bias error was determined together with the drift/bias error, elements of external orientation and coordinates of ground control points. In the second method shift/bias error was determined together with the elements of external orientation, coordinates of ground control points and drift/bias error equals 0. When two methods were compared the difference for shift/bias error is more than ±0.01 m for all terrain coordinates XYZ.

  7. Autonomous target tracking of UAVs based on low-power neural network hardware

    Science.gov (United States)

    Yang, Wei; Jin, Zhanpeng; Thiem, Clare; Wysocki, Bryant; Shen, Dan; Chen, Genshe

    2014-05-01

    Detecting and identifying targets in unmanned aerial vehicle (UAV) images and videos have been challenging problems due to various types of image distortion. Moreover, the significantly high processing overhead of existing image/video processing techniques and the limited computing resources available on UAVs force most of the processing tasks to be performed by the ground control station (GCS) in an off-line manner. In order to achieve fast and autonomous target identification on UAVs, it is thus imperative to investigate novel processing paradigms that can fulfill the real-time processing requirements, while fitting the size, weight, and power (SWaP) constrained environment. In this paper, we present a new autonomous target identification approach on UAVs, leveraging the emerging neuromorphic hardware which is capable of massively parallel pattern recognition processing and demands only a limited level of power consumption. A proof-of-concept prototype was developed based on a micro-UAV platform (Parrot AR Drone) and the CogniMemTMneural network chip, for processing the video data acquired from a UAV camera on the y. The aim of this study was to demonstrate the feasibility and potential of incorporating emerging neuromorphic hardware into next-generation UAVs and their superior performance and power advantages towards the real-time, autonomous target tracking.

  8. The application of micro UAV in construction project

    Science.gov (United States)

    Kaamin, Masiri; Razali, Siti Nooraiin Mohd; Ahmad, Nor Farah Atiqah; Bukari, Saifullizan Mohd; Ngadiman, Norhayati; Kadir, Aslila Abd; Hamid, Nor Baizura

    2017-10-01

    In every outstanding construction project, there is definitely have an effective construction management. Construction management allows a construction project to be implemented according to plan. Every construction project must have a progress development works that is usually created by the site engineer. Documenting the progress of works is one of the requirements in construction management. In a progress report it is necessarily have a visual image as an evidence. The conventional method used for photographing on the construction site is by using common digital camera which is has few setback comparing to Micro Unmanned Aerial Vehicles (UAV). Besides, site engineer always have a current issues involving limitation of monitoring on high reach point and entire view of the construction site. The purpose of this paper is to provide a concise review of Micro UAV technology in monitoring the progress on construction site through visualization approach. The aims of this study are to replace the conventional method of photographing on construction site using Micro UAV which can portray the whole view of the building, especially on high reach point and allows to produce better images, videos and 3D model and also facilitating site engineer to monitor works in progress. The Micro UAV was flown around the building construction according to the Ground Control Points (GCPs) to capture images and record videos. The images taken from Micro UAV have been processed generate 3D model and were analysed to visualize the building construction as well as monitoring the construction progress work and provides immediate reliable data for project estimation. It has been proven that by using Micro UAV, a better images and videos can give a better overview of the construction site and monitor any defects on high reach point building structures. Not to be forgotten, with Micro UAV the construction site progress is more efficiently tracked and kept on the schedule.

  9. Fast Orientation of Video Images of Buildings Acquired from a UAV without Stabilization

    Directory of Open Access Journals (Sweden)

    Michal Kedzierski

    2016-06-01

    Full Text Available The aim of this research was to assess the possibility of conducting an absolute orientation procedure for video imagery, in which the external orientation for the first image was typical for aerial photogrammetry whereas the external orientation of the second was typical for terrestrial photogrammetry. Starting from the collinearity equations, assuming that the camera tilt angle is equal to 90°, a simplified mathematical model is proposed. The proposed method can be used to determine the X, Y, Z coordinates of points based on a set of collinearity equations of a pair of images. The use of simplified collinearity equations can considerably shorten the processing tine of image data from Unmanned Aerial Vehicles (UAVs, especially in low cost systems. The conducted experiments have shown that it is possible to carry out a complete photogrammetric project of an architectural structure using a camera tilted 85°–90° ( φ or ω and simplified collinearity equations. It is also concluded that there is a correlation between the speed of the UAV and the discrepancy between the established and actual camera tilt angles.

  10. Weed detection by UAV with camera guided landing sequence

    DEFF Research Database (Denmark)

    Dyrmann, Mads

    UAVs gain more and more currency in agriculture, as they allow for inspection of even remote areas of farmland. Measurements of weed occurrence in fields is one branch of this growing field of research. A problem with UAVs is that they have a limited energy capacity: Consequently, after a short...... flight, they must return to the farm to charge. By installing a landing platform in the field it is possible to have charging facilities close to the area where the UAV is used, providing greater opportunity for autonomous flight in distant fields. A landing platform in the field will also allow...... for greater computing capacity, whereby collected images can be processed and appropriate actions can be taken. The present study uses an entry level UAV with a Pixhawk controller and a GPS specified with an accuracy of 2.5m, meaning that the GPS alone is not sufficient to coordinate the UAV landing. Using...

  11. GIF Video Sentiment Detection Using Semantic Sequence

    Directory of Open Access Journals (Sweden)

    Dazhen Lin

    2017-01-01

    Full Text Available With the development of social media, an increasing number of people use short videos in social media applications to express their opinions and sentiments. However, sentiment detection of short videos is a very challenging task because of the semantic gap problem and sequence based sentiment understanding problem. In this context, we propose a SentiPair Sequence based GIF video sentiment detection approach with two contributions. First, we propose a Synset Forest method to extract sentiment related semantic concepts from WordNet to build a robust SentiPair label set. This approach considers the semantic gap between label words and selects a robust label subset which is related to sentiment. Secondly, we propose a SentiPair Sequence based GIF video sentiment detection approach that learns the semantic sequence to understand the sentiment from GIF videos. Our experiment results on GSO-2016 (GIF Sentiment Ontology data show that our approach not only outperforms four state-of-the-art classification methods but also shows better performance than the state-of-the-art middle level sentiment ontology features, Adjective Noun Pairs (ANPs.

  12. Using crowd sourcing to combat potentially illegal or dangerous UAV operations

    Science.gov (United States)

    Tapsall, Brooke T.

    2016-10-01

    The UAV (Unmanned Aerial Vehicles) industry is growing exponentially at a pace that policy makers, individual countries and law enforcement agencies are finding difficult to keep up. The UAV market is large, as such the amount of UAVs being operated in potentially dangerous situations is prevalent and rapidly increasing. Media is continually reporting `near-miss' incidents between UAVs and commercial aircraft, UAV breaching security in sensitive areas or invading public privacy. One major challenge for law enforcement agencies is gaining tangible evidence against potentially dangerous or illegal UAV operators due to the rapidity with which UAV operators are able to enter, fly and exit a scene before authorities can arrive or before they can be located. DroneALERT, an application available via the Airport-UAV.com website, allows users to capture potentially dangerous or illegal UAV activity using their mobile device as it the incident is occurring. A short online DroneALERT Incident Report (DIR) is produced, emailed to the user and the Airport-UAV.com custodians. The DIR can be used to aid authorities in their investigations. The DIR contains details such as images and videos, location, time, date of the incident, drone model, its distance and height. By analysing information from the DIR, photos or video, there is a high potential for law enforcement authorities to use this evidence to identify the type of UAV used, triangulate the location of the potential dangerous UAV and operator, create a timeline of events, potential areas of operator exit and to determine the legalities breached. All provides crucial evidence for identifying and prosecuting a UAV operator.

  13. Airborne Video Surveillance

    National Research Council Canada - National Science Library

    Blask, Steven

    2002-01-01

    The DARPA Airborne Video Surveillance (AVS) program was established to develop and promote technologies to make airborne video more useful, providing capabilities that achieve a UAV force multiplier...

  14. UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment.

    Science.gov (United States)

    Chen, Jessie Y C

    2010-08-01

    A military reconnaissance environment was simulated to examine the performance of ground robotics operators who were instructed to utilise streaming video from an unmanned aerial vehicle (UAV) to navigate his/her ground robot to the locations of the targets. The effects of participants' spatial ability on their performance and workload were also investigated. Results showed that participants' overall performance (speed and accuracy) was better when she/he had access to images from larger UAVs with fixed orientations, compared with other UAV conditions (baseline- no UAV, micro air vehicle and UAV with orbiting views). Participants experienced the highest workload when the UAV was orbiting. Those individuals with higher spatial ability performed significantly better and reported less workload than those with lower spatial ability. The results of the current study will further understanding of ground robot operators' target search performance based on streaming video from UAVs. The results will also facilitate the implementation of ground/air robots in military environments and will be useful to the future military system design and training community.

  15. New generation of human machine interfaces for controlling UAV through depth-based gesture recognition

    Science.gov (United States)

    Mantecón, Tomás.; del Blanco, Carlos Roberto; Jaureguizar, Fernando; García, Narciso

    2014-06-01

    New forms of natural interactions between human operators and UAVs (Unmanned Aerial Vehicle) are demanded by the military industry to achieve a better balance of the UAV control and the burden of the human operator. In this work, a human machine interface (HMI) based on a novel gesture recognition system using depth imagery is proposed for the control of UAVs. Hand gesture recognition based on depth imagery is a promising approach for HMIs because it is more intuitive, natural, and non-intrusive than other alternatives using complex controllers. The proposed system is based on a Support Vector Machine (SVM) classifier that uses spatio-temporal depth descriptors as input features. The designed descriptor is based on a variation of the Local Binary Pattern (LBP) technique to efficiently work with depth video sequences. Other major consideration is the especial hand sign language used for the UAV control. A tradeoff between the use of natural hand signs and the minimization of the inter-sign interference has been established. Promising results have been achieved in a depth based database of hand gestures especially developed for the validation of the proposed system.

  16. A Robust Vision-based Runway Detection and Tracking Algorithm for Automatic UAV Landing

    KAUST Repository

    Abu Jbara, Khaled F.

    2015-05-01

    This work presents a novel real-time algorithm for runway detection and tracking applied to the automatic takeoff and landing of Unmanned Aerial Vehicles (UAVs). The algorithm is based on a combination of segmentation based region competition and the minimization of a specific energy function to detect and identify the runway edges from streaming video data. The resulting video-based runway position estimates are updated using a Kalman Filter, which can integrate other sensory information such as position and attitude angle estimates to allow a more robust tracking of the runway under turbulence. We illustrate the performance of the proposed lane detection and tracking scheme on various experimental UAV flights conducted by the Saudi Aerospace Research Center. Results show an accurate tracking of the runway edges during the landing phase under various lighting conditions. Also, it suggests that such positional estimates would greatly improve the positional accuracy of the UAV during takeoff and landing phases. The robustness of the proposed algorithm is further validated using Hardware in the Loop simulations with diverse takeoff and landing videos generated using a commercial flight simulator.

  17. Design of Electric Patrol UAVs Based on a Dual Antenna System

    Directory of Open Access Journals (Sweden)

    Yongjie Zhai

    2018-04-01

    Full Text Available China completed the construction of more than 1.15 million kilometers of transmission lines with conventional voltage levels spanning its vast territory in 2014. This large and complicated power grid structure relies mainly on manual operation and maintenance of lines. Unmanned aerial vehicles (UAVs equipped with high-definition digital video cameras and cameras and GPS positioning systems can conduct autonomous patrols along the grid. However, the presence of electromagnetic fields around high-voltage transmission lines can affect the UAV’s magnetometer, resulting in a wrong heading and thus unsafe flight. In this paper, the traditional method of UAV heading calculation using a magnetometer was analyzed, and a novel method for calculating UAV heading based on dual antennas was proposed. Experimental data showed that the proposed method improves the anti-magnetic interference characteristics of UAVs and increases UAV security and stability for power inspection applications.

  18. VOX POPULI: Automatic Generation of Biased Video Sequences

    NARCIS (Netherlands)

    S. Bocconi; F.-M. Nack (Frank)

    2004-01-01

    textabstractWe describe our experimental rhetoric engine Vox Populi that generates biased video-sequences from a repository of video interviews and other related audio-visual web sources. Users are thus able to explore their own opinions on controversial topics covered by the repository. The

  19. VOX POPULI: automatic generation of biased video sequences

    NARCIS (Netherlands)

    S. Bocconi; F.-M. Nack (Frank)

    2004-01-01

    textabstractWe describe our experimental rhetoric engine Vox Populi that generates biased video-sequences from a repository of video interviews and other related audio-visual web sources. Users are thus able to explore their own opinions on controversial topics covered by the repository. The

  20. Tracking, aiming, and hitting the UAV with ordinary assault rifle

    Science.gov (United States)

    Racek, František; Baláž, Teodor; Krejčí, Jaroslav; Procházka, Stanislav; Macko, Martin

    2017-10-01

    The usage small-unmanned aerial vehicles (UAVs) is significantly increasing nowadays. They are being used as a carrier of military spy and reconnaissance devices (taking photos, live video streaming and so on), or as a carrier of potentially dangerous cargo (intended for destruction and killing). Both ways of utilizing the UAV cause the necessity to disable it. From the military point of view, to disable the UAV means to bring it down by a weapon of an ordinary soldier that is the assault rifle. This task can be challenging for the soldier because he needs visually detect and identify the target, track the target visually and aim on the target. The final success of the soldier's mission depends not only on the said visual tasks, but also on the properties of the weapon and ammunition. The paper deals with possible methods of prediction of probability of hitting the UAV targets.

  1. UAV Trajectory Modeling Using Neural Networks

    Science.gov (United States)

    Xue, Min

    2017-01-01

    Large amount of small Unmanned Aerial Vehicles (sUAVs) are projected to operate in the near future. Potential sUAV applications include, but not limited to, search and rescue, inspection and surveillance, aerial photography and video, precision agriculture, and parcel delivery. sUAVs are expected to operate in the uncontrolled Class G airspace, which is at or below 500 feet above ground level (AGL), where many static and dynamic constraints exist, such as ground properties and terrains, restricted areas, various winds, manned helicopters, and conflict avoidance among sUAVs. How to enable safe, efficient, and massive sUAV operations at the low altitude airspace remains a great challenge. NASA's Unmanned aircraft system Traffic Management (UTM) research initiative works on establishing infrastructure and developing policies, requirement, and rules to enable safe and efficient sUAVs' operations. To achieve this goal, it is important to gain insights of future UTM traffic operations through simulations, where the accurate trajectory model plays an extremely important role. On the other hand, like what happens in current aviation development, trajectory modeling should also serve as the foundation for any advanced concepts and tools in UTM. Accurate models of sUAV dynamics and control systems are very important considering the requirement of the meter level precision in UTM operations. The vehicle dynamics are relatively easy to derive and model, however, vehicle control systems remain unknown as they are usually kept by manufactures as a part of intellectual properties. That brings challenges to trajectory modeling for sUAVs. How to model the vehicle's trajectories with unknown control system? This work proposes to use a neural network to model a vehicle's trajectory. The neural network is first trained to learn the vehicle's responses at numerous conditions. Once being fully trained, given current vehicle states, winds, and desired future trajectory, the neural

  2. On the relationship between perceptual impact of source and channel distortions in video sequences

    DEFF Research Database (Denmark)

    Korhonen, Jari; Reiter, Ulrich; You, Junyong

    2010-01-01

    It is known that peak signal-to-noise ratio (PSNR) can be used for assessing the relative qualities of distorted video sequences meaningfully only if the compared sequences contain similar types of distortions. In this paper, we propose a model for rough assessment of the bias in PSNR results, when...... video sequences with both channel and source distortion are compared against video sequences with source distortion only. The proposed method can be used to compare the relative perceptual quality levels of video sequences with different distortion types more reliably than using plain PSNR....

  3. Focus-of-attention for human activity recognition from UAVs

    NARCIS (Netherlands)

    Burghouts, G.J.; Eekeren, A.W.M. van; Dijk, J.

    2014-01-01

    This paper presents a system to extract metadata about human activities from full-motion video recorded from a UAV. The pipeline consists of these components: tracking, motion features, representation of the tracks in terms of their motion features, and classification of each track as one of the

  4. Rapid 3D Reconstruction for Image Sequence Acquired from UAV Camera

    Directory of Open Access Journals (Sweden)

    Yufu Qu

    2018-01-01

    Full Text Available In order to reconstruct three-dimensional (3D structures from an image sequence captured by unmanned aerial vehicles’ camera (UAVs and improve the processing speed, we propose a rapid 3D reconstruction method that is based on an image queue, considering the continuity and relevance of UAV camera images. The proposed approach first compresses the feature points of each image into three principal component points by using the principal component analysis method. In order to select the key images suitable for 3D reconstruction, the principal component points are used to estimate the interrelationships between images. Second, these key images are inserted into a fixed-length image queue. The positions and orientations of the images are calculated, and the 3D coordinates of the feature points are estimated using weighted bundle adjustment. With this structural information, the depth maps of these images can be calculated. Next, we update the image queue by deleting some of the old images and inserting some new images into the queue, and a structural calculation of all the images can be performed by repeating the previous steps. Finally, a dense 3D point cloud can be obtained using the depth–map fusion method. The experimental results indicate that when the texture of the images is complex and the number of images exceeds 100, the proposed method can improve the calculation speed by more than a factor of four with almost no loss of precision. Furthermore, as the number of images increases, the improvement in the calculation speed will become more noticeable.

  5. Rapid 3D Reconstruction for Image Sequence Acquired from UAV Camera.

    Science.gov (United States)

    Qu, Yufu; Huang, Jianyu; Zhang, Xuan

    2018-01-14

    In order to reconstruct three-dimensional (3D) structures from an image sequence captured by unmanned aerial vehicles' camera (UAVs) and improve the processing speed, we propose a rapid 3D reconstruction method that is based on an image queue, considering the continuity and relevance of UAV camera images. The proposed approach first compresses the feature points of each image into three principal component points by using the principal component analysis method. In order to select the key images suitable for 3D reconstruction, the principal component points are used to estimate the interrelationships between images. Second, these key images are inserted into a fixed-length image queue. The positions and orientations of the images are calculated, and the 3D coordinates of the feature points are estimated using weighted bundle adjustment. With this structural information, the depth maps of these images can be calculated. Next, we update the image queue by deleting some of the old images and inserting some new images into the queue, and a structural calculation of all the images can be performed by repeating the previous steps. Finally, a dense 3D point cloud can be obtained using the depth-map fusion method. The experimental results indicate that when the texture of the images is complex and the number of images exceeds 100, the proposed method can improve the calculation speed by more than a factor of four with almost no loss of precision. Furthermore, as the number of images increases, the improvement in the calculation speed will become more noticeable.

  6. Image-based tracking and sensor resource management for UAVs in an urban environment

    Science.gov (United States)

    Samant, Ashwin; Chang, K. C.

    2010-04-01

    Coordination and deployment of multiple unmanned air vehicles (UAVs) requires a lot of human resources in order to carry out a successful mission. The complexity of such a surveillance mission is significantly increased in the case of an urban environment where targets can easily escape from the UAV's field of view (FOV) due to intervening building and line-of-sight obstruction. In the proposed methodology, we focus on the control and coordination of multiple UAVs having gimbaled video sensor onboard for tracking multiple targets in an urban environment. We developed optimal path planning algorithms with emphasis on dynamic target prioritizations and persistent target updates. The command center is responsible for target prioritization and autonomous control of multiple UAVs, enabling a single operator to monitor and control a team of UAVs from a remote location. The results are obtained using extensive 3D simulations in Google Earth using Tangent plus Lyapunov vector field guidance for target tracking.

  7. Yellow River Icicle Hazard Dynamic Monitoring Using UAV Aerial Remote Sensing Technology

    International Nuclear Information System (INIS)

    Wang, H B; Wang, G H; Tang, X M; Li, C H

    2014-01-01

    Monitoring the response of Yellow River icicle hazard change requires accurate and repeatable topographic surveys. A new method based on unmanned aerial vehicle (UAV) aerial remote sensing technology is proposed for real-time data processing in Yellow River icicle hazard dynamic monitoring. The monitoring area is located in the Yellow River ice intensive care area in southern BaoTou of Inner Mongolia autonomous region. Monitoring time is from the 20th February to 30th March in 2013. Using the proposed video data processing method, automatic extraction covering area of 7.8 km 2 of video key frame image 1832 frames took 34.786 seconds. The stitching and correcting time was 122.34 seconds and the accuracy was better than 0.5 m. Through the comparison of precise processing of sequence video stitching image, the method determines the change of the Yellow River ice and locates accurate positioning of ice bar, improving the traditional visual method by more than 100 times. The results provide accurate aid decision information for the Yellow River ice prevention headquarters. Finally, the effect of dam break is repeatedly monitored and ice break five meter accuracy is calculated through accurate monitoring and evaluation analysis

  8. Binocular video ophthalmoscope for simultaneous recording of sequences of the human retina to compare dynamic parameters

    Science.gov (United States)

    Tornow, Ralf P.; Milczarek, Aleksandra; Odstrcilik, Jan; Kolar, Radim

    2017-07-01

    A parallel video ophthalmoscope was developed to acquire short video sequences (25 fps, 250 frames) of both eyes simultaneously with exact synchronization. Video sequences were registered off-line to compensate for eye movements. From registered video sequences dynamic parameters like cardiac cycle induced reflection changes and eye movements can be calculated and compared between eyes.

  9. Autonomous Control of a Quadrotor UAV Using Fuzzy Logic

    Science.gov (United States)

    Sureshkumar, Vijaykumar

    UAVs are being increasingly used today than ever before in both military and civil applications. They are heavily preferred in "dull, dirty or dangerous" mission scenarios. Increasingly, UAVs of all kinds are being used in policing, fire-fighting, inspection of structures, pipelines etc. Recently, the FAA gave its permission for UAVs to be used on film sets for motion capture and high definition video recording. The rapid development in MEMS and actuator technology has made possible a plethora of UAVs that are suited for commercial applications in an increasingly cost effective manner. An emerging popular rotary wing UAV platform is the Quadrotor A Quadrotor is a helicopter with four rotors, that make it more stable; but more complex to model and control. Characteristics that provide a clear advantage over other fixed wing UAVs are VTOL and hovering capabilities as well as a greater maneuverability. It is also simple in construction and design compared to a scaled single rotorcraft. Flying such UAVs using a traditional radio Transmitter-Receiver setup can be a daunting task especially in high stress situations. In order to make such platforms widely applicable, a certain level of autonomy is imperative to the future of such UAVs. This thesis paper presents a methodology for the autonomous control of a Quadrotor UAV using Fuzzy Logic. Fuzzy logic control has been chosen over conventional control methods as it can deal effectively with highly nonlinear systems, allows for imprecise data and is extremely modular. Modularity and adaptability are the key cornerstones of FLC. The objective of this thesis is to present the steps of designing, building and simulating an intelligent flight control module for a Quadrotor UAV. In the course of this research effort, a Quadrotor UAV is indigenously developed utilizing the resources of an online open source project called Aeroquad. System design is comprehensively dealt with. A math model for the Quadrotor is developed and a

  10. Teaching UAVs to Race With Observational Imitation Learning

    KAUST Repository

    Li, Guohao; Mueller, Matthias; Casser, Vincent; Smith, Neil; Michels, Dominik L.; Ghanem, Bernard

    2018-01-01

    Recent work has tackled the problem of autonomous navigation by imitating a teacher and learning an end-to-end policy, which directly predicts controls from raw images. However, these approaches tend to be sensitive to mistakes by the teacher and do not scale well to other environments or vehicles. To this end, we propose a modular network architecture that decouples perception from control, and is trained using Observational Imitation Learning (OIL), a novel imitation learning variant that supports online training and automatic selection of optimal behavior from observing multiple teachers. We apply our proposed methodology to the challenging problem of unmanned aerial vehicle (UAV) racing. We develop a simulator that enables the generation of large amounts of synthetic training data (both UAV captured images and its controls) and also allows for online learning and evaluation. We train a perception network to predict waypoints from raw image data and a control network to predict UAV controls from these waypoints using OIL. Our modular network is able to autonomously fly a UAV through challenging race tracks at high speeds. Extensive experiments demonstrate that our trained network outperforms its teachers, end-to-end baselines, and even human pilots in simulation. The supplementary video can be viewed at https://youtu.be/PeTXSoriflc

  11. Teaching UAVs to Race With Observational Imitation Learning

    KAUST Repository

    Li, Guohao

    2018-03-03

    Recent work has tackled the problem of autonomous navigation by imitating a teacher and learning an end-to-end policy, which directly predicts controls from raw images. However, these approaches tend to be sensitive to mistakes by the teacher and do not scale well to other environments or vehicles. To this end, we propose a modular network architecture that decouples perception from control, and is trained using Observational Imitation Learning (OIL), a novel imitation learning variant that supports online training and automatic selection of optimal behavior from observing multiple teachers. We apply our proposed methodology to the challenging problem of unmanned aerial vehicle (UAV) racing. We develop a simulator that enables the generation of large amounts of synthetic training data (both UAV captured images and its controls) and also allows for online learning and evaluation. We train a perception network to predict waypoints from raw image data and a control network to predict UAV controls from these waypoints using OIL. Our modular network is able to autonomously fly a UAV through challenging race tracks at high speeds. Extensive experiments demonstrate that our trained network outperforms its teachers, end-to-end baselines, and even human pilots in simulation. The supplementary video can be viewed at https://youtu.be/PeTXSoriflc

  12. Finding and Improving the Key-Frames of Long Video Sequences for Face Recognition

    DEFF Research Database (Denmark)

    Nasrollahi, Kamal; Moeslund, Thomas B.

    2010-01-01

    Face recognition systems are very sensitive to the quality and resolution of their input face images. This makes such systems unreliable when working with long surveillance video sequences without employing some selection and enhancement algorithms. On the other hand, processing all the frames...... of such video sequences by any enhancement or even face recognition algorithm is demanding. Thus, there is a need for a mechanism to summarize the input video sequence to a set of key-frames and then applying an enhancement algorithm to this subset. This paper presents a system doing exactly this. The system...... uses face quality assessment to select the key-frames and a hybrid super-resolution to enhance the face image quality. The suggested system that employs a linear associator face recognizer to evaluate the enhanced results has been tested on real surveillance video sequences and the experimental results...

  13. Flight route Designing and mission planning Of power line inspecting system Based On multi-sensor UAV

    International Nuclear Information System (INIS)

    Xiaowei, Xie; Zhengjun, Liu; Zhiquan, Zuo

    2014-01-01

    In order to obtain various information of power facilities such as spatial location, geometry, images data and video information in the infrared and ultraviolet band and so on, Unmanned Aerial Vehicle (UAV) power line inspecting system needs to integrate a variety of sensors for data collection. Low altitude and side-looking imaging are required for UAV flight to ensure sensors to acquire high-quality data and device security. In this paper, UAV power line inspecting system is deferent from existing ones that used in Surveying and Mapping. According to characteristics of UAV for example equipped multiple sensor, side-looking imaging, working at low altitude, complex terrain conditions and corridor type flight, this paper puts forward a UAV power line inspecting scheme which comprehensively considered of the UAV performance, sensor parameters and task requirements. The scheme is finally tested in a region of Guangdong province, and the preliminary results show that the scheme is feasible

  14. MAP Estimation of Chin and Cheek Contours in Video Sequences

    Directory of Open Access Journals (Sweden)

    Kampmann Markus

    2004-01-01

    Full Text Available An algorithm for the estimation of chin and cheek contours in video sequences is proposed. This algorithm exploits a priori knowledge about shape and position of chin and cheek contours in images. Exploiting knowledge about the shape, a parametric 2D model representing chin and cheek contours is introduced. Exploiting knowledge about the position, a MAP estimator is developed taking into account the observed luminance gradient as well as a priori probabilities of chin and cheek contours positions. The proposed algorithm was tested with head and shoulder video sequences (image resolution CIF. In nearly 70% of all investigated video frames, a subjectively error free estimation could be achieved. The 2D estimate error is measured as on average between 2.4 and .

  15. Augmented Reality Tool for the Situational Awareness Improvement of UAV Operators

    Science.gov (United States)

    Ruano, Susana; Cuevas, Carlos; Gallego, Guillermo; García, Narciso

    2017-01-01

    Unmanned Aerial Vehicles (UAVs) are being extensively used nowadays. Therefore, pilots of traditional aerial platforms should adapt their skills to operate them from a Ground Control Station (GCS). Common GCSs provide information in separate screens: one presents the video stream while the other displays information about the mission plan and information coming from other sensors. To avoid the burden of fusing information displayed in the two screens, an Augmented Reality (AR) tool is proposed in this paper. The AR system has two functionalities for Medium-Altitude Long-Endurance (MALE) UAVs: route orientation and target identification. Route orientation allows the operator to identify the upcoming waypoints and the path that the UAV is going to follow. Target identification allows a fast target localization, even in the presence of occlusions. The AR tool is implemented following the North Atlantic Treaty Organization (NATO) standards so that it can be used in different GCSs. The experiments show how the AR tool improves significantly the situational awareness of the UAV operators. PMID:28178189

  16. Key Issues in Modeling of Complex 3D Structures from Video Sequences

    Directory of Open Access Journals (Sweden)

    Shengyong Chen

    2012-01-01

    Full Text Available Construction of three-dimensional structures from video sequences has wide applications for intelligent video analysis. This paper summarizes the key issues of the theory and surveys the recent advances in the state of the art. Reconstruction of a scene object from video sequences often takes the basic principle of structure from motion with an uncalibrated camera. This paper lists the typical strategies and summarizes the typical solutions or algorithms for modeling of complex three-dimensional structures. Open difficult problems are also suggested for further study.

  17. Tracking of Individuals in Very Long Video Sequences

    DEFF Research Database (Denmark)

    Fihl, Preben; Corlin, Rasmus; Park, Sangho

    2006-01-01

    In this paper we present an approach for automatically detecting and tracking humans in very long video sequences. The detection is based on background subtraction using a multi-mode Codeword method. We enhance this method both in terms of representation and in terms of automatically updating...

  18. Development of a UAV-LiDAR System with Application to Forest Inventory

    Directory of Open Access Journals (Sweden)

    Darren Turner

    2012-05-01

    Full Text Available We present the development of a low-cost Unmanned Aerial Vehicle-Light Detecting and Ranging (UAV-LiDAR system and an accompanying workflow to produce 3D point clouds. UAV systems provide an unrivalled combination of high temporal and spatial resolution datasets. The TerraLuma UAV-LiDAR system has been developed to take advantage of these properties and in doing so overcome some of the current limitations of the use of this technology within the forestry industry. A modified processing workflow including a novel trajectory determination algorithm fusing observations from a GPS receiver, an Inertial Measurement Unit (IMU and a High Definition (HD video camera is presented. The advantages of this workflow are demonstrated using a rigorous assessment of the spatial accuracy of the final point clouds. It is shown that due to the inclusion of video the horizontal accuracy of the final point cloud improves from 0.61 m to 0.34 m (RMS error assessed against ground control. The effect of the very high density point clouds (up to 62 points per m2 produced by the UAV-LiDAR system on the measurement of tree location, height and crown width are also assessed by performing repeat surveys over individual isolated trees. The standard deviation of tree height is shown to reduce from 0.26 m, when using data with a density of 8 points perm2, to 0.15mwhen the higher density data was used. Improvements in the uncertainty of the measurement of tree location, 0.80 m to 0.53 m, and crown width, 0.69 m to 0.61 m are also shown.

  19. Study of the Subjective Visibility of Packet Loss Artifacts in Decoded Video Sequences

    DEFF Research Database (Denmark)

    Korhonen, Jari

    2018-01-01

    Packet loss is a significant cause of visual impairments in video broadcasting over packet-switched networks. There are several subjective and objective video quality assessment methods focused on the overall perception of video quality. However, less attention has been paid on the visibility...... of packet loss artifacts appearing in spatially and temporally limited regions of a video sequence. In this paper, we present the results of a subjective study, using a methodology where a video sequence is displayed on a touchscreen and the users tap it in the positions where they observe artifacts. We...... also analyze the objective features derived from those artifacts, and propose different models for combining those features into an objective metric for assessing the noticeability of the artifacts. The practical results show that the proposed metric predicts visibility of packet loss impairments...

  20. Coding visual features extracted from video sequences.

    Science.gov (United States)

    Baroffio, Luca; Cesana, Matteo; Redondi, Alessandro; Tagliasacchi, Marco; Tubaro, Stefano

    2014-05-01

    Visual features are successfully exploited in several applications (e.g., visual search, object recognition and tracking, etc.) due to their ability to efficiently represent image content. Several visual analysis tasks require features to be transmitted over a bandwidth-limited network, thus calling for coding techniques to reduce the required bit budget, while attaining a target level of efficiency. In this paper, we propose, for the first time, a coding architecture designed for local features (e.g., SIFT, SURF) extracted from video sequences. To achieve high coding efficiency, we exploit both spatial and temporal redundancy by means of intraframe and interframe coding modes. In addition, we propose a coding mode decision based on rate-distortion optimization. The proposed coding scheme can be conveniently adopted to implement the analyze-then-compress (ATC) paradigm in the context of visual sensor networks. That is, sets of visual features are extracted from video frames, encoded at remote nodes, and finally transmitted to a central controller that performs visual analysis. This is in contrast to the traditional compress-then-analyze (CTA) paradigm, in which video sequences acquired at a node are compressed and then sent to a central unit for further processing. In this paper, we compare these coding paradigms using metrics that are routinely adopted to evaluate the suitability of visual features in the context of content-based retrieval, object recognition, and tracking. Experimental results demonstrate that, thanks to the significant coding gains achieved by the proposed coding scheme, ATC outperforms CTA with respect to all evaluation metrics.

  1. APPLICABILITY ANALYSIS OF THE PHASE CORRELATION ALGORITHM FOR STABILIZATION OF VIDEO FRAMES SEQUENCES FOR CAPILLARY BLOOD FLOW

    Directory of Open Access Journals (Sweden)

    K. A. Karimov

    2016-05-01

    Full Text Available Videocapillaroscopy is a convenient and non-invasive method of blood flow parameters recovery in the capillaries. Capillaries position can vary at recorded video sequences due to the registration features of capillary blood flow. Stabilization algorithm of video capillary blood flow based on phase correlation is proposed and researched. This algorithm is compared to the known algorithms of video frames stabilization with full-frame superposition and with key points. Programs, based on discussed algorithms, are compared under processing the experimentally recorded video sequences of human capillaries and under processing of computer-simulated sequences of video frames with the specified offset. The full-frame superposition algorithm provides high quality of stabilization; however, the program based on this algorithm requires significant computational resources. Software implementation of the algorithm based on the detection of the key points is characterized by good performance, but provides low quality of stabilization for video sequences capillary blood flow. Algorithm based on phase correlation method provides high quality of stabilization and program realization of this algorithm requires minimal computational resources. It is shown that the phase correlation algorithm is the most useful for stabilization of video sequences for capillaries blood flow. Obtained findings can be used in the software for biomedical diagnostics.

  2. Heart rate measurement based on face video sequence

    Science.gov (United States)

    Xu, Fang; Zhou, Qin-Wu; Wu, Peng; Chen, Xing; Yang, Xiaofeng; Yan, Hong-jian

    2015-03-01

    This paper proposes a new non-contact heart rate measurement method based on photoplethysmography (PPG) theory. With this method we can measure heart rate remotely with a camera and ambient light. We collected video sequences of subjects, and detected remote PPG signals through video sequences. Remote PPG signals were analyzed with two methods, Blind Source Separation Technology (BSST) and Cross Spectral Power Technology (CSPT). BSST is a commonly used method, and CSPT is used for the first time in the study of remote PPG signals in this paper. Both of the methods can acquire heart rate, but compared with BSST, CSPT has clearer physical meaning, and the computational complexity of CSPT is lower than that of BSST. Our work shows that heart rates detected by CSPT method have good consistency with the heart rates measured by a finger clip oximeter. With good accuracy and low computational complexity, the CSPT method has a good prospect for the application in the field of home medical devices and mobile health devices.

  3. Cloud-Assisted UAV Data Collection for Multiple Emerging Events in Distributed WSNs.

    Science.gov (United States)

    Cao, Huiru; Liu, Yongxin; Yue, Xuejun; Zhu, Wenjian

    2017-08-07

    In recent years, UAVs (Unmanned Aerial Vehicles) have been widely applied for data collection and image capture. Specifically, UAVs have been integrated with wireless sensor networks (WSNs) to create data collection platforms with high flexibility. However, most studies in this domain focus on system architecture and UAVs' flight trajectory planning while event-related factors and other important issues are neglected. To address these challenges, we propose a cloud-assisted data gathering strategy for UAV-based WSN in the light of emerging events. We also provide a cloud-assisted approach for deriving UAV's optimal flying and data acquisition sequence of a WSN cluster. We validate our approach through simulations and experiments. It has been proved that our methodology outperforms conventional approaches in terms of flying time, energy consumption, and integrity of data acquisition. We also conducted a real-world experiment using a UAV to collect data wirelessly from multiple clusters of sensor nodes for monitoring an emerging event, which are deployed in a farm. Compared against the traditional method, this proposed approach requires less than half the flying time and achieves almost perfect data integrity.

  4. CONTEXT-BASED URBAN TERRAIN RECONSTRUCTION FROM UAV-VIDEOS FOR GEOINFORMATION APPLICATIONS

    Directory of Open Access Journals (Sweden)

    D. Bulatov

    2012-09-01

    Full Text Available Urban terrain reconstruction has many applications in areas of civil engineering, urban planning, surveillance and defense research. Therefore the needs of covering ad-hoc demand and performing a close-range urban terrain reconstruction with miniaturized and relatively inexpensive sensor platforms are constantly growing. Using (miniaturized unmanned aerial vehicles, (MUAVs, represents one of the most attractive alternatives to conventional large-scale aerial imagery. We cover in this paper a four-step procedure of obtaining georeferenced 3D urban models from video sequences. The four steps of the procedure – orientation, dense reconstruction, urban terrain modeling and geo-referencing – are robust, straight-forward, and nearly fully-automatic. The two last steps – namely, urban terrain modeling from almost-nadir videos and co-registration of models 6ndash; represent the main contribution of this work and will therefore be covered with more detail. The essential substeps of the third step include digital terrain model (DTM extraction, segregation of buildings from vegetation, as well as instantiation of building and tree models. The last step is subdivided into quasi- intrasensorial registration of Euclidean reconstructions and intersensorial registration with a geo-referenced orthophoto. Finally, we present reconstruction results from a real data-set and outline ideas for future work.

  5. HIERARCHICAL ADAPTIVE ROOD PATTERN SEARCH FOR MOTION ESTIMATION AT VIDEO SEQUENCE ANALYSIS

    Directory of Open Access Journals (Sweden)

    V. T. Nguyen

    2016-05-01

    Full Text Available Subject of Research.The paper deals with the motion estimation algorithms for the analysis of video sequences in compression standards MPEG-4 Visual and H.264. Anew algorithm has been offered based on the analysis of the advantages and disadvantages of existing algorithms. Method. Thealgorithm is called hierarchical adaptive rood pattern search (Hierarchical ARPS, HARPS. This new algorithm includes the classic adaptive rood pattern search ARPS and hierarchical search MP (Hierarchical search or Mean pyramid. All motion estimation algorithms have been implemented using MATLAB package and tested with several video sequences. Main Results. The criteria for evaluating the algorithms were: speed, peak signal to noise ratio, mean square error and mean absolute deviation. The proposed method showed a much better performance at a comparable error and deviation. The peak signal to noise ratio in different video sequences shows better and worse results than characteristics of known algorithms so it requires further investigation. Practical Relevance. Application of this algorithm in MPEG-4 and H.264 codecs instead of the standard can significantly reduce compression time. This feature enables to recommend it in telecommunication systems for multimedia data storing, transmission and processing.

  6. Video-to-Video Dynamic Super-Resolution for Grayscale and Color Sequences

    Directory of Open Access Journals (Sweden)

    Elad Michael

    2006-01-01

    Full Text Available We address the dynamic super-resolution (SR problem of reconstructing a high-quality set of monochromatic or color super-resolved images from low-quality monochromatic, color, or mosaiced frames. Our approach includes a joint method for simultaneous SR, deblurring, and demosaicing, this way taking into account practical color measurements encountered in video sequences. For the case of translational motion and common space-invariant blur, the proposed method is based on a very fast and memory efficient approximation of the Kalman filter (KF. Experimental results on both simulated and real data are supplied, demonstrating the presented algorithms, and their strength.

  7. Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data

    Directory of Open Access Journals (Sweden)

    Xiangyu Zhuo

    2017-04-01

    Full Text Available Recent years have witnessed the fast development of UAVs (unmanned aerial vehicles. As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing accuracy of UAVs is still limited by the low-performance on-board GNSS and INS. This paper investigates automatic geo-registration of an individual UAV image or UAV image blocks by matching the UAV image(s with a previously taken georeferenced image, such as an individual aerial or satellite image with a height map attached or an aerial orthophoto with a DSM (digital surface model attached. As the biggest challenge for matching UAV and aerial images is in the large differences in scale and rotation, we propose a novel feature matching method for nadir or slightly tilted images. The method is comprised of a dense feature detection scheme, a one-to-many matching strategy and a global geometric verification scheme. The proposed method is able to find thousands of valid matches in cases where SIFT and ASIFT fail. Those matches can be used to geo-register the whole UAV image block towards the reference image data. When the reference images offer high georeferencing accuracy, the UAV images can also be geolocalized in a global coordinate system. A series of experiments involving different scenarios was conducted to validate the proposed method. The results demonstrate that our approach achieves not only decimeter-level registration accuracy, but also comparable global accuracy as the reference images.

  8. A novel visual saliency detection method for infrared video sequences

    Science.gov (United States)

    Wang, Xin; Zhang, Yuzhen; Ning, Chen

    2017-12-01

    Infrared video applications such as target detection and recognition, moving target tracking, and so forth can benefit a lot from visual saliency detection, which is essentially a method to automatically localize the ;important; content in videos. In this paper, a novel visual saliency detection method for infrared video sequences is proposed. Specifically, for infrared video saliency detection, both the spatial saliency and temporal saliency are considered. For spatial saliency, we adopt a mutual consistency-guided spatial cues combination-based method to capture the regions with obvious luminance contrast and contour features. For temporal saliency, a multi-frame symmetric difference approach is proposed to discriminate salient moving regions of interest from background motions. Then, the spatial saliency and temporal saliency are combined to compute the spatiotemporal saliency using an adaptive fusion strategy. Besides, to highlight the spatiotemporal salient regions uniformly, a multi-scale fusion approach is embedded into the spatiotemporal saliency model. Finally, a Gestalt theory-inspired optimization algorithm is designed to further improve the reliability of the final saliency map. Experimental results demonstrate that our method outperforms many state-of-the-art saliency detection approaches for infrared videos under various backgrounds.

  9. Practical and Scalable Transmission of Segmented Video Sequences to Multiple Players Using H.264

    Science.gov (United States)

    Quax, Peter; di Fiore, Fabian; Issaris, Panagiotis; Lamotte, Wim; van Reeth, Frank

    We present a practical way to distribute viewports on the same video sequence to large amounts of players. Each of them has personal preferences to be met or is limited by the physical properties of his/her device (e.g., screen size of a PDA or processing power of a mobile phone). Instead of taking the naïve approach, in which sections of the video sequence are decoded and re-encoded for each of the clients, we have exploited advanced features offered by the H.264 codec to enable selection of parts of the video sequence by directly manipulating the encoder-generated bitstream. At the same time, we have overcome several practical issues presented by the fact that support for these features is sadly lacking from the state-of-the-art encoders available on the market. Two alternative solutions are discussed and have been implemented, enabling the generation of measurement results and comparison to alternative approaches.

  10. Fall Detection for Elderly from Partially Observed Depth-Map Video Sequences Based on View-Invariant Human Activity Representation

    Directory of Open Access Journals (Sweden)

    Rami Alazrai

    2017-03-01

    Full Text Available This paper presents a new approach for fall detection from partially-observed depth-map video sequences. The proposed approach utilizes the 3D skeletal joint positions obtained from the Microsoft Kinect sensor to build a view-invariant descriptor for human activity representation, called the motion-pose geometric descriptor (MPGD. Furthermore, we have developed a histogram-based representation (HBR based on the MPGD to construct a length-independent representation of the observed video subsequences. Using the constructed HBR, we formulate the fall detection problem as a posterior-maximization problem in which the posteriori probability for each observed video subsequence is estimated using a multi-class SVM (support vector machine classifier. Then, we combine the computed posteriori probabilities from all of the observed subsequences to obtain an overall class posteriori probability of the entire partially-observed depth-map video sequence. To evaluate the performance of the proposed approach, we have utilized the Kinect sensor to record a dataset of depth-map video sequences that simulates four fall-related activities of elderly people, including: walking, sitting, falling form standing and falling from sitting. Then, using the collected dataset, we have developed three evaluation scenarios based on the number of unobserved video subsequences in the testing videos, including: fully-observed video sequence scenario, single unobserved video subsequence of random lengths scenarios and two unobserved video subsequences of random lengths scenarios. Experimental results show that the proposed approach achieved an average recognition accuracy of 93 . 6 % , 77 . 6 % and 65 . 1 % , in recognizing the activities during the first, second and third evaluation scenario, respectively. These results demonstrate the feasibility of the proposed approach to detect falls from partially-observed videos.

  11. A robust approach towards unknown transformation, regional adjacency graphs, multigraph matching, segmentation video frames from unnamed aerial vehicles (UAV)

    Science.gov (United States)

    Gohatre, Umakant Bhaskar; Patil, Venkat P.

    2018-04-01

    In computer vision application, the multiple object detection and tracking, in real-time operation is one of the important research field, that have gained a lot of attentions, in last few years for finding non stationary entities in the field of image sequence. The detection of object is advance towards following the moving object in video and then representation of object is step to track. The multiple object recognition proof is one of the testing assignment from detection multiple objects from video sequence. The picture enrollment has been for quite some time utilized as a reason for the location the detection of moving multiple objects. The technique of registration to discover correspondence between back to back casing sets in view of picture appearance under inflexible and relative change. The picture enrollment is not appropriate to deal with event occasion that can be result in potential missed objects. In this paper, for address such problems, designs propose novel approach. The divided video outlines utilizing area adjancy diagram of visual appearance and geometric properties. Then it performed between graph sequences by using multi graph matching, then getting matching region labeling by a proposed graph coloring algorithms which assign foreground label to respective region. The plan design is robust to unknown transformation with significant improvement in overall existing work which is related to moving multiple objects detection in real time parameters.

  12. Adaptive deblocking and deringing of H.264/AVC video sequences

    DEFF Research Database (Denmark)

    Nadernejad, Ehsan; Burini, Nino; Forchhammer, Søren

    2013-01-01

    We present a method to reduce blocking and ringing artifacts in H.264/AVC video sequences. For deblocking, the proposed method uses a quality measure of a block based coded image to find filtering modes. Based on filtering modes, the images are segmented to three classes and a specific deblocking...

  13. Registration of retinal sequences from new video-ophthalmoscopic camera.

    Science.gov (United States)

    Kolar, Radim; Tornow, Ralf P; Odstrcilik, Jan; Liberdova, Ivana

    2016-05-20

    Analysis of fast temporal changes on retinas has become an important part of diagnostic video-ophthalmology. It enables investigation of the hemodynamic processes in retinal tissue, e.g. blood-vessel diameter changes as a result of blood-pressure variation, spontaneous venous pulsation influenced by intracranial-intraocular pressure difference, blood-volume changes as a result of changes in light reflection from retinal tissue, and blood flow using laser speckle contrast imaging. For such applications, image registration of the recorded sequence must be performed. Here we use a new non-mydriatic video-ophthalmoscope for simple and fast acquisition of low SNR retinal sequences. We introduce a novel, two-step approach for fast image registration. The phase correlation in the first stage removes large eye movements. Lucas-Kanade tracking in the second stage removes small eye movements. We propose robust adaptive selection of the tracking points, which is the most important part of tracking-based approaches. We also describe a method for quantitative evaluation of the registration results, based on vascular tree intensity profiles. The achieved registration error evaluated on 23 sequences (5840 frames) is 0.78 ± 0.67 pixels inside the optic disc and 1.39 ± 0.63 pixels outside the optic disc. We compared the results with the commonly used approaches based on Lucas-Kanade tracking and scale-invariant feature transform, which achieved worse results. The proposed method can efficiently correct particular frames of retinal sequences for shift and rotation. The registration results for each frame (shift in X and Y direction and eye rotation) can also be used for eye-movement evaluation during single-spot fixation tasks.

  14. AirSTAR: A UAV Platform for Flight Dynamics and Control System Testing

    Science.gov (United States)

    Jordan, Thomas L.; Foster, John V.; Bailey, Roger M.; Belcastro, Christine M.

    2006-01-01

    As part of the NASA Aviation Safety Program at Langley Research Center, a dynamically scaled unmanned aerial vehicle (UAV) and associated ground based control system are being developed to investigate dynamics modeling and control of large transport vehicles in upset conditions. The UAV is a 5.5% (seven foot wingspan), twin turbine, generic transport aircraft with a sophisticated instrumentation and telemetry package. A ground based, real-time control system is located inside an operations vehicle for the research pilot and associated support personnel. The telemetry system supports over 70 channels of data plus video for the downlink and 30 channels for the control uplink. Data rates are in excess of 200 Hz. Dynamic scaling of the UAV, which includes dimensional, weight, inertial, actuation, and control system scaling, is required so that the sub-scale vehicle will realistically simulate the flight characteristics of the full-scale aircraft. This testbed will be utilized to validate modeling methods, flight dynamics characteristics, and control system designs for large transport aircraft, with the end goal being the development of technologies to reduce the fatal accident rate due to loss-of-control.

  15. UAV Delivery Monitoring System

    Directory of Open Access Journals (Sweden)

    San Khin Thida

    2018-01-01

    Full Text Available UAV-based delivery systems are increasingly being used in the logistics field, particularly to achieve faster last-mile delivery. This study develops a UAV delivery system that manages delivery order assignments, autonomous flight operation, real time control for UAV flights, and delivery status tracking. To manage the delivery item assignments, we apply the concurrent scheduler approach with a genetic algorithm. The present paper describes real time flight data based on a micro air vehicle communication protocol (MAVLink. It also presents the detailed hardware components used for the field tests. Finally, we provide UAV component analysis to choose the suitable components for delivery in terms of battery capacity, flight time, payload weight and motor thrust ratio.

  16. #DroneHackademy: Aerial countervisuality and citizen science for UAVS as social technology

    Directory of Open Access Journals (Sweden)

    Pablo de Soto Suárez

    2015-12-01

    Full Text Available Drones are a dark technology (Lichty. The military drones that kill civilians are unevenly distributed, geographically. The video "Our Drone Future" (Cornell imagines a scenario where UAVs (Unmanned Aerial Vehicles, with their technologies and capabilities, come to be pervasive in the skies of our future cities. The panoptic vision of the drone is a fundamental part of contemporary “complex of visuality” defined by the military-industrial complex, according to Mirzoeff. He proposes "the right to look" as a form of opposition to this alliance of visuality and power. The right to look from the skies as a practice of contravisuality using drones is claimed and exercised by an increasing number of hackers, artivists, social scientists, independent journalists and environmental activists, such as Mark Devries (FarmDrones or Lot Amorós (Guerilla Drone, Flone. In order to investigate and act in the present on "Our future drone", we propose the creation of a citizen laboratory and a learning community in the use of UAVs as social technology. Drone Hackademy joined for a week ten representatives of collectives from Rio de Janeiro and other Brazilian cities. Participants were teached how and why to protect themselves from UAVs. Activities included the construction of free hardware and software UAVs such as Flone; and the production of an aerial mapping of the local community resisting eviction in the area annex to the Olympic Park.

  17. Using infrared HOG-based pedestrian detection for outdoor autonomous searching UAV with embedded system

    Science.gov (United States)

    Shao, Yanhua; Mei, Yanying; Chu, Hongyu; Chang, Zhiyuan; He, Yuxuan; Zhan, Huayi

    2018-04-01

    Pedestrian detection (PD) is an important application domain in computer vision and pattern recognition. Unmanned Aerial Vehicles (UAVs) have become a major field of research in recent years. In this paper, an algorithm for a robust pedestrian detection method based on the combination of the infrared HOG (IR-HOG) feature and SVM is proposed for highly complex outdoor scenarios on the basis of airborne IR image sequences from UAV. The basic flow of our application operation is as follows. Firstly, the thermal infrared imager (TAU2-336), which was installed on our Outdoor Autonomous Searching (OAS) UAV, is used for taking pictures of the designated outdoor area. Secondly, image sequences collecting and processing were accomplished by using high-performance embedded system with Samsung ODROID-XU4 and Ubuntu as the core and operating system respectively, and IR-HOG features were extracted. Finally, the SVM is used to train the pedestrian classifier. Experiment show that, our method shows promising results under complex conditions including strong noise corruption, partial occlusion etc.

  18. Video Enhancement and Dynamic Range Control of HDR Sequences for Automotive Applications

    Directory of Open Access Journals (Sweden)

    Giovanni Ramponi

    2007-01-01

    Full Text Available CMOS video cameras with high dynamic range (HDR output are particularly suitable for driving assistance applications, where lighting conditions can strongly vary, going from direct sunlight to dark areas in tunnels. However, common visualization devices can only handle a low dynamic range, and thus a dynamic range reduction is needed. Many algorithms have been proposed in the literature to reduce the dynamic range of still pictures. Anyway, extending the available methods to video is not straightforward, due to the peculiar nature of video data. We propose an algorithm for both reducing the dynamic range of video sequences and enhancing its appearance, thus improving visual quality and reducing temporal artifacts. We also provide an optimized version of our algorithm for a viable hardware implementation on an FPGA. The feasibility of this implementation is demonstrated by means of a case study.

  19. Application of UAVs at the Savannah River Site

    International Nuclear Information System (INIS)

    Hofstetter, K.J.; Pendergast, M.M.

    1996-01-01

    Small, unmanned aerial vehicles (UAVs) equipped with sensors for physical, chemical, and radiochemical measurements of remote environments have been tested at the Savannah River Site (SRS). A miniature helicopter was used as an aerial platform for testing a variety of sensors with outputs integrated with the flight control system for real-time data acquisition and evaluation. The sensors included a precision magnetometer, two broad band infra-red radiometers, a 1-inch by 1-inch Nal(TI) scintillation detector, and an on-board color video camera. Included in the avionics package was an ultrasonic altimeter, a precision barometer, and a portable Global Positioning System. Two separate demonstration locations at SRS were flown that had been previously characterized by careful sampling and analyses and by aerial surveys at high altitudes. The Steed Pond demonstration site contains elevated levels of uranium in the soil and pond silt due to runoff from one of the site's uranium fuel and target production areas. The soil at the other site is contaminated with oil bearing materials and contains some buried objects. The results and limitations of the UAV surveys are presented and improvements for future measurements are discussed

  20. Spurious RF signals emitted by mini-UAVs

    Science.gov (United States)

    Schleijpen, Ric (H. M. A.); Voogt, Vincent; Zwamborn, Peter; van den Oever, Jaap

    2016-10-01

    This paper presents experimental work on the detection of spurious RF emissions of mini Unmanned Aerial Vehicles (mini-UAV). Many recent events have shown that mini-UAVs can be considered as a potential threat for civil security. For this reason the detection of mini-UAVs has become of interest to the sensor community. The detection, classification and identification chain can take advantage of different sensor technologies. Apart from the signatures used by radar and electro-optical sensor systems, the UAV also emits RF signals. These RF signatures can be split in intentional signals for communication with the operator and un-intentional RF signals emitted by the UAV. These unintentional or spurious RF emissions are very weak but could be used to discriminate potential UAV detections from false alarms. The goal of this research was to assess the potential of exploiting spurious emissions in the classification and identification chain of mini-UAVs. It was already known that spurious signals are very weak, but the focus was on the question whether the emission pattern could be correlated to the behaviour of the UAV. In this paper experimental examples of spurious RF emission for different types of mini-UAVs and their correlation with the electronic circuits in the UAVs will be shown

  1. Diverse Planning for UAV Control and Remote Sensing

    Directory of Open Access Journals (Sweden)

    Jan Tožička

    2016-12-01

    Full Text Available Unmanned aerial vehicles (UAVs are suited to various remote sensing missions, such as measuring air quality. The conventional method of UAV control is by human operators. Such an approach is limited by the ability of cooperation among the operators controlling larger fleets of UAVs in a shared area. The remedy for this is to increase autonomy of the UAVs in planning their trajectories by considering other UAVs and their plans. To provide such improvement in autonomy, we need better algorithms for generating alternative trajectory variants that the UAV coordination algorithms can utilize. In this article, we define a novel family of multi-UAV sensing problems, solving task allocation of huge number of tasks (tens of thousands to a group of configurable UAVs with non-zero weight of equipped sensors (comprising the air quality measurement as well together with two base-line solvers. To solve the problem efficiently, we use an algorithm for diverse trajectory generation and integrate it with a solver for the multi-UAV coordination problem. Finally, we experimentally evaluate the multi-UAV sensing problem solver. The evaluation is done on synthetic and real-world-inspired benchmarks in a multi-UAV simulator. Results show that diverse planning is a valuable method for remote sensing applications containing multiple UAVs.

  2. Image ranking in video sequences using pairwise image comparisons and temporal smoothing

    CSIR Research Space (South Africa)

    Burke, Michael

    2016-12-01

    Full Text Available The ability to predict the importance of an image is highly desirable in computer vision. This work introduces an image ranking scheme suitable for use in video or image sequences. Pairwise image comparisons are used to determine image ‘interest...

  3. UAV Swarm Operational Risk Assessment System

    Science.gov (United States)

    2015-09-01

    are detected, clear monitoring is required to track and identify the possible intentions of inbound UAVs. And when a target is identified, enough...armed UAVs (Davis et al. 2014). Although manufacturers in the U.S. and Israel dominate the global UAV market (approximately 75 percent share between

  4. Colour-based Object Detection and Tracking for Autonomous Quadrotor UAV

    International Nuclear Information System (INIS)

    Kadouf, Hani Hunud A; Mustafah, Yasir Mohd

    2013-01-01

    With robotics becoming a fundamental aspect of modern society, further research and consequent application is ever increasing. Aerial robotics, in particular, covers applications such as surveillance in hostile military zones or search and rescue operations in disaster stricken areas, where ground navigation is impossible. The increased visual capacity of UAV's (Unmanned Air Vehicles) is also applicable in the support of ground vehicles to provide supplies for emergency assistance, for scouting purposes or to extend communication beyond insurmountable land or water barriers. The Quadrotor, which is a small UAV has its lift generated by four rotors and can be controlled by altering the speeds of its motors relative to each other. The four rotors allow for a higher payload than single or dual rotor UAVs, which makes it safer and more suitable to carry camera and transmitter equipment. An onboard camera is used to capture and transmit images of the Quadrotor's First Person View (FPV) while in flight, in real time, wirelessly to a base station. The aim of this research is to develop an autonomous quadrotor platform capable of transmitting real time video signals to a base station for processing. The result from the image analysis will be used as a feedback in the quadrotor positioning control. To validate the system, the algorithm should have the capacity to make the quadrotor identify, track or hover above stationary or moving objects

  5. A Survey of Channel Modeling for UAV Communications

    KAUST Repository

    Khuwaja, Aziz Altaf; Chen, Yunfei; Zhao, Nan; Alouini, Mohamed-Slim; Dobbins, Paul

    2018-01-01

    Unmanned aerial vehicles (UAVs) have gained great interest for rapid deployment in both civil and military applications. UAV communication has its own distinctive channel characteristics compared with widely used cellular and satellite systems. Thus, accurate channel characterization is crucial for the performance optimization and design of efficient UAV communication systems. However, several challenges exist in UAV channel modeling. For example, propagation characteristics of UAV channels are still less explored for spatial and temporal variations in non-stationary channels. Also, airframe shadowing has not yet been investigated for small size rotary UAVs. This paper provides an extensive survey on the measurement campaigns launched for UAV channel modeling using low altitude platforms and discusses various channel characterization efforts. We also review the contemporary perspective of UAV channel modeling approaches and outline some future research challenges in this domain.

  6. A Survey of Channel Modeling for UAV Communications

    KAUST Repository

    Khuwaja, Aziz Altaf

    2018-01-23

    Unmanned aerial vehicles (UAVs) have gained great interest for rapid deployment in both civil and military applications. UAV communication has its own distinctive channel characteristics compared with widely used cellular and satellite systems. Thus, accurate channel characterization is crucial for the performance optimization and design of efficient UAV communication systems. However, several challenges exist in UAV channel modeling. For example, propagation characteristics of UAV channels are still less explored for spatial and temporal variations in non-stationary channels. Also, airframe shadowing has not yet been investigated for small size rotary UAVs. This paper provides an extensive survey on the measurement campaigns launched for UAV channel modeling using low altitude platforms and discusses various channel characterization efforts. We also review the contemporary perspective of UAV channel modeling approaches and outline some future research challenges in this domain.

  7. Multi-Task Video Captioning with Video and Entailment Generation

    OpenAIRE

    Pasunuru, Ramakanth; Bansal, Mohit

    2017-01-01

    Video captioning, the task of describing the content of a video, has seen some promising improvements in recent years with sequence-to-sequence models, but accurately learning the temporal and logical dynamics involved in the task still remains a challenge, especially given the lack of sufficient annotated data. We improve video captioning by sharing knowledge with two related directed-generation tasks: a temporally-directed unsupervised video prediction task to learn richer context-aware vid...

  8. Development of Cloud-Based UAV Monitoring and Management System.

    Science.gov (United States)

    Itkin, Mason; Kim, Mihui; Park, Younghee

    2016-11-15

    Unmanned aerial vehicles (UAVs) are an emerging technology with the potential to revolutionize commercial industries and the public domain outside of the military. UAVs would be able to speed up rescue and recovery operations from natural disasters and can be used for autonomous delivery systems (e.g., Amazon Prime Air). An increase in the number of active UAV systems in dense urban areas is attributed to an influx of UAV hobbyists and commercial multi-UAV systems. As airspace for UAV flight becomes more limited, it is important to monitor and manage many UAV systems using modern collision avoidance techniques. In this paper, we propose a cloud-based web application that provides real-time flight monitoring and management for UAVs. For each connected UAV, detailed UAV sensor readings from the accelerometer, GPS sensor, ultrasonic sensor and visual position cameras are provided along with status reports from the smaller internal components of UAVs (i.e., motor and battery). The dynamic map overlay visualizes active flight paths and current UAV locations, allowing the user to monitor all aircrafts easily. Our system detects and prevents potential collisions by automatically adjusting UAV flight paths and then alerting users to the change. We develop our proposed system and demonstrate its feasibility and performances through simulation.

  9. Development of Cloud-Based UAV Monitoring and Management System

    Directory of Open Access Journals (Sweden)

    Mason Itkin

    2016-11-01

    Full Text Available Unmanned aerial vehicles (UAVs are an emerging technology with the potential to revolutionize commercial industries and the public domain outside of the military. UAVs would be able to speed up rescue and recovery operations from natural disasters and can be used for autonomous delivery systems (e.g., Amazon Prime Air. An increase in the number of active UAV systems in dense urban areas is attributed to an influx of UAV hobbyists and commercial multi-UAV systems. As airspace for UAV flight becomes more limited, it is important to monitor and manage many UAV systems using modern collision avoidance techniques. In this paper, we propose a cloud-based web application that provides real-time flight monitoring and management for UAVs. For each connected UAV, detailed UAV sensor readings from the accelerometer, GPS sensor, ultrasonic sensor and visual position cameras are provided along with status reports from the smaller internal components of UAVs (i.e., motor and battery. The dynamic map overlay visualizes active flight paths and current UAV locations, allowing the user to monitor all aircrafts easily. Our system detects and prevents potential collisions by automatically adjusting UAV flight paths and then alerting users to the change. We develop our proposed system and demonstrate its feasibility and performances through simulation.

  10. Development of Cloud-Based UAV Monitoring and Management System

    Science.gov (United States)

    Itkin, Mason; Kim, Mihui; Park, Younghee

    2016-01-01

    Unmanned aerial vehicles (UAVs) are an emerging technology with the potential to revolutionize commercial industries and the public domain outside of the military. UAVs would be able to speed up rescue and recovery operations from natural disasters and can be used for autonomous delivery systems (e.g., Amazon Prime Air). An increase in the number of active UAV systems in dense urban areas is attributed to an influx of UAV hobbyists and commercial multi-UAV systems. As airspace for UAV flight becomes more limited, it is important to monitor and manage many UAV systems using modern collision avoidance techniques. In this paper, we propose a cloud-based web application that provides real-time flight monitoring and management for UAVs. For each connected UAV, detailed UAV sensor readings from the accelerometer, GPS sensor, ultrasonic sensor and visual position cameras are provided along with status reports from the smaller internal components of UAVs (i.e., motor and battery). The dynamic map overlay visualizes active flight paths and current UAV locations, allowing the user to monitor all aircrafts easily. Our system detects and prevents potential collisions by automatically adjusting UAV flight paths and then alerting users to the change. We develop our proposed system and demonstrate its feasibility and performances through simulation. PMID:27854267

  11. Characterization of UAV Performance and Development of a Formation Flight Controller for Multiple Small UAVS

    National Research Council Canada - National Science Library

    McCarthy, Patrick A

    2006-01-01

    ... (UAV). One area of particular interest is using multiple small UAVs cooperatively to improve mission efficiency, as well as perform missions that couldn't be performed using vehicles independently...

  12. Thrust sensing for small UAVs

    Science.gov (United States)

    Marchman, Christopher Scott

    Unmanned aerial vehicles (UAVs) have become prevalent in both military and civilian applications. UAVs have many size categories from large-scale aircraft to micro air vehicles. The performance, health, and efficiency for UAVs of smaller sizes can be difficult to assess and few associated instrumentation systems have been developed. Thrust measurements on the ground can characterize systems especially when combined with simultaneous motor power measurements. This thesis demonstrates the use of strain measurements to measure the thrust produced by motor/propeller combinations for such small UAVs. A full-bridge Wheatstone circuit and electrical resistance strain gauges were used in conjunction with constant-stress cantilever beams for static tests and dynamic wind tunnel tests. An associated instrumentation module monitored power from the electric motor. Monitoring the thrust data over time can provide insights into optimal propeller and motor selection and early detection of problems such as component failure. The approach provides a system for laboratory or field measurements that can be scaled for a wide range of small UAVs.

  13. Development of Open source-based automatic shooting and processing UAV imagery for Orthoimage Using Smart Camera UAV

    Science.gov (United States)

    Park, J. W.; Jeong, H. H.; Kim, J. S.; Choi, C. U.

    2016-06-01

    Recently, aerial photography with unmanned aerial vehicle (UAV) system uses UAV and remote controls through connections of ground control system using bandwidth of about 430 MHz radio Frequency (RF) modem. However, as mentioned earlier, existing method of using RF modem has limitations in long distance communication. The Smart Camera equipments's LTE (long-term evolution), Bluetooth, and Wi-Fi to implement UAV that uses developed UAV communication module system carried out the close aerial photogrammetry with the automatic shooting. Automatic shooting system is an image capturing device for the drones in the area's that needs image capturing and software for loading a smart camera and managing it. This system is composed of automatic shooting using the sensor of smart camera and shooting catalog management which manages filmed images and information. Processing UAV imagery module used Open Drone Map. This study examined the feasibility of using the Smart Camera as the payload for a photogrammetric UAV system. The open soure tools used for generating Android, OpenCV (Open Computer Vision), RTKLIB, Open Drone Map.

  14. Development of Open source-based automatic shooting and processing UAV imagery for Orthoimage Using Smart Camera UAV

    Directory of Open Access Journals (Sweden)

    J. W. Park

    2016-06-01

    Full Text Available Recently, aerial photography with unmanned aerial vehicle (UAV system uses UAV and remote controls through connections of ground control system using bandwidth of about 430 MHz radio Frequency (RF modem. However, as mentioned earlier, existing method of using RF modem has limitations in long distance communication. The Smart Camera equipments’s LTE (long-term evolution, Bluetooth, and Wi-Fi to implement UAV that uses developed UAV communication module system carried out the close aerial photogrammetry with the automatic shooting. Automatic shooting system is an image capturing device for the drones in the area’s that needs image capturing and software for loading a smart camera and managing it. This system is composed of automatic shooting using the sensor of smart camera and shooting catalog management which manages filmed images and information. Processing UAV imagery module used Open Drone Map. This study examined the feasibility of using the Smart Camera as the payload for a photogrammetric UAV system. The open soure tools used for generating Android, OpenCV (Open Computer Vision, RTKLIB, Open Drone Map.

  15. Aeromagnetic Compensation for UAVs

    Science.gov (United States)

    Naprstek, T.; Lee, M. D.

    2017-12-01

    Aeromagnetic data is one of the most widely collected types of data in exploration geophysics. With the continuing prevalence of unmanned air vehicles (UAVs) in everyday life there is a strong push for aeromagnetic data collection using UAVs. However, apart from the many political and legal barriers to overcome in the development of UAVs as aeromagnetic data collection platforms, there are also significant scientific hurdles, primary of which is magnetic compensation. This is a well-established process in manned aircraft achieved through a combination of platform magnetic de-noising and compensation routines. However, not all of this protocol can be directly applied to UAVs due to fundamental differences in the platforms, most notably the decrease in scale causing magnetometers to be significantly closer to the avionics. As such, the methodology must be suitably adjusted. The National Research Council of Canada has collaborated with Aeromagnetic Solutions Incorporated to develop a standardized approach to de-noising and compensating UAVs, which is accomplished through a series of static and dynamic experiments. On the ground, small static tests are conducted on individual components to determine their magnetization. If they are highly magnetic, they are removed, demagnetized, or characterized such that they can be accounted for in the compensation. Dynamic tests can include measuring specific components as they are powered on and off to assess their potential effect on airborne data. The UAV is then flown, and a modified compensation routine is applied. These modifications include utilizing onboard autopilot current sensors as additional terms in the compensation algorithm. This process has been applied with success to fixed-wing and rotary-wing platforms, with both a standard manned-aircraft magnetometer, as well as a new atomic magnetometer, much smaller in scale.

  16. A Hybrid Vehicle Detection Method Based on Viola-Jones and HOG + SVM from UAV Images

    Science.gov (United States)

    Xu, Yongzheng; Yu, Guizhen; Wang, Yunpeng; Wu, Xinkai; Ma, Yalong

    2016-01-01

    A new hybrid vehicle detection scheme which integrates the Viola-Jones (V-J) and linear SVM classifier with HOG feature (HOG + SVM) methods is proposed for vehicle detection from low-altitude unmanned aerial vehicle (UAV) images. As both V-J and HOG + SVM are sensitive to on-road vehicles’ in-plane rotation, the proposed scheme first adopts a roadway orientation adjustment method, which rotates each UAV image to align the roads with the horizontal direction so the original V-J or HOG + SVM method can be directly applied to achieve fast detection and high accuracy. To address the issue of descending detection speed for V-J and HOG + SVM, the proposed scheme further develops an adaptive switching strategy which sophistically integrates V-J and HOG + SVM methods based on their different descending trends of detection speed to improve detection efficiency. A comprehensive evaluation shows that the switching strategy, combined with the road orientation adjustment method, can significantly improve the efficiency and effectiveness of the vehicle detection from UAV images. The results also show that the proposed vehicle detection method is competitive compared with other existing vehicle detection methods. Furthermore, since the proposed vehicle detection method can be performed on videos captured from moving UAV platforms without the need of image registration or additional road database, it has great potentials of field applications. Future research will be focusing on expanding the current method for detecting other transportation modes such as buses, trucks, motors, bicycles, and pedestrians. PMID:27548179

  17. A Hybrid Vehicle Detection Method Based on Viola-Jones and HOG + SVM from UAV Images.

    Science.gov (United States)

    Xu, Yongzheng; Yu, Guizhen; Wang, Yunpeng; Wu, Xinkai; Ma, Yalong

    2016-08-19

    A new hybrid vehicle detection scheme which integrates the Viola-Jones (V-J) and linear SVM classifier with HOG feature (HOG + SVM) methods is proposed for vehicle detection from low-altitude unmanned aerial vehicle (UAV) images. As both V-J and HOG + SVM are sensitive to on-road vehicles' in-plane rotation, the proposed scheme first adopts a roadway orientation adjustment method, which rotates each UAV image to align the roads with the horizontal direction so the original V-J or HOG + SVM method can be directly applied to achieve fast detection and high accuracy. To address the issue of descending detection speed for V-J and HOG + SVM, the proposed scheme further develops an adaptive switching strategy which sophistically integrates V-J and HOG + SVM methods based on their different descending trends of detection speed to improve detection efficiency. A comprehensive evaluation shows that the switching strategy, combined with the road orientation adjustment method, can significantly improve the efficiency and effectiveness of the vehicle detection from UAV images. The results also show that the proposed vehicle detection method is competitive compared with other existing vehicle detection methods. Furthermore, since the proposed vehicle detection method can be performed on videos captured from moving UAV platforms without the need of image registration or additional road database, it has great potentials of field applications. Future research will be focusing on expanding the current method for detecting other transportation modes such as buses, trucks, motors, bicycles, and pedestrians.

  18. Introducing a Low-Cost Mini-Uav for - and Multispectral-Imaging

    Science.gov (United States)

    Bendig, J.; Bolten, A.; Bareth, G.

    2012-07-01

    The trend to minimize electronic devices also accounts for Unmanned Airborne Vehicles (UAVs) as well as for sensor technologies and imaging devices. Consequently, it is not surprising that UAVs are already part of our daily life and the current pace of development will increase civil applications. A well known and already wide spread example is the so called flying video game based on Parrot's AR.Drone which is remotely controlled by an iPod, iPhone, or iPad (http://ardrone.parrot.com). The latter can be considered as a low-weight and low-cost Mini-UAV. In this contribution a Mini-UAV is considered to weigh less than 5 kg and is being able to carry 0.2 kg to 1.5 kg of sensor payload. While up to now Mini-UAVs like Parrot's AR.Drone are mainly equipped with RGB cameras for videotaping or imaging, the development of such carriage systems clearly also goes to multi-sensor platforms like the ones introduced for larger UAVs (5 to 20 kg) by Jaakkolla et al. (2010) for forestry applications or by Berni et al. (2009) for agricultural applications. The problem when designing a Mini-UAV for multi-sensor imaging is the limitation of payload of up to 1.5 kg and a total weight of the whole system below 5 kg. Consequently, the Mini-UAV without sensors but including navigation system and GPS sensors must weigh less than 3.5 kg. A Mini-UAV system with these characteristics is HiSystems' MK-Okto (www.mikrokopter.de). Total weight including battery without sensors is less than 2.5 kg. Payload of a MK-Okto is approx. 1 kg and maximum speed is around 30 km/h. The MK-Okto can be operated up to a wind speed of less than 19 km/h which corresponds to Beaufort scale number 3 for wind speed. In our study, the MK-Okto is equipped with a handheld low-weight NEC F30IS thermal imaging system. The F30IS which was developed for veterinary applications, covers 8 to 13 μm, weighs only 300 g, and is capturing the temperature range between -20 °C and 100 °C. Flying at a height of 100 m, the camera

  19. Research for new UAV capabilities

    Energy Technology Data Exchange (ETDEWEB)

    Canavan, G.H.; Leadabrand, R.

    1996-07-01

    This paper discusses research for new Unmanned Aerial Vehicles (UAV) capabilities. Findings indicate that UAV performance could be greatly enhanced by modest research. Improved sensors and communications enhance near term cost effectiveness. Improved engines, platforms, and stealth improve long term effectiveness.

  20. Real-Time Reliability Verification for UAV Flight Control System Supporting Airworthiness Certification.

    Science.gov (United States)

    Xu, Haiyang; Wang, Ping

    2016-01-01

    In order to verify the real-time reliability of unmanned aerial vehicle (UAV) flight control system and comply with the airworthiness certification standard, we proposed a model-based integration framework for modeling and verification of time property. Combining with the advantages of MARTE, this framework uses class diagram to create the static model of software system, and utilizes state chart to create the dynamic model. In term of the defined transformation rules, the MARTE model could be transformed to formal integrated model, and the different part of the model could also be verified by using existing formal tools. For the real-time specifications of software system, we also proposed a generating algorithm for temporal logic formula, which could automatically extract real-time property from time-sensitive live sequence chart (TLSC). Finally, we modeled the simplified flight control system of UAV to check its real-time property. The results showed that the framework could be used to create the system model, as well as precisely analyze and verify the real-time reliability of UAV flight control system.

  1. A system of UAV application in indoor environment

    DEFF Research Database (Denmark)

    Khosiawan, Yohanes; Nielsen, Izabela Ewa

    2016-01-01

    In recent years, there has been an increased demand in the use of multiple unmanned aerial vehicles (UAVs) in indoor environments such as material handling task in a manufacturing environment and plant/environment monitoring task in a greenhouse. However, there is a lack of work reported on this ......In recent years, there has been an increased demand in the use of multiple unmanned aerial vehicles (UAVs) in indoor environments such as material handling task in a manufacturing environment and plant/environment monitoring task in a greenhouse. However, there is a lack of work reported...... on this topic. This paper presents a detailed study on several UAV systems and UAV scheduling systems. It is followed by a proposed system of UAV application in indoor environment, which comprises components of UAV system addressed in detail; focused on scheduler as the heart of operations. Consequently, system...... architecture of UAV scheduling system is presented and the framework of scheduler component is included. Scheduler component works in a phased manner to provide a systematic abstraction and achieve an efficient computation time. This study serves as a reference guide for UAV application in indoor environment....

  2. Optical and acoustical UAV detection

    Science.gov (United States)

    Christnacher, Frank; Hengy, Sébastien; Laurenzis, Martin; Matwyschuk, Alexis; Naz, Pierre; Schertzer, Stéphane; Schmitt, Gwenael

    2016-10-01

    Recent world events have highlighted that the proliferation of UAVs is bringing with it a new and rapidly increasing threat for national defense and security agencies. Whilst many of the reported UAV incidents seem to indicate that there was no terrorist intent behind them, it is not unreasonable to assume that it may not be long before UAV platforms are regularly employed by terrorists or other criminal organizations. The flight characteristics of many of these mini- and micro-platforms present challenges for current systems which have been optimized over time to defend against the traditional air-breathing airborne platforms. A lot of programs to identify cost-effective measures for the detection, classification, tracking and neutralization have begun in the recent past. In this paper, lSL shows how the performance of a UAV detection and tracking concept based on acousto-optical technology can be powerfully increased through active imaging.

  3. Spurious RF signals emitted by mini-UAVs

    NARCIS (Netherlands)

    Schleijpen, R.; Voogt, V.; Zwamborn, P.; Oever, J. van den

    2016-01-01

    This paper presents experimental work on the detection of spurious RF emissions of mini Unmanned Aerial Vehicles (mini-UAV). Many recent events have shown that mini-UAVs can be considered as a potential threat for civil security. For this reason the detection of mini-UAVs has become of interest to

  4. UAV magnetometry in mineral exploration and infrastructure detection

    Science.gov (United States)

    Braun, A.; Parvar, K.; Burns, M.

    2015-12-01

    Magnetic surveys are critical tools in mineral exploration and UAVs have the potential to carry magnetometers. UAV surveys can offer higher spatial resolution than traditional airborne surveys, and higher coverage than terrestrial surveys. However, the main advantage is their ability to sense the magnetic field in 3-D, while most airborne or terrestrial surveys are restricted to 2-D acquisition. This study compares UAV magnetic data from two different UAVs (JIB drone, DJI Phantom 2) and three different magnetometers (GEM GSPM35, Honeywell HMR2300, GEM GST-19). The first UAV survey was conducted using a JIB UAV with a GSPM35 flying at 10-15 m above ground. The survey's goal was to detect intrusive Rhyolite bodies for primary mineral exploration. The survey resulted in a better understanding of the validity/resolution of UAV data and led to improved knowledge about the geological structures in the area. The results further drove the design of a following terrestrial survey. Comparing the UAV data with an available airborne survey (upward continued to 250 m) reveals that the UAV data has superior spatial resolution, but exhibits a higher noise level. The magnetic anomalies related to the Rhyolite intrusions is about 109 nT and translates into an estimated depth of approximately 110 meters. The second survey was conducted using an in-house developed UAV magnetometer system equipped with a DJI Phantom 2 and a Honeywell HMR2300 fluxgate magnetometer. By flying the sensor in different altitudes, the vertical and horizontal gradients can be derived leading to full 3-D magnetic data volumes which can provide improved constraints for source depth/geometry characterization. We demonstrate that a buried steam pipeline was detectable with the UAV magnetometer system and compare the resulting data with a terrestrial survey using a GEM GST-19 Proton Precession Magnetometer.

  5. Design of UAV (Diseño de un UAV)

    OpenAIRE

    Sacristán Estévez, José María

    2016-01-01

    En este proyecto se ha diseñado un dron, un vehículo aéreo no tripulado (UAV en sus siglas inglesas). El propósito de este proyecto es empezar el diseño desde cero hasta poder vender el dron y que sea rentable. Han sido calculados los parámetros necesarios para comenzar el diseño. Se ha comprobado si todas las partes del UAV son capaces de resistir un impacto contra el suelo durante su uso, y se ha buscado la forma más óptima de conseguir los materiales, así de cómo fabricar ciertas partes y ...

  6. Collaborative UAV Exploration of Hostile Environments

    National Research Council Canada - National Science Library

    Luotsinen, Linus J; Gonzalez, Avelino J; Boeloeni, Ladislau

    2004-01-01

    .... UAVs can be lost or significantly damaged during the exploration process. Although employing multiple UAVs can increase the chance of success, their efficiency depends on the collaboration strategies used...

  7. A review of techniques for the identification and measurement of fish in underwater stereo-video image sequences

    Science.gov (United States)

    Shortis, Mark R.; Ravanbakskh, Mehdi; Shaifat, Faisal; Harvey, Euan S.; Mian, Ajmal; Seager, James W.; Culverhouse, Philip F.; Cline, Danelle E.; Edgington, Duane R.

    2013-04-01

    Underwater stereo-video measurement systems are used widely for counting and measuring fish in aquaculture, fisheries and conservation management. To determine population counts, spatial or temporal frequencies, and age or weight distributions, snout to fork length measurements are captured from the video sequences, most commonly using a point and click process by a human operator. Current research aims to automate the measurement and counting task in order to improve the efficiency of the process and expand the use of stereo-video systems within marine science. A fully automated process will require the detection and identification of candidates for measurement, followed by the snout to fork length measurement, as well as the counting and tracking of fish. This paper presents a review of the techniques used for the detection, identification, measurement, counting and tracking of fish in underwater stereo-video image sequences, including consideration of the changing body shape. The review will analyse the most commonly used approaches, leading to an evaluation of the techniques most likely to be a general solution to the complete process of detection, identification, measurement, counting and tracking.

  8. Radio Channel Modelling for UAV Communication over Cellular Networks

    DEFF Research Database (Denmark)

    Amorim, Rafhael Medeiros de; Nguyen, Huan Cong; Mogensen, Preben Elgaard

    2017-01-01

    a commercial UAV. Our results show that path loss exponents decrease as the UAV moves up, approximating freespace propagation for horizontal ranges up to tens of kilometers at UAV heights around 100m. Our findings support the need of heightdependent parameters for describing the propagation channel for UAVs...

  9. The Way Ahead For Maritime UAVS

    National Research Council Canada - National Science Library

    Pearson , II, F. C

    2006-01-01

    .... There is an overarching USN plan for UAVs, but I propose an emphasis should be placed on the close range or tactical UAVs that will directly complement battle space management, increase situational...

  10. An UAV scheduling and planning method for post-disaster survey

    Science.gov (United States)

    Li, G. Q.; Zhou, X. G.; Yin, J.; Xiao, Q. Y.

    2014-11-01

    Annually, the extreme climate and special geological environments lead to frequent natural disasters, e.g., earthquakes, floods, etc. The disasters often bring serious casualties and enormous economic losses. Post-disaster surveying is very important for disaster relief and assessment. As the Unmanned Aerial Vehicle (UAV) remote sensing with the advantage of high efficiency, high precision, high flexibility, and low cost, it is widely used in emergency surveying in recent years. As the UAVs used in emergency surveying cannot stop and wait for the happening of the disaster, when the disaster happens the UAVs usually are working at everywhere. In order to improve the emergency surveying efficiency, it is needed to track the UAVs and assign the emergency surveying task for each selected UAV. Therefore, a UAV tracking and scheduling method for post-disaster survey is presented in this paper. In this method, Global Positioning System (GPS), and GSM network are used to track the UAVs; an emergency tracking UAV information database is built in advance by registration, the database at least includes the following information, e.g., the ID of the UAVs, the communication number of the UAVs; when catastrophe happens, the real time location of all UAVs in the database will be gotten using emergency tracking method at first, then the traffic cost time for all UAVs to the disaster region will be calculated based on the UAVs' the real time location and the road network using the nearest services analysis algorithm; the disaster region is subdivided to several emergency surveying regions based on DEM, area, and the population distribution map; the emergency surveying regions are assigned to the appropriated UAV according to shortest cost time rule. The UAVs tracking and scheduling prototype is implemented using SQLServer2008, ArcEnginge 10.1 SDK, Visual Studio 2010 C#, Android, SMS Modem, and Google Maps API.

  11. Two-terminal video coding.

    Science.gov (United States)

    Yang, Yang; Stanković, Vladimir; Xiong, Zixiang; Zhao, Wei

    2009-03-01

    Following recent works on the rate region of the quadratic Gaussian two-terminal source coding problem and limit-approaching code designs, this paper examines multiterminal source coding of two correlated, i.e., stereo, video sequences to save the sum rate over independent coding of both sequences. Two multiterminal video coding schemes are proposed. In the first scheme, the left sequence of the stereo pair is coded by H.264/AVC and used at the joint decoder to facilitate Wyner-Ziv coding of the right video sequence. The first I-frame of the right sequence is successively coded by H.264/AVC Intracoding and Wyner-Ziv coding. An efficient stereo matching algorithm based on loopy belief propagation is then adopted at the decoder to produce pixel-level disparity maps between the corresponding frames of the two decoded video sequences on the fly. Based on the disparity maps, side information for both motion vectors and motion-compensated residual frames of the right sequence are generated at the decoder before Wyner-Ziv encoding. In the second scheme, source splitting is employed on top of classic and Wyner-Ziv coding for compression of both I-frames to allow flexible rate allocation between the two sequences. Experiments with both schemes on stereo video sequences using H.264/AVC, LDPC codes for Slepian-Wolf coding of the motion vectors, and scalar quantization in conjunction with LDPC codes for Wyner-Ziv coding of the residual coefficients give a slightly lower sum rate than separate H.264/AVC coding of both sequences at the same video quality.

  12. INTRODUCING A LOW-COST MINI-UAV FOR THERMAL- AND MULTISPECTRAL-IMAGING

    Directory of Open Access Journals (Sweden)

    J. Bendig

    2012-07-01

    Full Text Available The trend to minimize electronic devices also accounts for Unmanned Airborne Vehicles (UAVs as well as for sensor technologies and imaging devices. Consequently, it is not surprising that UAVs are already part of our daily life and the current pace of development will increase civil applications. A well known and already wide spread example is the so called flying video game based on Parrot's AR.Drone which is remotely controlled by an iPod, iPhone, or iPad (http://ardrone.parrot.com. The latter can be considered as a low-weight and low-cost Mini-UAV. In this contribution a Mini-UAV is considered to weigh less than 5 kg and is being able to carry 0.2 kg to 1.5 kg of sensor payload. While up to now Mini-UAVs like Parrot's AR.Drone are mainly equipped with RGB cameras for videotaping or imaging, the development of such carriage systems clearly also goes to multi-sensor platforms like the ones introduced for larger UAVs (5 to 20 kg by Jaakkolla et al. (2010 for forestry applications or by Berni et al. (2009 for agricultural applications. The problem when designing a Mini-UAV for multi-sensor imaging is the limitation of payload of up to 1.5 kg and a total weight of the whole system below 5 kg. Consequently, the Mini-UAV without sensors but including navigation system and GPS sensors must weigh less than 3.5 kg. A Mini-UAV system with these characteristics is HiSystems' MK-Okto (www.mikrokopter.de. Total weight including battery without sensors is less than 2.5 kg. Payload of a MK-Okto is approx. 1 kg and maximum speed is around 30 km/h. The MK-Okto can be operated up to a wind speed of less than 19 km/h which corresponds to Beaufort scale number 3 for wind speed. In our study, the MK-Okto is equipped with a handheld low-weight NEC F30IS thermal imaging system. The F30IS which was developed for veterinary applications, covers 8 to 13 μm, weighs only 300 g, and is capturing the temperature range between −20 °C and 100 °C. Flying at a height of

  13. Teaching UAVs to Race Using UE4Sim

    KAUST Repository

    Mueller, Matthias

    2017-08-19

    Automating the navigation of unmanned aerial vehicles (UAVs) in diverse scenarios has gained much attention in the recent years. However, teaching UAVs to fly in challenging environments remains an unsolved problem, mainly due to the lack of data for training. In this paper, we develop a photo-realistic simulator that can afford the generation of large amounts of training data (both images rendered from the UAV camera and its controls) to teach a UAV to autonomously race through challenging tracks. We train a deep neural network to predict UAV controls from raw image data for the task of autonomous UAV racing. Training is done through imitation learning enabled by data augmentation to allow for the correction of navigation mistakes. Extensive experiments demonstrate that our trained network (when sufficient data augmentation is used) outperforms state-of-the-art methods and flies more consistently than many human pilots.

  14. Teaching UAVs to Race Using UE4Sim

    KAUST Repository

    Mueller, Matthias; Casser, Vincent; Smith, Neil; Michels, Dominik L.; Ghanem, Bernard

    2017-01-01

    Automating the navigation of unmanned aerial vehicles (UAVs) in diverse scenarios has gained much attention in the recent years. However, teaching UAVs to fly in challenging environments remains an unsolved problem, mainly due to the lack of data for training. In this paper, we develop a photo-realistic simulator that can afford the generation of large amounts of training data (both images rendered from the UAV camera and its controls) to teach a UAV to autonomously race through challenging tracks. We train a deep neural network to predict UAV controls from raw image data for the task of autonomous UAV racing. Training is done through imitation learning enabled by data augmentation to allow for the correction of navigation mistakes. Extensive experiments demonstrate that our trained network (when sufficient data augmentation is used) outperforms state-of-the-art methods and flies more consistently than many human pilots.

  15. Air Force UAVs: The Secret History

    Science.gov (United States)

    2010-07-01

    iA Mitchell Institute Study i Air Force UAVs The Secret History A Mitchell Institute Study July 2010 By Thomas P. Ehrhard Report Documentation Page...DATES COVERED 00-00-2010 to 00-00-2010 4. TITLE AND SUBTITLE Air Force UAVs The Secret History 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c...opening phases of Operation Enduring Freedom in Afghanistan. By Thomas P. Ehrhard a miTchEll insTiTuTE sTudy July 2010 Air Force UAVs The Secret History

  16. Uav-Based 3d Urban Environment Monitoring

    Science.gov (United States)

    Boonpook, Wuttichai; Tan, Yumin; Liu, Huaqing; Zhao, Binbin; He, Lingfeng

    2018-04-01

    Unmanned Aerial Vehicle (UAV) based remote sensing can be used to make three-dimensions (3D) mapping with great flexibility, besides the ability to provide high resolution images. In this paper we propose a quick-change detection method on UAV images by combining altitude from Digital Surface Model (DSM) and texture analysis from images. Cases of UAV images with and without georeferencing are both considered. Research results show that the accuracy of change detection can be enhanced with georeferencing procedure, and the accuracy and precision of change detection on UAV images which are collected both vertically and obliquely but without georeferencing also have a good performance.

  17. Review of the Current State of UAV Regulations

    Directory of Open Access Journals (Sweden)

    Claudia Stöcker

    2017-05-01

    Full Text Available UAVs—unmanned aerial vehicles—facilitate data acquisition at temporal and spatial scales that still remain unachievable for traditional remote sensing platforms. However, current legal frameworks that regulate UAVs present significant barriers to research and development. To highlight the importance, impact, and diversity of UAV regulations, this paper provides an exploratory investigation of UAV regulations on the global scale. For this, the methodological approach consists of a research synthesis of UAV regulations, including a thorough literature review and a comparative analysis of national regulatory frameworks. Similarities and contrasting elements in the various national UAV regulations are explored including their statuses from the perspectives of past, present, and future trends. Since the early 2000s, countries have gradually established national legal frameworks. Although all UAV regulations have one common goal—minimizing the risks to other airspace users and to both people and property on the ground—the results reveal distinct variations in all the compared variables. Furthermore, besides the clear presence of legal frameworks, market forces such as industry design standards and reliable information about UAVs as public goods are expected to shape future developments.

  18. Flight safety measurements of UAVs in congested airspace

    Directory of Open Access Journals (Sweden)

    Xiang Jinwu

    2016-10-01

    Full Text Available Describing spatial safety status is crucial for high-density air traffic involving multiple unmanned aerial vehicles (UAVs in a complex environment. A probabilistic approach is proposed to measure safety situation in congested airspace. The occupancy distribution of the airspace is represented with conflict probability between spatial positions and UAV. The concept of a safety envelope related to flight performance and response time is presented first instead of the conventional fixed-size protected zones around aircraft. Consequently, the conflict probability is performance-dependent, and effects of various UAVs on safety can be distinguished. The uncertainty of a UAV future position is explicitly accounted for as Brownian motion. An analytic approximate algorithm for the conflict probability is developed to decrease the computational consumption. The relationship between safety and flight performance are discussed for different response times and prediction intervals. To illustrate the applications of the approach, an experiment of three UAVs in formation flight is performed. In addition, an example of trajectory planning is simulated for one UAV flying over airspace where five UAVs exist. The validation of the approach shows its potential in guaranteeing flight safety in highly dynamic environment.

  19. Air Force UAV’s: The Secret History

    Science.gov (United States)

    2010-07-01

    iA Mitchell Institute Study i Air Force UAVs The Secret History A Mitchell Institute Study July 2010 By Thomas P. Ehrhard Report Documentation Page...DATES COVERED 00-00-2010 to 00-00-2010 4. TITLE AND SUBTITLE Air Force UAVs The Secret History 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c... The Secret History 2 Air Force UAVs: The Secret History2 air Force uaVs: The secret history Has any airplane in the past decade captured the public

  20. Unmanned aerial vehicles (UAVs) in pest management: Progress in the development of a UAV-deployed mating disruption system for Wisconsin cranberries

    Science.gov (United States)

    Unmanned aerial vehicles (UAVs) represent a powerful new tool for agriculture. Currently, UAVs are used almost exclusively as crop reconnaissance devices (“eyes in the sky”), not as pest control delivery systems. Research in Wisconsin cranberries is taking UAVs in a new direction. The Steffan and Lu...

  1. Spatiotemporal Super-Resolution Reconstruction Based on Robust Optical Flow and Zernike Moment for Video Sequences

    Directory of Open Access Journals (Sweden)

    Meiyu Liang

    2013-01-01

    Full Text Available In order to improve the spatiotemporal resolution of the video sequences, a novel spatiotemporal super-resolution reconstruction model (STSR based on robust optical flow and Zernike moment is proposed in this paper, which integrates the spatial resolution reconstruction and temporal resolution reconstruction into a unified framework. The model does not rely on accurate estimation of subpixel motion and is robust to noise and rotation. Moreover, it can effectively overcome the problems of hole and block artifacts. First we propose an efficient robust optical flow motion estimation model based on motion details preserving, then we introduce the biweighted fusion strategy to implement the spatiotemporal motion compensation. Next, combining the self-adaptive region correlation judgment strategy, we construct a fast fuzzy registration scheme based on Zernike moment for better STSR with higher efficiency, and then the final video sequences with high spatiotemporal resolution can be obtained by fusion of the complementary and redundant information with nonlocal self-similarity between the adjacent video frames. Experimental results demonstrate that the proposed method outperforms the existing methods in terms of both subjective visual and objective quantitative evaluations.

  2. Classification of video sequences into chosen generalized use classes of target size and lighting level.

    Science.gov (United States)

    Leszczuk, Mikołaj; Dudek, Łukasz; Witkowski, Marcin

    The VQiPS (Video Quality in Public Safety) Working Group, supported by the U.S. Department of Homeland Security, has been developing a user guide for public safety video applications. According to VQiPS, five parameters have particular importance influencing the ability to achieve a recognition task. They are: usage time-frame, discrimination level, target size, lighting level, and level of motion. These parameters form what are referred to as Generalized Use Classes (GUCs). The aim of our research was to develop algorithms that would automatically assist classification of input sequences into one of the GUCs. Target size and lighting level parameters were approached. The experiment described reveals the experts' ambiguity and hesitation during the manual target size determination process. However, the automatic methods developed for target size classification make it possible to determine GUC parameters with 70 % compliance to the end-users' opinion. Lighting levels of the entire sequence can be classified with an efficiency reaching 93 %. To make the algorithms available for use, a test application has been developed. It is able to process video files and display classification results, the user interface being very simple and requiring only minimal user interaction.

  3. A UAV-Based Fog Collector Design for Fine-Scale Aerobiological Sampling

    Science.gov (United States)

    Gentry, Diana; Guarro, Marcello; Demachkie, Isabella Siham; Stumfall, Isabel; Dahlgren, Robert P.

    2017-01-01

    Airborne microbes are found throughout the troposphere and into the stratosphere. Knowing how the activity of airborne microorganisms can alter water, carbon, and other geochemical cycles is vital to a full understanding of local and global ecosystems. Just as on the land or in the ocean, atmospheric regions vary in habitability; the underlying geochemical, climatic, and ecological dynamics must be characterized at different scales to be effectively modeled. Most aerobiological studies have focused on a high level: 'How high are airborne microbes found?' and 'How far can they travel?' Most fog and cloud water studies collect from stationary ground stations (point) or along flight transects (1D). To complement and provide context for this data, we have designed a UAV-based modified fog and cloud water collector to retrieve 4D-resolved samples for biological and chemical analysis.Our design uses a passive impacting collector hanging from a rigid rod suspended between two multi-rotor UAVs. The suspension design reduces the effect of turbulence and potential for contamination from the UAV downwash. The UAVs are currently modeled in a leader-follower configuration, taking advantage of recent advances in modular UAVs, UAV swarming, and flight planning.The collector itself is a hydrophobic mesh. Materials including Tyvek, PTFE, nylon, and polypropylene monofilament fabricated via laser cutting, CNC knife, or 3D printing were characterized for droplet collection efficiency using a benchtop atomizer and particle counter. Because the meshes can be easily and inexpensively fabricated, a set can be pre-sterilized and brought to the field for 'hot swapping' to decrease cross-contamination between flight sessions or use as negative controls.An onboard sensor and logging system records the time and location of each sample; when combined with flight tracking data, the samples can be resolved into a 4D volumetric map of the fog bank. Collected samples can be returned to the lab for

  4. Contour Detection for UAV-Based Cadastral Mapping

    Directory of Open Access Journals (Sweden)

    Sophie Crommelinck

    2017-02-01

    Full Text Available Unmanned aerial vehicles (UAVs provide a flexible and low-cost solution for the acquisition of high-resolution data. The potential of high-resolution UAV imagery to create and update cadastral maps is being increasingly investigated. Existing procedures generally involve substantial fieldwork and many manual processes. Arguably, multiple parts of UAV-based cadastral mapping workflows could be automated. Specifically, as many cadastral boundaries coincide with visible boundaries, they could be extracted automatically using image analysis methods. This study investigates the transferability of gPb contour detection, a state-of-the-art computer vision method, to remotely sensed UAV images and UAV-based cadastral mapping. Results show that the approach is transferable to UAV data and automated cadastral mapping: object contours are comprehensively detected at completeness and correctness rates of up to 80%. The detection quality is optimal when the entire scene is covered with one orthoimage, due to the global optimization of gPb contour detection. However, a balance between high completeness and correctness is hard to achieve, so a combination with area-based segmentation and further object knowledge is proposed. The localization quality exhibits the usual dependency on ground resolution. The approach has the potential to accelerate the process of general boundary delineation during the creation and updating of cadastral maps.

  5. AERIAL SURVEYING UAV BASED ON OPEN-SOURCE HARDWARE AND SOFTWARE

    Directory of Open Access Journals (Sweden)

    J. Mészáros

    2012-09-01

    Full Text Available In the last years the functionality and type of UAV-systems increased fast, but unfortunately these systems are hardly available for researchers in some cases. A simple and low-cost solution was developed to build an autonomous aerial surveying airplane, which can fulfil the necessities (aerial photographs with very-high resolution of other departments at the university and very useful and practical for teaching photogrammetry.. The base was a commercial, remote controlled model airplane and an open-source GPS/IMU system (MatrixPilot was adapted to achieve the semi-automatic or automatic stabilization and navigation of the model airplane along predefined trajectory. The firmware is completely open-source and easily available on the website of the project. The first used camera system was a low-budget, low-quality video camera, which could provide only 1.2 megapixel photographs or low resolution video depending on the light conditions and the desired spatial resolution. A field measurement test was carried out with the described system: the aerial surveying of an undiscovered archaeological site, signed by a crop-mark in mountain Pilis (Hungary.

  6. Commercial UAV operations in civil airspace

    Science.gov (United States)

    Newcome, Laurence R.

    2000-11-01

    The Federal Aviation Administration is often portrayed as the major impediment to unmanned aerial vehicle expansion into civil government and commercial markets. This paper describes one company's record for successfully negotiating the FAA regulations and obtaining authorizations for several types of UAVs to fly commercial reconnaissance missions in civil airspace. The process and criteria for obtaining such authorizations are described. The mishap records of the Pioneer, Predator and Hunter UAVs are examined in regard to their impact on FAA rule making. The paper concludes with a discussion of the true impediments to UAV penetration of commercial markets to date.

  7. Remote Marker-Based Tracking for UAV Landing Using Visible-Light Camera Sensor.

    Science.gov (United States)

    Nguyen, Phong Ha; Kim, Ki Wan; Lee, Young Won; Park, Kang Ryoung

    2017-08-30

    Unmanned aerial vehicles (UAVs), which are commonly known as drones, have proved to be useful not only on the battlefields where manned flight is considered too risky or difficult, but also in everyday life purposes such as surveillance, monitoring, rescue, unmanned cargo, aerial video, and photography. More advanced drones make use of global positioning system (GPS) receivers during the navigation and control loop which allows for smart GPS features of drone navigation. However, there are problems if the drones operate in heterogeneous areas with no GPS signal, so it is important to perform research into the development of UAVs with autonomous navigation and landing guidance using computer vision. In this research, we determined how to safely land a drone in the absence of GPS signals using our remote maker-based tracking algorithm based on the visible light camera sensor. The proposed method uses a unique marker designed as a tracking target during landing procedures. Experimental results show that our method significantly outperforms state-of-the-art object trackers in terms of both accuracy and processing time, and we perform test on an embedded system in various environments.

  8. UAV State Estimation Modeling Techniques in AHRS

    Science.gov (United States)

    Razali, Shikin; Zhahir, Amzari

    2017-11-01

    Autonomous unmanned aerial vehicle (UAV) system is depending on state estimation feedback to control flight operation. Estimation on the correct state improves navigation accuracy and achieves flight mission safely. One of the sensors configuration used in UAV state is Attitude Heading and Reference System (AHRS) with application of Extended Kalman Filter (EKF) or feedback controller. The results of these two different techniques in estimating UAV states in AHRS configuration are displayed through position and attitude graphs.

  9. Sub-band/transform compression of video sequences

    Science.gov (United States)

    Sauer, Ken; Bauer, Peter

    1992-01-01

    The progress on compression of video sequences is discussed. The overall goal of the research was the development of data compression algorithms for high-definition television (HDTV) sequences, but most of our research is general enough to be applicable to much more general problems. We have concentrated on coding algorithms based on both sub-band and transform approaches. Two very fundamental issues arise in designing a sub-band coder. First, the form of the signal decomposition must be chosen to yield band-pass images with characteristics favorable to efficient coding. A second basic consideration, whether coding is to be done in two or three dimensions, is the form of the coders to be applied to each sub-band. Computational simplicity is of essence. We review the first portion of the year, during which we improved and extended some of the previous grant period's results. The pyramid nonrectangular sub-band coder limited to intra-frame application is discussed. Perhaps the most critical component of the sub-band structure is the design of bandsplitting filters. We apply very simple recursive filters, which operate at alternating levels on rectangularly sampled, and quincunx sampled images. We will also cover the techniques we have studied for the coding of the resulting bandpass signals. We discuss adaptive three-dimensional coding which takes advantage of the detection algorithm developed last year. To this point, all the work on this project has been done without the benefit of motion compensation (MC). Motion compensation is included in many proposed codecs, but adds significant computational burden and hardware expense. We have sought to find a lower-cost alternative featuring a simple adaptation to motion in the form of the codec. In sequences of high spatial detail and zooming or panning, it appears that MC will likely be necessary for the proposed quality and bit rates.

  10. Synthesis of Control Algorithm for a Leaderheaded UAVs Group

    Directory of Open Access Journals (Sweden)

    I. O. Samodov

    2015-01-01

    Full Text Available Currently, a defense sphere uses unmanned aerial vehicles (UAVs. UAVs have several advantages over manned aircrafts such as small size, reduced combat losses of personnel, etc. In addition, in threat environment, it is necessary to arrange both bringing together distant from each other UAVs in a group and their undetected in radar fields compact flying in terms of the joint flight security.However, the task to control a UAVs group is much more difficult than to control a single UAV, since it is necessary not only to control the aircraft, but also take into account the relative position of objects in the group.To solve this problem two ways are possible: using a network exchange between members of the group on the "everyone with everyone" principle and organizing the leader-headed flight.The aim of the article is to develop and study a possible option of the UAVs group control with arranging a leader-headed flight to provide the undetected in radar fields compact flying in terms of the joint flight security.The article develops a universal algorithm to control leader-headed group, based on a new modification of the statistical theory of optimal control. It studies effectiveness of the algorithm. While solving this task, a flight of seven UAVs was simulated in the horizontal plane in a rectangular coordinate system. Control time, linear errors of desired alignment of UAV, and control errors with respect to angular coordinates are used as measures of merit.The study results of the algorithm to control a leader-headed group of UAVs confirmed that it is possible to fulfill tasks of flying free-of-collision group of UAVs with essentially reduced computational costs.

  11. RAVEN-2: Around-The-World UAV Project

    National Research Council Canada - National Science Library

    Burleigh, Chris

    2003-01-01

    The Raven around-the-world UAV project is part of an on-going effort to build up a significant European capability in the design, construction and operation of large UAVs and manned reconnaissance aircraft...

  12. Content-based video retrieval by example video clip

    Science.gov (United States)

    Dimitrova, Nevenka; Abdel-Mottaleb, Mohamed

    1997-01-01

    This paper presents a novel approach for video retrieval from a large archive of MPEG or Motion JPEG compressed video clips. We introduce a retrieval algorithm that takes a video clip as a query and searches the database for clips with similar contents. Video clips are characterized by a sequence of representative frame signatures, which are constructed from DC coefficients and motion information (`DC+M' signatures). The similarity between two video clips is determined by using their respective signatures. This method facilitates retrieval of clips for the purpose of video editing, broadcast news retrieval, or copyright violation detection.

  13. Development Situation, Trend and Countermeasure of Consumer-level UAV Market in China

    Directory of Open Access Journals (Sweden)

    Kang Yu-Lei

    2017-01-01

    Full Text Available This paper is based on the status of Chinese consumer-level UAV(Unmanned Aerial Vehicle market. According to the main problems in Chinese consumer-level UAV market, the author analyses the trends of Chinese consumer-level UAV market. Then, the author put forward some suggestions to develop Chinese consumer-level UAV market. In 21st century, the research and development expenditure presents the explosive growth in Chinese consumer-level UAV market. From the year of 2012, DJI released their first consumer-level UAV product. Amazon, Facebook, Google and other companies have announced their entry into the UAV market. In 2016, Huawei also announced that it will enter the UAV market.

  14. Automatic Reverse Engineering of Private Flight Control Protocols of UAVs

    Directory of Open Access Journals (Sweden)

    Ran Ji

    2017-01-01

    Full Text Available The increasing use of civil unmanned aerial vehicles (UAVs has the potential to threaten public safety and privacy. Therefore, airspace administrators urgently need an effective method to regulate UAVs. Understanding the meaning and format of UAV flight control commands by automatic protocol reverse-engineering techniques is highly beneficial to UAV regulation. To improve our understanding of the meaning and format of UAV flight control commands, this paper proposes a method to automatically analyze the private flight control protocols of UAVs. First, we classify flight control commands collected from a binary network trace into clusters; then, we analyze the meaning of flight control commands by the accumulated error of each cluster; next, we extract the binary format of commands and infer field semantics in these commands; and finally, we infer the location of the check field in command and the generator polynomial matrix. The proposed approach is validated via experiments on a widely used consumer UAV.

  15. Multiple UAV Cooperation for Wildfire Monitoring

    Science.gov (United States)

    Lin, Zhongjie

    Wildfires have been a major factor in the development and management of the world's forest. An accurate assessment of wildfire status is imperative for fire management. This thesis is dedicated to the topic of utilizing multiple unmanned aerial vehicles (UAVs) to cooperatively monitor a large-scale wildfire. This is achieved through wildfire spreading situation estimation based on on-line measurements and wise cooperation strategy to ensure efficiency. First, based on the understanding of the physical characteristics of the wildfire propagation behavior, a wildfire model and a Kalman filter-based method are proposed to estimate the wildfire rate of spread and the fire front contour profile. With the enormous on-line measurements from on-board sensors of UAVs, the proposed method allows a wildfire monitoring mission to benefit from on-line information updating, increased flexibility, and accurate estimation. An independent wildfire simulator is utilized to verify the effectiveness of the proposed method. Second, based on the filter analysis, wildfire spreading situation and vehicle dynamics, the influence of different cooperation strategies of UAVs to the overall mission performance is studied. The multi-UAV cooperation problem is formulated in a distributed network. A consensus-based method is proposed to help address the problem. The optimal cooperation strategy of UAVs is obtained through mathematical analysis. The derived optimal cooperation strategy is then verified in an independent fire simulation environment to verify its effectiveness.

  16. Introduction to UAV systems

    CERN Document Server

    Fahlstrom, Paul

    2012-01-01

    Unmanned aerial vehicles (UAVs) have been widely adopted in the military world over the last decade and the success of these military applications is increasingly driving efforts to establish unmanned aircraft in non-military roles. Introduction to UAV Systems, 4th edition provides a comprehensive introduction to all of the elements of a complete Unmanned Aircraft System (UAS). It addresses the air vehicle, mission planning and control, several types of mission payloads, data links and how they interact with mission performance, and launch and recovery concepts. This

  17. Slic Superpixels for Object Delineation from Uav Data

    Science.gov (United States)

    Crommelinck, S.; Bennett, R.; Gerke, M.; Koeva, M. N.; Yang, M. Y.; Vosselman, G.

    2017-08-01

    Unmanned aerial vehicles (UAV) are increasingly investigated with regard to their potential to create and update (cadastral) maps. UAVs provide a flexible and low-cost platform for high-resolution data, from which object outlines can be accurately delineated. This delineation could be automated with image analysis methods to improve existing mapping procedures that are cost, time and labor intensive and of little reproducibility. This study investigates a superpixel approach, namely simple linear iterative clustering (SLIC), in terms of its applicability to UAV data. The approach is investigated in terms of its applicability to high-resolution UAV orthoimages and in terms of its ability to delineate object outlines of roads and roofs. Results show that the approach is applicable to UAV orthoimages of 0.05 m GSD and extents of 100 million and 400 million pixels. Further, the approach delineates the objects with the high accuracy provided by the UAV orthoimages at completeness rates of up to 64 %. The approach is not suitable as a standalone approach for object delineation. However, it shows high potential for a combination with further methods that delineate objects at higher correctness rates in exchange of a lower localization quality. This study provides a basis for future work that will focus on the incorporation of multiple methods for an interactive, comprehensive and accurate object delineation from UAV data. This aims to support numerous application fields such as topographic and cadastral mapping.

  18. Flocking of quad-rotor UAVs with fuzzy control.

    Science.gov (United States)

    Mao, Xiang; Zhang, Hongbin; Wang, Yanhui

    2018-03-01

    This paper investigates the flocking problem of quad-rotor UAVs. Considering the actual situations, we derived a new simplified quad-rotor UAV model which is more reasonable. Based on the model, the T-S fuzzy model of attitude dynamic equation and the corresponding T-S fuzzy feedback controller are discussed. By introducing a double-loop control construction, we adjust its attitude to realize the position control. Then a flocking algorithm is proposed to achieve the flocking of the quad-rotor UAVs. Compared with the flocking algorithm of the mass point model, we dealt with the collision problem of the quad-rotor UAVs. In order to improve the airspace utilization, a more compact configuration called quasi e-lattice is constructed to guarantee the compact flight of the quad-rotor UAVs. Finally, numerical simulations are provided to illustrate the effectiveness of the obtained theoretical results. Copyright © 2018 ISA. Published by Elsevier Ltd. All rights reserved.

  19. Development of a bio-inspired UAV perching system

    Science.gov (United States)

    Xie, Pu

    Although technologies of unmanned aerial vehicles (UAVs) including micro air vehicles (MAVs) have been greatly advanced in the recent years, it is still very difficult for a UAV to perform some very challenging tasks such as perching to any desired spot reliably and agilely like a bird. Unlike the UAVs, the biological control mechanism of birds has been optimized through millions of year evolution and hence, they can perform many extremely maneuverability tasks, such as perching or grasping accurately and robustly. Therefore, we have good reason to learn from the nature in order to significantly improve the capabilities of UAVs. The development of a UAV perching system is becoming feasible, especially after a lot of research contributions in ornithology which involve the analysis of the bird's functionalities. Meanwhile, as technology advances in many engineering fields, such as airframes, propulsion, sensors, batteries, micro-electromechanical-system (MEMS), and UAV technology is also advancing rapidly. All of these research efforts in ornithology and the fast growing development technologies in UAV applications are motivating further interests and development in the area of UAV perching and grasping research. During the last decade, the research contributions about UAV perching and grasping were mainly based on fixed-wing, flapping-wing, and rotorcraft UAVs. However, most of the current researches in UAV systems with perching and grasping capability are focusing on either active (powered) grasping and perching or passive (unpowered) perching. Although birds do have both active and passive perching capabilities depending on their needs, there is no UAV perching system with both capabilities. In this project, we focused on filling this gap. Inspired by the anatomy analysis of bird legs and feet, a novel perching system has been developed to implement the bionics action for both active grasping and passive perching. In addition, for developing a robust and

  20. State-Of in Uav Remote Sensing Survey - First Insights Into Applications of Uav Sensing Systems

    Science.gov (United States)

    Aasen, H.

    2017-08-01

    UAVs are increasingly adapted as remote sensing platforms. Together with specialized sensors, they become powerful sensing systems for environmental monitoring and surveying. Spectral data has great capabilities to the gather information about biophysical and biochemical properties. Still, capturing meaningful spectral data in a reproducible way is not trivial. Since a couple of years small and lightweight spectral sensors, which can be carried on small flexible platforms, have become available. With their adaption in the community, the responsibility to ensure the quality of the data is increasingly shifted from specialized companies and agencies to individual researchers or research teams. Due to the complexity of the data acquisition of spectral data, this poses a challenge for the community and standardized protocols, metadata and best practice procedures are needed to make data intercomparable. In November 2016, the ESSEM COST action Innovative optical Tools for proximal sensing of ecophysiological processes (OPTIMISE; http://optimise.dcs.aber.ac.uk/) held a workshop on best practices for UAV spectral sampling. The objective of this meeting was to trace the way from particle to pixel and identify influences on the data quality / reliability, to figure out how well we are currently doing with spectral sampling from UAVs and how we can improve. Additionally, a survey was designed to be distributed within the community to get an overview over the current practices and raise awareness for the topic. This talk will introduce the approach of the OPTIMISE community towards best practises in UAV spectral sampling and present first results of the survey (http://optimise.dcs.aber.ac.uk/uav-survey/). This contribution briefly introduces the survey and gives some insights into the first results given by the interviewees.

  1. Energy-Efficient Power Allocation for UAV Cognitive Radio Systems

    KAUST Repository

    Sboui, Lokman

    2018-02-12

    We study the deployment of unmanned aerial vehicles (UAV) based cognitive system in an area covered by the primary network (PN). An UAV shares the spectrum of the PN and aims to maximize its energy efficiency (EE) by optimizing the transmit power. We focus on the case where the UAV simultaneously communicates with the ground receiver (G), under interference limitation, and with another relaying UAV (A), with a minimal required rate. We analytically develop the power allocation framework that maximizes the EE subject to power budget, interference, and minimal rate constraints. In the numerical results, we show that the minimal rate may cause a transmission outage at low power budget values. We also highlighted the existence of optimal altitudes given the UAV location with respect to the different other terminals.

  2. Energy-Efficient Power Allocation for UAV Cognitive Radio Systems

    KAUST Repository

    Sboui, Lokman; Ghazzai, Hakim; Rezki, Zouheir; Alouini, Mohamed-Slim

    2018-01-01

    We study the deployment of unmanned aerial vehicles (UAV) based cognitive system in an area covered by the primary network (PN). An UAV shares the spectrum of the PN and aims to maximize its energy efficiency (EE) by optimizing the transmit power. We focus on the case where the UAV simultaneously communicates with the ground receiver (G), under interference limitation, and with another relaying UAV (A), with a minimal required rate. We analytically develop the power allocation framework that maximizes the EE subject to power budget, interference, and minimal rate constraints. In the numerical results, we show that the minimal rate may cause a transmission outage at low power budget values. We also highlighted the existence of optimal altitudes given the UAV location with respect to the different other terminals.

  3. Assessing UAVs in Monitoring Crop Evapotranspiration within a Heterogeneous Soil

    Science.gov (United States)

    Rouze, G.; Neely, H.; Morgan, C.; Kustas, W. P.; McKee, L.; Prueger, J. H.; Cope, D.; Yang, C.; Thomasson, A.; Jung, J.

    2017-12-01

    Airborne and satellite remote sensing methods have been developed to provide ET estimates across entire management fields. However, airborne-based ET is not particularly cost-effective and satellite-based ET provides insufficient spatial/temporal information. ET estimations through remote sensing are also problematic where soils are highly variable within a given management field. Unlike airborne/satellite-based ET, Unmanned Aerial Vehicle (UAV)-based ET has the potential to increase the spatial and temporal detail of these measurements, particularly within a heterogeneous soil landscape. However, it is unclear to what extent UAVs can model ET. The overall goal of this project was to assess the capability of UAVs in modeling ET across a heterogeneous landscape. Within a 20-ha irrigated cotton field in Central Texas, low-altitude UAV surveys were conducted throughout the growing season over two soil types. UAVs were equipped with thermal and multispectral cameras to obtain canopy temperature and NDVI, respectively. UAV data were supplemented simultaneously with ground-truth measurements such as Leaf Area Index (LAI) and plant height. Both remote sensing and ground-truth parameters were used to model ET using a Two-Source Energy Balance (TSEB) model. UAV-based estimations of ET and other energy balance components were validated against energy balance measurements obtained from nearby eddy covariance towers that were installed within each soil type. UAV-based ET fluxes were also compared with airborne and satellite (Landsat 8)-based ET fluxes collected near the time of the UAV survey.

  4. Research on UAV Intelligent Obstacle Avoidance Technology During Inspection of Transmission Line

    Science.gov (United States)

    Wei, Chuanhu; Zhang, Fei; Yin, Chaoyuan; Liu, Yue; Liu, Liang; Li, Zongyu; Wang, Wanguo

    Autonomous obstacle avoidance of unmanned aerial vehicle (hereinafter referred to as UAV) in electric power line inspection process has important significance for operation safety and economy for UAV intelligent inspection system of transmission line as main content of UAV intelligent inspection system on transmission line. In the paper, principles of UAV inspection obstacle avoidance technology of transmission line are introduced. UAV inspection obstacle avoidance technology based on particle swarm global optimization algorithm is proposed after common obstacle avoidance technologies are studied. Stimulation comparison is implemented with traditional UAV inspection obstacle avoidance technology which adopts artificial potential field method. Results show that UAV inspection strategy of particle swarm optimization algorithm, adopted in the paper, is prominently better than UAV inspection strategy of artificial potential field method in the aspects of obstacle avoidance effect and the ability of returning to preset inspection track after passing through the obstacle. An effective method is provided for UAV inspection obstacle avoidance of transmission line.

  5. A method of fast mosaic for massive UAV images

    Science.gov (United States)

    Xiang, Ren; Sun, Min; Jiang, Cheng; Liu, Lei; Zheng, Hui; Li, Xiaodong

    2014-11-01

    With the development of UAV technology, UAVs are used widely in multiple fields such as agriculture, forest protection, mineral exploration, natural disaster management and surveillances of public security events. In contrast of traditional manned aerial remote sensing platforms, UAVs are cheaper and more flexible to use. So users can obtain massive image data with UAVs, but this requires a lot of time to process the image data, for example, Pix4UAV need approximately 10 hours to process 1000 images in a high performance PC. But disaster management and many other fields require quick respond which is hard to realize with massive image data. Aiming at improving the disadvantage of high time consumption and manual interaction, in this article a solution of fast UAV image stitching is raised. GPS and POS data are used to pre-process the original images from UAV, belts and relation between belts and images are recognized automatically by the program, in the same time useless images are picked out. This can boost the progress of finding match points between images. Levenberg-Marquard algorithm is improved so that parallel computing can be applied to shorten the time of global optimization notably. Besides traditional mosaic result, it can also generate superoverlay result for Google Earth, which can provide a fast and easy way to show the result data. In order to verify the feasibility of this method, a fast mosaic system of massive UAV images is developed, which is fully automated and no manual interaction is needed after original images and GPS data are provided. A test using 800 images of Kelan River in Xinjiang Province shows that this system can reduce 35%-50% time consumption in contrast of traditional methods, and increases respond speed of UAV image processing rapidly.

  6. Single and Multiple UAV Cyber-Attack Simulation and Performance Evaluation

    Directory of Open Access Journals (Sweden)

    Ahmad Y. Javaid

    2015-02-01

    Full Text Available Usage of ground, air and underwater unmanned vehicles (UGV, UAV and UUV has increased exponentially in the recent past with industries producing thousands of these unmanned vehicles every year.With the ongoing discussion of integration of UAVs in the US National Airspace, the need of a cost-effective way to verify the security and resilience of a group of communicating UAVs under attack has become very important. The answer to this need is a simulation testbed which can be used to simulate the UAV Network (UAVNet. One of these attempts is - UAVSim (Unmanned Aerial Vehicle Simulation testbed developed at the University of Toledo. It has the capability of simulating large UAV networks as well as small UAV networks with large number of attack nodes. In this paper, we analyse the performance of the simulation testbed for two attacks, targeting single and multiple UAVs. Traditional and generic computing resource available in a regular computer laboratory was used. Various evaluation results have been presented and analysed which suggest the suitability of UAVSim for UAVNet attack and swarm simulation applications.

  7. Surveillance mission planning for UAVs in GPS-denied urban environment

    Science.gov (United States)

    Pengfei, Wang

    In this thesis, the issues involved in the mission planning of UAVs for city surveillance have been studied. In this thesis, the research includes two major parts. Firstly, a mission planning system is developed that generates mission plans for a group of fixed-wing UAVs with on-board gimballed cameras to provide continuous surveillance over an urban area. Secondly, the problem of perching location selection (as part of perch-and-stare surveillance mission) for rotary-wing UAVs in a GPS-denied environment is studied. In this kind of mission, a UAV is dispatched to perch on a roof of a building to keep surveillance on a given target. The proposed algorithms to UAV surveillance mission planning (fixed-wing and rotary-wing) have been implemented and tested. It represents an important step towards achieving autonomous planning in UAV surveillance missions.

  8. Characteristic analysis on UAV-MIMO channel based on normalized correlation matrix.

    Science.gov (United States)

    Gao, Xi jun; Chen, Zi li; Hu, Yong Jiang

    2014-01-01

    Based on the three-dimensional GBSBCM (geometrically based double bounce cylinder model) channel model of MIMO for unmanned aerial vehicle (UAV), the simple form of UAV space-time-frequency channel correlation function which includes the LOS, SPE, and DIF components is presented. By the methods of channel matrix decomposition and coefficient normalization, the analytic formula of UAV-MIMO normalized correlation matrix is deduced. This formula can be used directly to analyze the condition number of UAV-MIMO channel matrix, the channel capacity, and other characteristic parameters. The simulation results show that this channel correlation matrix can be applied to describe the changes of UAV-MIMO channel characteristics under different parameter settings comprehensively. This analysis method provides a theoretical basis for improving the transmission performance of UAV-MIMO channel. The development of MIMO technology shows practical application value in the field of UAV communication.

  9. Mini UAV as an improvised air threat

    NARCIS (Netherlands)

    Kraker, K.J. de; Wiel, R.A.N. van de

    2013-01-01

    The use of UAVs for military and law enforcement purposes is increasing dramatically. Simultaneously, possible opponents are also developing UAV capabilities that they may deploy for their purposes. For example, a terrorist may deploy a commercially available model airplane or multicopter with an

  10. Use of an unmanned aerial vehicle-mounted video camera to assess feeding behavior of Raramuri Criollo cows

    Science.gov (United States)

    We determined the feasibility of using unmanned aerial vehicle (UAV) video monitoring to predict intake of discrete food items of rangeland-raised Raramuri Criollo non-nursing beef cows. Thirty-five cows were released into a 405-m2 rectangular dry lot, either in pairs (pilot tests) or individually (...

  11. SLIC superpixels for object delineation UAV data

    NARCIS (Netherlands)

    Crommelinck, Sophie Charlotte; Bennett, R.M.; Gerke, Markus; Koeva, M.N.; Yang, M.Y.; Vosselman, G.; Stachniss, C.; Förstner, W.; Schneider, J.

    2017-01-01

    Unmanned aerial vehicles (UAV) are increasingly investigated with regard to their potential to create and update (cadastral) maps. UAVs provide a flexible and low-cost platform for high-resolution data, from which object outlines can be accurately delineated. This delineation could be automated with

  12. EMERGENCY RADIATION SURVEY DEVICE ONBOARD THE UAV

    Directory of Open Access Journals (Sweden)

    S. Bogatov

    2013-08-01

    Full Text Available Radiation survey device (RSD on the base of unmanned aerial vehicle (UAV was developed as an equipment of rescue forces for radiation situation reconnaissance in case of emergency. RSD is multi range radiometer with spectrometer functions capable to work within gamma ray fields of dose rate 10–7 – 10–1 Sievert per hour. UAV md4-1000 (Microdrones GmbH, Germany was selected as the RSD carrier as a reliable vehicle with appropriate properties. Short description of RSD, UAV and developed software features as well as sensitivity assessments for different radiation sources are presented.

  13. Dynamic Data-Driven UAV Network for Plume Characterization

    Science.gov (United States)

    2016-05-23

    AFRL-AFOSR-VA-TR-2016-0203 Dynamic Data-Driven UAV Network for Plume Characterization Kamran Mohseni UNIVERSITY OF FLORIDA Final Report 05/23/2016...AND SUBTITLE Dynamic Data-Driven UAV Network for Plume Characterization 5a.  CONTRACT NUMBER 5b.  GRANT NUMBER FA9550-13-1-0090 5c.  PROGRAM ELEMENT...studied a dynamic data driven (DDD) approach to operation of a heterogeneous team of unmanned aerial vehicles ( UAVs ) or micro/miniature aerial

  14. Implications of longitude and latitude on the size of solar-powered UAV

    International Nuclear Information System (INIS)

    Rajendran, Parvathy; Smith, Howard

    2015-01-01

    Highlights: • We studied solar irradiance and daylight implication on solar-powered UAV design. • We explored for perpetual UAV flight for 12 cities around the world. • All year round solar-powered UAV operation possible for cities near equatorial line. • Cities in latitudes of ±35° are the optimal for solar-powered UAV. • Longitudinal coordinates and elevation have a minor effect on UAV design. - Abstract: The implication of solar irradiance and daylight duration on the design of a small solar-powered unmanned aerial vehicle (UAV) that is capable of operating perpetually in various cities around the world was investigated. Solar data in 2013 on 12 cities distributed around the world was collected. The effects of the available solar irradiance and daylight of the city on the maximum take-off weight and wing span of a small solar-powered UAV were studied. The analysis indicates that daylight duration is as important as the available solar irradiance to the performance of the solar-powered UAV. Longitudinal coordinates and elevation have a minor effect on the estimation of daylight duration. Areas considerably high in solar irradiance and daylight duration are more conducive to the effective performance of solar-powered UAVs than other areas. Therefore, cities closer to the equator have an advantage in utilizing solar-powered UAVs; where smaller and lighter solar-powered UAV can be designed

  15. Aerial photogrammetry procedure optimized for micro uav

    Directory of Open Access Journals (Sweden)

    T. Anai

    2014-06-01

    Full Text Available This paper proposes the automatic aerial photogrammetry procedure optimized for Micro UAV that has ability of autonomous flight. The most important goal of our proposed method is the reducing the processing cost for fully automatic reconstruction of DSM from a large amount of image obtained from Micro UAV. For this goal, we have developed automatic corresponding point generation procedure using feature point tracking algorithm considering position and attitude information, which obtained from onboard GPS-IMU integrated on Micro UAV. In addition, we have developed the automatic exterior orientation and registration procedure from the automatic generated corresponding points on each image and position and attitude information from Micro UAV. Moreover, in order to reconstruct precise DSM, we have developed the area base matching process which considering edge information. In this paper, we describe processing flow of our automatic aerial photogrammetry. Moreover, the accuracy assessment is also described. Furthermore, some application of automatic reconstruction of DSM will be desired.

  16. From random process to chaotic behavior in swarms of UAVs

    OpenAIRE

    Rosalie , Martin; Danoy , Grégoire; Chaumette , Serge; Bouvry , Pascal

    2016-01-01

    International audience; Unmanned Aerial Vehicles (UAVs) applications have seen an important increase in the last decade for both military and civilian applications ranging from fire and high seas rescue to military surveillance and target detection. While this technology is now mature for a single UAV, new methods are needed to operate UAVs in swarms, also referred to as fleets. This work focuses on the mobility management of one single autonomous swarm of UAVs which mission is to cover a giv...

  17. Critical infrastructure monitoring using UAV imagery

    Science.gov (United States)

    Maltezos, Evangelos; Skitsas, Michael; Charalambous, Elisavet; Koutras, Nikolaos; Bliziotis, Dimitris; Themistocleous, Kyriacos

    2016-08-01

    The constant technological evolution in Computer Vision enabled the development of new techniques which in conjunction with the use of Unmanned Aerial Vehicles (UAVs) may extract high quality photogrammetric products for several applications. Dense Image Matching (DIM) is a Computer Vision technique that can generate a dense 3D point cloud of an area or object. The use of UAV systems and DIM techniques is not only a flexible and attractive solution to produce accurate and high qualitative photogrammetric results but also is a major contribution to cost effectiveness. In this context, this study aims to highlight the benefits of the use of the UAVs in critical infrastructure monitoring applying DIM. A Multi-View Stereo (MVS) approach using multiple images (RGB digital aerial and oblique images), to fully cover the area of interest, is implemented. The application area is an Olympic venue in Attica, Greece, at an area of 400 acres. The results of our study indicate that the UAV+DIM approach respond very well to the increasingly greater demands for accurate and cost effective applications when provided with, a 3D point cloud and orthomosaic.

  18. UAV formation control design with obstacle avoidance in dynamic three-dimensional environment.

    Science.gov (United States)

    Chang, Kai; Xia, Yuanqing; Huang, Kaoli

    2016-01-01

    This paper considers the artificial potential field method combined with rotational vectors for a general problem of multi-unmanned aerial vehicle (UAV) systems tracking a moving target in dynamic three-dimensional environment. An attractive potential field is generated between the leader and the target. It drives the leader to track the target based on the relative position of them. The other UAVs in the formation are controlled to follow the leader by the attractive control force. The repulsive force affects among the UAVs to avoid collisions and distribute the UAVs evenly on the spherical surface whose center is the leader-UAV. Specific orders or positions of the UAVs are not required. The trajectories of avoidance obstacle can be obtained through two kinds of potential field with rotation vectors. Every UAV can choose the optimal trajectory to avoid the obstacle and reconfigure the formation after passing the obstacle. Simulations study on UAV are presented to demonstrate the effectiveness of proposed method.

  19. Subjective Video Quality Assessment in H.264/AVC Video Coding Standard

    Directory of Open Access Journals (Sweden)

    Z. Miličević

    2012-11-01

    Full Text Available This paper seeks to provide an approach for subjective video quality assessment in the H.264/AVC standard. For this purpose a special software program for the subjective assessment of quality of all the tested video sequences is developed. It was developed in accordance with recommendation ITU-T P.910, since it is suitable for the testing of multimedia applications. The obtained results show that in the proposed selective intra prediction and optimized inter prediction algorithm there is a small difference in picture quality (signal-to-noise ratio between decoded original and modified video sequences.

  20. Application of Unmanned Air Vehicles (UAV) in monitoring of terrestrial habitats

    DEFF Research Database (Denmark)

    Sørensen, Peter Borgen; Strandberg, Beate; Bak, Jesper Leth

    2015-01-01

    I the last years there have been high focus on UAVs (drones) for many civil purposes and UAVs are also increasingly used for ecological data gathering. This presentation will first make an appetizer to show the new possibilities of using UAVs. The traditional concept of separating “data......” that are “real” from “models” that are “simulations” has to be refined in the area of field investigations, in order to utilize UAVs to make a revolution in data and understanding about the terrestrial habitats. However, this is not straightforward, and the presentation will line up the obstacles for using UAVs...

  1. Multi-UAV Flight using Virtual Structure Combined with Behavioral Approach

    Directory of Open Access Journals (Sweden)

    Kownacki Cezary

    2016-06-01

    Full Text Available Implementations of multi-UAV systems can be divided mainly into two different approaches, centralised system that synchronises positions of each vehicle by a ground station and an autonomous system based on decentralised control, which offers more flexibility and independence. Decentralisation of multi-UAV control entails the need for information sharing between all vehicles, what in some cases could be problematic due to a significant amount of data to be sent over the wireless network. To improve the reliability and the throughput of information sharing inside the formation of UAVs, this paper proposes an approach that combines virtual structure with a leader and two flocking behaviours. Each UAV has assigned different virtual migration point referenced to the leader's position which is simultaneously the origin of a formation reference frame. All migration points create together a virtual rigid structure. Each vehicle uses local behaviours of cohesion and repulsion respectively, to track its own assigned point in the structure and to avoid a collision with the previous UAV in the structure. To calculate parameters of local behaviours, each UAV should know position and attitude of the leader to define the formation reference frame and also the actual position of the previous UAV in the structure. Hence, information sharing can be based on a chain of local peer-to-peer communication between two consecutive vehicles in the structure. In such solution, the information about the leader could be sequentially transmitted from one UAV to another. Numerical simulations were prepared and carried out to verify the effectiveness of the presented approach. Trajectories recorded during those simulations show collective, coherence and collision-free flights of the formation created with five UAVs.

  2. Classical Photogrammetry and Uav - Selected Ascpects

    Science.gov (United States)

    Mikrut, S.

    2016-06-01

    The UAV technology seems to be highly future-oriented due to its low costs as compared to traditional aerial images taken from classical photogrammetry aircrafts. The AGH University of Science and Technology in Cracow - Department of Geoinformation, Photogrammetry and Environmental Remote Sensing focuses mainly on geometry and radiometry of recorded images. Various scientific research centres all over the world have been conducting the relevant research for years. The paper presents selected aspects of processing digital images made with the UAV technology. It provides on a practical example a comparison between a digital image taken from an airborne (classical) height, and the one made from an UAV level. In his research the author of the paper is trying to find an answer to the question: to what extent does the UAV technology diverge today from classical photogrammetry, and what are the advantages and disadvantages of both methods? The flight plan was made over the Tokarnia Village Museum (more than 0.5 km2) for two separate flights: the first was made by an UAV - System FT-03A built by FlyTech Solution Ltd. The second was made with the use of a classical photogrammetric Cesna aircraft furnished with an airborne photogrammetric camera (Ultra Cam Eagle). Both sets of photographs were taken with pixel size of about 3 cm, in order to have reliable data allowing for both systems to be compared. The project has made aerotriangulation independently for the two flights. The DTM was generated automatically, and the last step was the generation of an orthophoto. The geometry of images was checked under the process of aerotriangulation. To compare the accuracy of these two flights, control and check points were used. RMSE were calculated. The radiometry was checked by a visual method and using the author's own algorithm for feature extraction (to define edges with subpixel accuracy). After initial pre-processing of data, the images were put together, and shown side by side

  3. Landing spot selection for UAV emergency landing

    NARCIS (Netherlands)

    Eendebak, P.T.; Eekeren, A.W.M. van; Hollander, R.J.M. den

    2013-01-01

    We present a robust method for landing zone selection using obstacle detection to be used for UAV emergency landings. The method is simple enough to allow real-time implementation on a UAV system. The method is able to detect objects in the presence of camera movement and motion parallax. Using the

  4. SUSI 62 A ROBUST AND SAFE PARACHUTE UAV WITH LONG FLIGHT TIME AND GOOD PAYLOAD

    Directory of Open Access Journals (Sweden)

    H. P. Thamm

    2012-09-01

    Full Text Available In many research areas in the geo-sciences (erosion, land use, land cover change, etc. or applications (e.g. forest management, mining, land management etc. there is a demand for remote sensing images of a very high spatial and temporal resolution. Due to the high costs of classic aerial photo campaigns, the use of a UAV is a promising option for obtaining the desired remote sensed information at the time it is needed. However, the UAV must be easy to operate, safe, robust and should have a high payload and long flight time. For that purpose, the parachute UAV SUSI 62 was developed. It consists of a steel frame with a powerful 62 cm3 2- stroke engine and a parachute wing. The frame can be easily disassembled for transportation or to replace parts. On the frame there is a gimbal mounted sensor carrier where different sensors, standard SLR cameras and/or multi-spectral and thermal sensors can be mounted. Due to the design of the parachute, the SUSI 62 is very easy to control. Two different parachute sizes are available for different wind speed conditions. The SUSI 62 has a payload of up to 8 kg providing options to use different sensors at the same time or to extend flight duration. The SUSI 62 needs a runway of between 10 m and 50 m, depending on the wind conditions. The maximum flight speed is approximately 50 km/h. It can be operated in a wind speed of up to 6 m/s. The design of the system utilising a parachute UAV makes it comparatively safe as a failure of the electronics or the remote control only results in the UAV coming to the ground at a slow speed. The video signal from the camera, the GPS coordinates and other flight parameters are transmitted to the ground station in real time. An autopilot is available, which guarantees that the area of investigation is covered at the desired resolution and overlap. The robustly designed SUSI 62 has been used successfully in Europe, Africa and Australia for scientific projects and also for

  5. Quasi-ADS-B Based UAV Conflict Detection and Resolution to Manned Aircraft

    Directory of Open Access Journals (Sweden)

    Chin E. Lin

    2015-01-01

    Full Text Available A Conflict Detection and Resolution (CD&R system for manned/unmanned aerial vehicle (UAV based on Automatic Dependent Surveillance-Broadcast (ADS-B concept is designed and verified in this paper. The 900 MHz XBee-Pro is selected as data transponder to broadcast flight information among participating aircraft in omnirange. Standard Compact Position Report (CPR format packet data are automatically broadcasted by ID sequencing under Quasi-ADS-B mechanism. Time Division Multiple Access (TDMA monitoring checks the designated time slot and reallocates the conflict ID. This mechanism allows the transponder to effectively share data with multiple aircraft in near airspace. The STM32f103 microprocessor is designed to handle RF, GPS, and flight data with Windows application on manned aircraft and ground control station simultaneously. Different conflict detection and collision avoidance algorithms can be implemented into the system to ensure flight safety. The proposed UAV/CD&R using Quasi-ADS-B transceiver is tested using ultralight aircraft flying at 100–120 km/hr speed in small airspace for mission simulation. The proposed hardware is also useful to additional applications to mountain hikers for emergency search and rescue. The fundamental function by the proposed UAV/CD&R using Quasi-ADS-B is verified with effective signal broadcasting for surveillance and efficient collision alert and avoidance performance to low altitude flights.

  6. Unmanned Aerial Vehicles (UAVs and Artificial Intelligence Revolutionizing Wildlife Monitoring and Conservation

    Directory of Open Access Journals (Sweden)

    Luis F. Gonzalez

    2016-01-01

    Full Text Available Surveying threatened and invasive species to obtain accurate population estimates is an important but challenging task that requires a considerable investment in time and resources. Estimates using existing ground-based monitoring techniques, such as camera traps and surveys performed on foot, are known to be resource intensive, potentially inaccurate and imprecise, and difficult to validate. Recent developments in unmanned aerial vehicles (UAV, artificial intelligence and miniaturized thermal imaging systems represent a new opportunity for wildlife experts to inexpensively survey relatively large areas. The system presented in this paper includes thermal image acquisition as well as a video processing pipeline to perform object detection, classification and tracking of wildlife in forest or open areas. The system is tested on thermal video data from ground based and test flight footage, and is found to be able to detect all the target wildlife located in the surveyed area. The system is flexible in that the user can readily define the types of objects to classify and the object characteristics that should be considered during classification.

  7. Unmanned Aerial Vehicles (UAVs) and Artificial Intelligence Revolutionizing Wildlife Monitoring and Conservation.

    Science.gov (United States)

    Gonzalez, Luis F; Montes, Glen A; Puig, Eduard; Johnson, Sandra; Mengersen, Kerrie; Gaston, Kevin J

    2016-01-14

    Surveying threatened and invasive species to obtain accurate population estimates is an important but challenging task that requires a considerable investment in time and resources. Estimates using existing ground-based monitoring techniques, such as camera traps and surveys performed on foot, are known to be resource intensive, potentially inaccurate and imprecise, and difficult to validate. Recent developments in unmanned aerial vehicles (UAV), artificial intelligence and miniaturized thermal imaging systems represent a new opportunity for wildlife experts to inexpensively survey relatively large areas. The system presented in this paper includes thermal image acquisition as well as a video processing pipeline to perform object detection, classification and tracking of wildlife in forest or open areas. The system is tested on thermal video data from ground based and test flight footage, and is found to be able to detect all the target wildlife located in the surveyed area. The system is flexible in that the user can readily define the types of objects to classify and the object characteristics that should be considered during classification.

  8. Real-Time 3d Reconstruction from Images Taken from AN Uav

    Science.gov (United States)

    Zingoni, A.; Diani, M.; Corsini, G.; Masini, A.

    2015-08-01

    We designed a method for creating 3D models of objects and areas from two aerial images acquired from an UAV. The models are generated automatically and in real-time, and consist in dense and true-colour reconstructions of the considered areas, which give the impression to the operator to be physically present within the scene. The proposed method only needs a cheap compact camera, mounted on a small UAV. No additional instrumentation is necessary, so that the costs are very limited. The method consists of two main parts: the design of the acquisition system and the 3D reconstruction algorithm. In the first part, the choices for the acquisition geometry and for the camera parameters are optimized, in order to yield the best performance. In the second part, a reconstruction algorithm extracts the 3D model from the two acquired images, maximizing the accuracy under the real-time constraint. A test was performed in monitoring a construction yard, obtaining very promising results. Highly realistic and easy-to-interpret 3D models of objects and areas of interest were produced in less than one second, with an accuracy of about 0.5m. For its characteristics, the designed method is suitable for video-surveillance, remote sensing and monitoring, especially in those applications that require intuitive and reliable information quickly, as disasters monitoring, search and rescue and area surveillance.

  9. Review of the current state of UAV regulations

    NARCIS (Netherlands)

    Stöcker, Elvira Claudia; Bennett, Rohan; Nex, Francesco; Gerke, Markus; Zevenbergen, Jaap

    2017-01-01

    UAVs-unmanned aerial vehicles-facilitate data acquisition at temporal and spatial scales that still remain unachievable for traditional remote sensing platforms. However, current legal frameworks that regulate UAVs present significant barriers to research and development. To highlight the

  10. USING DISTANCE SENSORS TO PERFORM COLLISION AVOIDANCE MANEUVRES ON UAV APPLICATIONS

    Directory of Open Access Journals (Sweden)

    A. Raimundo

    2017-08-01

    Full Text Available The Unmanned Aerial Vehicles (UAV and its applications are growing for both civilian and military purposes. The operability of an UAV proved that some tasks and operations can be done easily and at a good cost-efficiency ratio. Nowadays, an UAV can perform autonomous missions. It is very useful to certain UAV applications, such as meteorology, vigilance systems, agriculture, environment mapping and search and rescue operations. One of the biggest problems that an UAV faces is the possibility of collision with other objects in the flight area. To avoid this, an algorithm was developed and implemented in order to prevent UAV collision with other objects. “Sense and Avoid” algorithm was developed as a system for UAVs to avoid objects in collision course. This algorithm uses a Light Detection and Ranging (LiDAR, to detect objects facing the UAV in mid-flights. This light sensor is connected to an on-board hardware, Pixhawk’s flight controller, which interfaces its communications with another hardware: Raspberry Pi. Communications between Ground Control Station and UAV are made via Wi-Fi or cellular third or fourth generation (3G/4G. Some tests were made in order to evaluate the “Sense and Avoid” algorithm’s overall performance. These tests were done in two different environments: A 3D simulated environment and a real outdoor environment. Both modes worked successfully on a simulated 3D environment, and “Brake” mode on a real outdoor, proving its concepts.

  11. Using Distance Sensors to Perform Collision Avoidance Maneuvres on Uav Applications

    Science.gov (United States)

    Raimundo, A.; Peres, D.; Santos, N.; Sebastião, P.; Souto, N.

    2017-08-01

    The Unmanned Aerial Vehicles (UAV) and its applications are growing for both civilian and military purposes. The operability of an UAV proved that some tasks and operations can be done easily and at a good cost-efficiency ratio. Nowadays, an UAV can perform autonomous missions. It is very useful to certain UAV applications, such as meteorology, vigilance systems, agriculture, environment mapping and search and rescue operations. One of the biggest problems that an UAV faces is the possibility of collision with other objects in the flight area. To avoid this, an algorithm was developed and implemented in order to prevent UAV collision with other objects. "Sense and Avoid" algorithm was developed as a system for UAVs to avoid objects in collision course. This algorithm uses a Light Detection and Ranging (LiDAR), to detect objects facing the UAV in mid-flights. This light sensor is connected to an on-board hardware, Pixhawk's flight controller, which interfaces its communications with another hardware: Raspberry Pi. Communications between Ground Control Station and UAV are made via Wi-Fi or cellular third or fourth generation (3G/4G). Some tests were made in order to evaluate the "Sense and Avoid" algorithm's overall performance. These tests were done in two different environments: A 3D simulated environment and a real outdoor environment. Both modes worked successfully on a simulated 3D environment, and "Brake" mode on a real outdoor, proving its concepts.

  12. Current development of UAV sense and avoid system

    Science.gov (United States)

    Zhahir, A.; Razali, A.; Mohd Ajir, M. R.

    2016-10-01

    As unmanned aerial vehicles (UAVs) are now gaining high interests from civil and commercialised market, the automatic sense and avoid (SAA) system is currently one of the essential features in research spotlight of UAV. Several sensor types employed in current SAA research and technology of sensor fusion that offers a great opportunity in improving detection and tracking system are presented here. The purpose of this paper is to provide an overview of SAA system development in general, as well as the current challenges facing UAV researchers and designers.

  13. Learning with Technology: Video Modeling with Concrete-Representational-Abstract Sequencing for Students with Autism Spectrum Disorder

    Science.gov (United States)

    Yakubova, Gulnoza; Hughes, Elizabeth M.; Shinaberry, Megan

    2016-01-01

    The purpose of this study was to determine the effectiveness of a video modeling intervention with concrete-representational-abstract instructional sequence in teaching mathematics concepts to students with autism spectrum disorder (ASD). A multiple baseline across skills design of single-case experimental methodology was used to determine the…

  14. Extracting a Good Quality Frontal Face Image from a Low-Resolution Video Sequence

    DEFF Research Database (Denmark)

    Nasrollahi, Kamal; Moeslund, Thomas B.

    2011-01-01

    Feeding low-resolution and low-quality images, from inexpensive surveillance cameras, to systems like, e.g., face recognition, produces erroneous and unstable results. Therefore, there is a need for a mechanism to bridge the gap between on one hand low-resolution and low-quality images......, we use a learning-based super-resolution algorithm applied to the result of the reconstruction-based part to improve the quality by another factor of two. This results in an improvement factor of four for the entire system. The proposed system has been tested on 122 low-resolution sequences from two...... different databases. The experimental results show that the proposed system can indeed produce a high-resolution and good quality frontal face image from low-resolution video sequences....

  15. A Natural Interaction Interface for UAVs Using Intuitive Gesture Recognition

    Science.gov (United States)

    Chandarana, Meghan; Trujillo, Anna; Shimada, Kenji; Allen, Danette

    2016-01-01

    The popularity of unmanned aerial vehicles (UAVs) is increasing as technological advancements boost their favorability for a broad range of applications. One application is science data collection. In fields like Earth and atmospheric science, researchers are seeking to use UAVs to augment their current portfolio of platforms and increase their accessibility to geographic areas of interest. By increasing the number of data collection platforms UAVs will significantly improve system robustness and allow for more sophisticated studies. Scientists would like be able to deploy an available fleet of UAVs to fly a desired flight path and collect sensor data without needing to understand the complex low-level controls required to describe and coordinate such a mission. A natural interaction interface for a Ground Control System (GCS) using gesture recognition is developed to allow non-expert users (e.g., scientists) to define a complex flight path for a UAV using intuitive hand gesture inputs from the constructed gesture library. The GCS calculates the combined trajectory on-line, verifies the trajectory with the user, and sends it to the UAV controller to be flown.

  16. An Efficient Fractal Video Sequences Codec with Multiviews

    Directory of Open Access Journals (Sweden)

    Shiping Zhu

    2013-01-01

    Full Text Available Multiview video consists of multiple views of the same scene. They require enormous amount of data to achieve high image quality, which makes it indispensable to compress multiview video. Therefore, data compression is a major issue for multiviews. In this paper, we explore an efficient fractal video codec to compress multiviews. The proposed scheme first compresses a view-dependent geometry of the base view using fractal video encoder with homogeneous region condition. With the extended fractional pel motion estimation algorithm and fast disparity estimation algorithm, it then generates prediction images of other views. The prediction image uses the image-based rendering techniques based on the decoded video. And the residual signals are obtained by the prediction image and the original image. Finally, it encodes residual signals by the fractal video encoder. The idea is also to exploit the statistical dependencies from both temporal and interview reference pictures for motion compensated prediction. Experimental results show that the proposed algorithm is consistently better than JMVC8.5, with 62.25% bit rate decrease and 0.37 dB PSNR increase based on the Bjontegaard metric, and the total encoding time (TET of the proposed algorithm is reduced by 92%.

  17. UAV Robust Strategy Control Based on MAS

    Directory of Open Access Journals (Sweden)

    Jian Han

    2014-01-01

    Full Text Available A novel multiagent system (MAS has been proposed to integrate individual UAV (unmanned aerial vehicle to form a UAV team which can accomplish complex missions with better efficiency and effect. The MAS based UAV team control is more able to conquer dynamic situations and enhance the performance of any single UAV. In this paper, the MAS proposed and established combines the reacting and thinking abilities to be an initiative and autonomous hybrid system which can solve missions involving coordinated flight and cooperative operation. The MAS uses BDI model to support its logical perception and to classify the different missions; then the missions will be allocated by utilizing auction mechanism after analyzing dynamic parameters. Prim potential algorithm, particle swarm algorithm, and reallocation mechanism are proposed to realize the rational decomposing and optimal allocation in order to reach the maximum profit. After simulation, the MAS has been proved to be able to promote the success ratio and raise the robustness, while realizing feasibility of coordinated flight and optimality of cooperative mission.

  18. Persistent Aerial Tracking

    KAUST Repository

    Mueller, Matthias

    2016-04-13

    In this thesis, we propose a new aerial video dataset and benchmark for low altitude UAV target tracking, as well as, a photo-realistic UAV simulator that can be coupled with tracking methods. Our benchmark provides the rst evaluation of many state of-the-art and popular trackers on 123 new and fully annotated HD video sequences captured from a low-altitude aerial perspective. Among the compared trackers, we determine which ones are the most suitable for UAV tracking both in terms of tracking accuracy and run-time. We also present a simulator that can be used to evaluate tracking algorithms in real-time scenarios before they are deployed on a UAV "in the field", as well as, generate synthetic but photo-realistic tracking datasets with free ground truth annotations to easily extend existing real-world datasets. Both the benchmark and simulator will be made publicly available to the vision community to further research in the area of object tracking from UAVs. Additionally, we propose a persistent, robust and autonomous object tracking system for unmanned aerial vehicles (UAVs) called Persistent Aerial Tracking (PAT). A computer vision and control strategy is applied to a diverse set of moving objects (e.g. humans, animals, cars, boats, etc.) integrating multiple UAVs with a stabilized RGB camera. A novel strategy is employed to successfully track objects over a long period, by \\'handing over the camera\\' from one UAV to another. We integrate the complete system into an off-the-shelf UAV, and obtain promising results showing the robustness of our solution in real-world aerial scenarios.

  19. Volumetric calculation using low cost unmanned aerial vehicle (UAV) approach

    Science.gov (United States)

    Rahman, A. A. Ab; Maulud, K. N. Abdul; Mohd, F. A.; Jaafar, O.; Tahar, K. N.

    2017-12-01

    Unmanned Aerial Vehicles (UAV) technology has evolved dramatically in the 21st century. It is used by both military and general public for recreational purposes and mapping work. Operating cost for UAV is much cheaper compared to that of normal aircraft and it does not require a large work space. The UAV systems have similar functions with the LIDAR and satellite images technologies. These systems require a huge cost, labour and time consumption to produce elevation and dimension data. Measurement of difficult objects such as water tank can also be done by using UAV. The purpose of this paper is to show the capability of UAV to compute the volume of water tank based on a different number of images and control points. The results were compared with the actual volume of the tank to validate the measurement. In this study, the image acquisition was done using Phantom 3 Professional, which is a low cost UAV. The analysis in this study is based on different volume computations using two and four control points with variety set of UAV images. The results show that more images will provide a better quality measurement. With 95 images and four GCP, the error percentage to the actual volume is about 5%. Four controls are enough to get good results but more images are needed, estimated about 115 until 220 images. All in all, it can be concluded that the low cost UAV has a potential to be used for volume of water and dimension measurement.

  20. Image restoration for civil engineering structure monitoring using imaging system embedded on UAV

    Science.gov (United States)

    Vozel, Benoit; Dumoulin, Jean; Chehdi, Kacem

    2013-04-01

    Nowadays, civil engineering structures are periodically surveyed by qualified technicians (i.e. alpinist) operating visual inspection using heavy mechanical pods. This method is far to be safe, not only for civil engineering structures monitoring staff, but also for users. Due to the unceasing traffic increase, making diversions or closing lanes on bridge becomes more and more difficult. New inspection methods have to be found. One of the most promising technique is to develop inspection method using images acquired by a dedicated monitoring system operating around the civil engineering structures, without disturbing the traffic. In that context, the use of images acquired with an UAV, which fly around the structures is of particular interest. The UAV can be equipped with different vision system (digital camera, infrared sensor, video, etc.). Nonetheless, detection of small distresses on images (like cracks of 1 mm or less) depends on image quality, which is sensitive to internal parameters of the UAV (vibration modes, video exposure times, etc.) and to external parameters (turbulence, bad illumination of the scene, etc.). Though progresses were made at UAV level and at sensor level (i.e. optics), image deterioration is still an open problem. These deteriorations are mainly represented by motion blur that can be coupled with out-of-focus blur and observation noise on acquired images. In practice, deteriorations are unknown if no a priori information is available or dedicated additional instrumentation is set-up at UAV level. Image restoration processing is therefore required. This is a difficult problem [1-3] which has been intensively studied over last decades [4-12]. Image restoration can be addressed by following a blind approach or a myopic one. In both cases, it includes two processing steps that can be implemented in sequential or alternate mode. The first step carries out the identification of the blur impulse response and the second one makes use of this

  1. UNMANNED AIRCRAFT VEHICLE (UAV IN THE ROMANIAN AIRSPACE. AN OVERVIEW

    Directory of Open Access Journals (Sweden)

    Vasile PRISACARIU

    2014-04-01

    Full Text Available For the last decade the unmanned aircraft vehicle (UAV field has evolved in terms of the sub-branches established in the aerospace industry. At national level the UAV market is still in its infancy but acknowledges an upward trend in the implementation and use of UAVs in civilian and military missions. The achievements of the past decade confirms that Romanian specialists are able to conceive, design and build UAVs at a technological and operational level comparable to the one achieved by large international producers creating the prerequisites of developing a sub-sector for the national aeronautic industry. The current article aims at providing an overview of all activities related to the conception, manufacturing, testing, improving, operating UAVs as these activities evolved within the national airspace filed with brief references to the missions and legislation in this area.

  2. Automatic video segmentation employing object/camera modeling techniques

    NARCIS (Netherlands)

    Farin, D.S.

    2005-01-01

    Practically established video compression and storage techniques still process video sequences as rectangular images without further semantic structure. However, humans watching a video sequence immediately recognize acting objects as semantic units. This semantic object separation is currently not

  3. Output feedback control of a quadrotor UAV using neural networks.

    Science.gov (United States)

    Dierks, Travis; Jagannathan, Sarangapani

    2010-01-01

    In this paper, a new nonlinear controller for a quadrotor unmanned aerial vehicle (UAV) is proposed using neural networks (NNs) and output feedback. The assumption on the availability of UAV dynamics is not always practical, especially in an outdoor environment. Therefore, in this work, an NN is introduced to learn the complete dynamics of the UAV online, including uncertain nonlinear terms like aerodynamic friction and blade flapping. Although a quadrotor UAV is underactuated, a novel NN virtual control input scheme is proposed which allows all six degrees of freedom (DOF) of the UAV to be controlled using only four control inputs. Furthermore, an NN observer is introduced to estimate the translational and angular velocities of the UAV, and an output feedback control law is developed in which only the position and the attitude of the UAV are considered measurable. It is shown using Lyapunov theory that the position, orientation, and velocity tracking errors, the virtual control and observer estimation errors, and the NN weight estimation errors for each NN are all semiglobally uniformly ultimately bounded (SGUUB) in the presence of bounded disturbances and NN functional reconstruction errors while simultaneously relaxing the separation principle. The effectiveness of proposed output feedback control scheme is then demonstrated in the presence of unknown nonlinear dynamics and disturbances, and simulation results are included to demonstrate the theoretical conjecture.

  4. Towards a Biosynthetic UAV

    Science.gov (United States)

    Block, Eli; Byemerwa, Jovita; Dispenza, Ross; Doughty, Benjamin; Gillyard, KaNesha; Godbole, Poorwa; Gonzales-Wright, Jeanette; Hull, Ian; Kannappan, Jotthe; Levine, Alexander; hide

    2014-01-01

    We are currently working on a series of projects towards the construction of a fully biological unmanned aerial vehicle (UAV) for use in scientific and humanitarian missions. The prospect of a biologically-produced UAV presents numerous advantages over the current manufacturing paradigm. First, a foundational architecture built by cells allows for construction or repair in locations where it would be difficult to bring traditional tools of production. Second, a major limitation of current research with UAVs is the size and high power consumption of analytical instruments, which require bulky electrical components and large fuselages to support their weight. By moving these functions into cells with biosensing capabilities - for example, a series of cells engineered to report GFP, green fluorescent protein, when conditions exceed a certain threshold concentration of a compound of interest, enabling their detection post-flight - these problems of scale can be avoided. To this end, we are working to engineer cells to synthesize cellulose acetate as a novel bioplastic, characterize biological methods of waterproofing the material, and program this material's systemic biodegradation. In addition, we aim to use an "amberless" system to prevent horizontal gene transfer from live cells on the material to microorganisms in the flight environment.

  5. Radar sensing via a Micro-UAV-borne system

    Science.gov (United States)

    Catapano, Ilaria; Ludeno, Giovanni; Gennarelli, Gianluca; Soldovieri, Francesco; Rodi Vetrella, Amedeo; Fasano, Giancarmine

    2017-04-01

    In recent years, the miniaturization of flight control systems and payloads has contributed to a fast and widespread diffusion of micro-UAV (Unmanned Aircraft Vehicle). While micro-UAV can be a powerful tool in several civil applications such as environmental monitoring and surveillance, unleashing their full potential for societal benefits requires augmenting their sensing capability beyond the realm of active/passive optical sensors [1]. In this frame, radar systems are drawing attention since they allow performing missions in all-weather and day/night conditions and, thanks to the microwave ability to penetrate opaque media, they enable the detection and localization not only of surface objects but also of sub-surface/hidden targets. However, micro-UAV-borne radar imaging represents still a new frontier, since it is much more than a matter of technology miniaturization or payload installation, which can take advantage of the newly developed ultralight systems. Indeed, micro-UAV-borne radar imaging entails scientific challenges in terms of electromagnetic modeling and knowledge of flight dynamics and control. As a consequence, despite Synthetic Aperture Radar (SAR) imaging is a traditional remote sensing tool, its adaptation to micro-UAV is an open issue and so far only few case studies concerning the integration of SAR and UAV technologies have been reported worldwide [2]. In addition, only early results concerning subsurface imaging by means of an UAV-mounted radar are available [3]. As a contribution to radar imaging via autonomous micro-UAV, this communication presents a proof-of-concept experiment. This experiment represents the first step towards the development of a general methodological approach that exploits expertise about (sub-)surface imaging and aerospace systems with the aim to provide high-resolution images of the surveyed scene. In details, at the conference, we will present the results of a flight campaign carried out by using a single radar

  6. Recording animal vocalizations from a UAV: bat echolocation during roost re-entry.

    Science.gov (United States)

    Kloepper, Laura N; Kinniry, Morgan

    2018-05-17

    Unmanned aerial vehicles (UAVs) are rising in popularity for wildlife monitoring, but direct recordings of animal vocalizations have not yet been accomplished, likely due to the noise generated by the UAV. Echolocating bats, especially Tadarida brasiliensis, are good candidates for UAV recording due to their high-speed, high-altitude flight. Here, we use a UAV to record the signals of bats during morning roost re-entry. We designed a UAV to block the noise of the propellers from the receiving microphone, and report on the characteristics of bioacoustic recordings from a UAV. We report the first published characteristics of echolocation signals from bats during group flight and cave re-entry. We found changes in inter-individual time-frequency shape, suggesting that bats may use differences in call design when sensing in complex groups. Furthermore, our first documented successful recordings of animals in their natural habitat demonstrate that UAVs can be important tools for bioacoustic monitoring, and we discuss the ethical considerations for such monitoring.

  7. UAV Based Imaging for Crop, Weed and Disease Monitoring

    DEFF Research Database (Denmark)

    Garcia Ruiz, Francisco Jose

    Summary Unmanned aerial vehicles (UAV) equipped with cameras have become a powerful technology to collect high resolution remote sensing data from agricultural crops. When equipped with multispectral cameras, light invisible for the human eye may be captured and used to characterize the physiolog......Summary Unmanned aerial vehicles (UAV) equipped with cameras have become a powerful technology to collect high resolution remote sensing data from agricultural crops. When equipped with multispectral cameras, light invisible for the human eye may be captured and used to characterize...... the physiological status of the vegetation. UAV imagery may be divided into three steps (1) spectral characterization of the targets of interest, (2) flight and image acquisition and (3) image processing and interpretation. The overall aims of this study were to improve knowledge in all three steps associated...... with UAV-based remote sensing for practical use in agriculture and to contribute to the incipient research on UAV based remote sensing for agricultural applications. Three case studies were performed to (1) Characterize the spectral signatures of sugar beet (Beta vulgaris L.) and creeping thistle (Cirsium...

  8. UAV PHOTOGRAMMETRY: BLOCK TRIANGULATION COMPARISONS

    Directory of Open Access Journals (Sweden)

    R. Gini

    2013-08-01

    Full Text Available UAVs systems represent a flexible technology able to collect a big amount of high resolution information, both for metric and interpretation uses. In the frame of experimental tests carried out at Dept. ICA of Politecnico di Milano to validate vector-sensor systems and to assess metric accuracies of images acquired by UAVs, a block of photos taken by a fixed wing system is triangulated with several software. The test field is a rural area included in an Italian Park ("Parco Adda Nord", useful to study flight and imagery performances on buildings, roads, cultivated and uncultivated vegetation. The UAV SenseFly, equipped with a camera Canon Ixus 220HS, flew autonomously over the area at a height of 130 m yielding a block of 49 images divided in 5 strips. Sixteen pre-signalized Ground Control Points, surveyed in the area through GPS (NRTK survey, allowed the referencing of the block and accuracy analyses. Approximate values for exterior orientation parameters (positions and attitudes were recorded by the flight control system. The block was processed with several software: Erdas-LPS, EyeDEA (Univ. of Parma, Agisoft Photoscan, Pix4UAV, in assisted or automatic way. Results comparisons are given in terms of differences among digital surface models, differences in orientation parameters and accuracies, when available. Moreover, image and ground point coordinates obtained by the various software were independently used as initial values in a comparative adjustment made by scientific in-house software, which can apply constraints to evaluate the effectiveness of different methods of point extraction and accuracies on ground check points.

  9. Unmanned air vehicle (UAV) ultra-persitence research

    Energy Technology Data Exchange (ETDEWEB)

    Dron, S. B.

    2012-03-01

    Sandia National Laboratories and Northrop Grumman Corporation Integrated Systems, Unmanned Systems (NGIS UMS) collaborated to further ultra-persistence technologies for unmanned air vehicles (UAVs). The greatest shortfalls in UAV capabilities have been repeatedly identified as (1) insufficient flight persistence or 'hang time,' (2) marginal electrical power for running higher power avionics and payload systems, and (3) inadequate communications bandwidth and reach. NGIS UMS requested support from Sandia to develop an ultra-persistent propulsion and power system (UP3S) for potential incorporation into next generation UAV systems. The team members tried to determine which energy storage and power generation concepts could most effectively push UAV propulsion and electrical power capabilities to increase UAV sortie duration from days to months while increasing available electrical power at least two-fold. Primary research and development areas that were pursued included these goals: perform general system engineering and integration analyses; develop initial thermal and electrical power estimates; provide mass, volume, dimensional, and balance estimates; conduct preliminary safety assessments; assess logistics support requirements; perform, preliminary assessments of any security and safeguards; evaluate options for removal, replacement, and disposition of materials; generally advance the potential of the UP3S concept. The effort contrasted and compared eight heat sources technologies, three power conversion, two dual cycle propulsion system configurations, and a single electrical power generation scheme. Overall performance, specific power parameters, technical complexities, security, safety, and other operational features were successfully investigated. Large and medium sized UAV systems were envisioned and operational flight profiles were developed for each concept. Heat source creation and support challenges for domestic and expeditionary operations were

  10. a Three-Dimensional Simulation and Visualization System for Uav Photogrammetry

    Science.gov (United States)

    Liang, Y.; Qu, Y.; Cui, T.

    2017-08-01

    Nowadays UAVs has been widely used for large-scale surveying and mapping. Compared with manned aircraft, UAVs are more cost-effective and responsive. However, UAVs are usually more sensitive to wind condition, which greatly influences their positions and orientations. The flight height of a UAV is relative low, and the relief of the terrain may result in serious occlusions. Moreover, the observations acquired by the Position and Orientation System (POS) are usually less accurate than those acquired in manned aerial photogrammetry. All of these factors bring in uncertainties to UAV photogrammetry. To investigate these uncertainties, a three-dimensional simulation and visualization system has been developed. The system is demonstrated with flight plan evaluation, image matching, POS-supported direct georeferencing, and ortho-mosaicing. Experimental results show that the presented system is effective for flight plan evaluation. The generated image pairs are accurate and false matches can be effectively filtered. The presented system dynamically visualizes the results of direct georeferencing in three-dimensions, which is informative and effective for real-time target tracking and positioning. The dynamically generated orthomosaic can be used in emergency applications. The presented system has also been used for teaching theories and applications of UAV photogrammetry.

  11. Rancang Bangun Prototype Unmanned Aerial Vehicle (UAV dengan Tiga Rotor

    Directory of Open Access Journals (Sweden)

    Darmawan Rasyid Hadi Saputra

    2013-03-01

    Full Text Available Unmanned Aerial Vehicle atau yang biasa dikenal dengan istilah UAV  merupakan sebuah sistem penerbangan/ pesawat tanpa pilot yang berada di dalam pesawat tersebut. UAV dapat dikendalikan dengan menggunakan remote dari jarak jauh, diprogram dengan perintah tertentu, atau bahkan dengan sistem pengendalian otomatis yang lebih kompleks. Aplikasi dari teknologi UAV pun beragam mulai dari tugas militer hingga pengamatan udara. Dalam penelitian ini, sebuah UAV akan dikembangkan dengan tiga buah rotor dan satu buah motor servo di bagian belakang UAV. Perancangan model menggunakan software CATIA dengan batasan dimensi (panjang × lebar maksimum 75 × 75 cm dan massa < 2 kg. Analisis struktur rangka dilakukan untuk menguji kekuatan rangka ketika terbang dan membawa beban, dengan menggunakan metode elemen hingga dan kriteria kegagalan Von-Misses. Dalam proses pengerjaan, rancangan dari CATIA dan analisis yang telah dilakukan dalam perancangan tersebut akan digunakan. Hasil yang didapat berupa UAV yang memiliki struktur rangka dengan defleksi maksimum 3,67 mm pada rangka tengah yang berbahan acrylic. Dalam pengujian di lapangan, UAV dapat melakukan gerak roll, pitch, dan yaw yang dikendalikan melalui remote control. Waktu operasi maksimum yang dapat dilakukan adalah selama 7 menit 43 detik.

  12. Optimal trajectory planning for a UAV glider using atmospheric thermals

    Science.gov (United States)

    Kagabo, Wilson B.

    An Unmanned Aerial Vehicle Glider (UAV glider) uses atmospheric energy in its different forms to remain aloft for extended flight durations. This UAV glider's aim is to extract atmospheric thermal energy and use it to supplement its battery energy usage and increase the mission period. Given an infrared camera identified atmospheric thermal of known strength and location; current wind speed and direction; current battery level; altitude and location of the UAV glider; and estimating the expected altitude gain from the thermal, is it possible to make an energy-efficient based motivation to fly to an atmospheric thermal so as to achieve UAV glider extended flight time? For this work, an infrared thermal camera aboard the UAV glider takes continuous forward-looking ground images of "hot spots". Through image processing a candidate atmospheric thermal strength and location is estimated. An Intelligent Decision Model incorporates this information with the current UAV glider status and weather conditions to provide an energy-based recommendation to modify the flight path of the UAV glider. Research, development, and simulation of the Intelligent Decision Model is the primary focus of this work. Three models are developed: (1) Battery Usage Model, (2) Intelligent Decision Model, and (3) Altitude Gain Model. The Battery Usage Model comes from the candidate flight trajectory, wind speed & direction and aircraft dynamic model. Intelligent Decision Model uses a fuzzy logic based approach. The Altitude Gain Model requires the strength and size of the thermal and is found a priori.

  13. Intification and modelling of flight characteristics for self-build shock flyer type UAV

    Science.gov (United States)

    Rashid., Z. A.; Dardin, A. S. F. Syed.; Azid, A. A.; Ahmad, K. A.

    2018-02-01

    The development of an autonomous Unmanned Aerial Vehicle (UAV) requires a fundamentals studies of the UAV's flight characteristic. The aim of this study is to identify and model the flight characteristic of a conventional fixed-wing type UAV. Subsequence to this, the mode of flight of the UAV can be investigated. One technique to identify the characteristic of a UAV is a flight test where it required specific maneuvering to be executed while measuring the attitude sensor. In this study, a simple shock flyer type UAV was used as the aircraft. The result shows that the modeled flight characteristic has a significant relation with actual values but the fitting value is rather small. It is suggested that the future study is conducted with an improvement of the physical UAV, data filtering and better system identification methods.

  14. Multi-UAV Routing for Area Coverage and Remote Sensing with Minimum Time.

    Science.gov (United States)

    Avellar, Gustavo S C; Pereira, Guilherme A S; Pimenta, Luciano C A; Iscold, Paulo

    2015-11-02

    This paper presents a solution for the problem of minimum time coverage of ground areas using a group of unmanned air vehicles (UAVs) equipped with image sensors. The solution is divided into two parts: (i) the task modeling as a graph whose vertices are geographic coordinates determined in such a way that a single UAV would cover the area in minimum time; and (ii) the solution of a mixed integer linear programming problem, formulated according to the graph variables defined in the first part, to route the team of UAVs over the area. The main contribution of the proposed methodology, when compared with the traditional vehicle routing problem's (VRP) solutions, is the fact that our method solves some practical problems only encountered during the execution of the task with actual UAVs. In this line, one of the main contributions of the paper is that the number of UAVs used to cover the area is automatically selected by solving the optimization problem. The number of UAVs is influenced by the vehicles' maximum flight time and by the setup time, which is the time needed to prepare and launch a UAV. To illustrate the methodology, the paper presents experimental results obtained with two hand-launched, fixed-wing UAVs.

  15. The use of UAVs for monitoring land degradation

    Science.gov (United States)

    Themistocleous, Kyriacos

    2017-10-01

    Land degradation is one of the causes of desertification of drylands in the Mediterranean. UAVs can be used to monitor and document the various variables that cause desertification in drylands, including overgrazing, aridity, vegetation loss, etc. This paper examines the use of UAVs and accompanying sensors to monitor overgrazing, vegetation stress and aridity in the study area. UAV images can be used to generate digital elevation models (DEMs) to examine the changes in microtopography as well as ortho-photos were used to detect changes in vegetation patterns. The combined data of the digital elevation models and the orthophotos can be used to identify the mechanisms for desertification in the study area.

  16. Rate control scheme for consistent video quality in scalable video codec.

    Science.gov (United States)

    Seo, Chan-Won; Han, Jong-Ki; Nguyen, Truong Q

    2011-08-01

    Multimedia data delivered to mobile devices over wireless channels or the Internet are complicated by bandwidth fluctuation and the variety of mobile devices. Scalable video coding has been developed as an extension of H.264/AVC to solve this problem. Since scalable video codec provides various scalabilities to adapt the bitstream for the channel conditions and terminal types, scalable codec is one of the useful codecs for wired or wireless multimedia communication systems, such as IPTV and streaming services. In such scalable multimedia communication systems, video quality fluctuation degrades the visual perception significantly. It is important to efficiently use the target bits in order to maintain a consistent video quality or achieve a small distortion variation throughout the whole video sequence. The scheme proposed in this paper provides a useful function to control video quality in applications supporting scalability, whereas conventional schemes have been proposed to control video quality in the H.264 and MPEG-4 systems. The proposed algorithm decides the quantization parameter of the enhancement layer to maintain a consistent video quality throughout the entire sequence. The video quality of the enhancement layer is controlled based on a closed-form formula which utilizes the residual data and quantization error of the base layer. The simulation results show that the proposed algorithm controls the frame quality of the enhancement layer in a simple operation, where the parameter decision algorithm is applied to each frame.

  17. Hierarchical structure for audio-video based semantic classification of sports video sequences

    Science.gov (United States)

    Kolekar, M. H.; Sengupta, S.

    2005-07-01

    A hierarchical structure for sports event classification based on audio and video content analysis is proposed in this paper. Compared to the event classifications in other games, those of cricket are very challenging and yet unexplored. We have successfully solved cricket video classification problem using a six level hierarchical structure. The first level performs event detection based on audio energy and Zero Crossing Rate (ZCR) of short-time audio signal. In the subsequent levels, we classify the events based on video features using a Hidden Markov Model implemented through Dynamic Programming (HMM-DP) using color or motion as a likelihood function. For some of the game-specific decisions, a rule-based classification is also performed. Our proposed hierarchical structure can easily be applied to any other sports. Our results are very promising and we have moved a step forward towards addressing semantic classification problems in general.

  18. Hierarchical path planning and control of a small fixed-wing UAV: Theory and experimental validation

    Science.gov (United States)

    Jung, Dongwon

    2007-12-01

    Recently there has been a tremendous growth of research emphasizing control of unmanned aerial vehicles (UAVs) either in isolation or in teams. As a matter of fact, UAVs increasingly find their way into military and law enforcement applications (e.g., reconnaissance, remote delivery of urgent equipment/material, resource assessment, environmental monitoring, battlefield monitoring, ordnance delivery, etc.). This trend will continue in the future, as UAVs are poised to replace the human-in-the-loop during dangerous missions. Civilian applications of UAVs are also envisioned such as crop dusting, geological surveying, search and rescue operations, etc. In this thesis we propose a new online multiresolution path planning algorithm for a small UAV with limited on-board computational resources. The proposed approach assumes that the UAV has detailed information of the environment and the obstacles only in its vicinity. Information about far-away obstacles is also available, albeit less accurately. The proposed algorithm uses the fast lifting wavelet transform (FLWT) to get a multiresolution cell decomposition of the environment, whose dimension is commensurate to the on-board computational resources. A topological graph representation of the multiresolution cell decomposition is constructed efficiently, directly from the approximation and detail wavelet coefficients. Dynamic path planning is sequentially executed for an optimal path using the A* algorithm over the resulting graph. The proposed path planning algorithm is implemented on-line on a small autopilot. Comparisons with the standard D*-lite algorithm are also presented. We also investigate the problem of generating a smooth, planar reference path from a discrete optimal path. Upon the optimal path being represented as a sequence of cells in square geometry, we derive a smooth B-spline path that is constrained inside a channel that is induced by the geometry of the cells. To this end, a constrained optimization

  19. UAV-based Radar Sounding of Antarctic Ice

    Science.gov (United States)

    Leuschen, Carl; Yan, Jie-Bang; Mahmood, Ali; Rodriguez-Morales, Fernando; Hale, Rick; Camps-Raga, Bruno; Metz, Lynsey; Wang, Zongbo; Paden, John; Bowman, Alec; Keshmiri, Shahriar; Gogineni, Sivaprasad

    2014-05-01

    We developed a compact radar for use on a small UAV to conduct measurements over the ice sheets in Greenland and Antarctica. It operates at center frequencies of 14 and 35 MHz with bandwidths of 1 MHz and 4 MHz, respectively. The radar weighs about 2 kgs and is housed in a box with dimensions of 20.3 cm x 15.2 cm x 13.2 cm. It transmits a signal power of 100 W at a pulse repletion frequency of 10 kHz and requires average power of about 20 W. The antennas for operating the radar are integrated into the wings and airframe of a small UAV with a wingspan of 5.3 m. We selected the frequencies of 14 and 35 MHz based on previous successful soundings of temperate ice in Alaska with a 12.5 MHz impulse radar [Arcone, 2002] and temperate glaciers in Patagonia with a 30 MHz monocycle radar [Blindow et al., 2012]. We developed the radar-equipped UAV to perform surveys over a 2-D grid, which allows us to synthesize a large two-dimensional aperture and obtain fine resolution in both the along- and cross-track directions. Low-frequency, high-sensitivity radars with 2-D aperture synthesis capability are needed to overcome the surface and volume scatter that masks weak echoes from the ice-bed interface of fast-flowing glaciers. We collected data with the radar-equipped UAV on sub-glacial ice near Lake Whillans at both 14 and 35 MHz. We acquired data to evaluate the concept of 2-D aperture synthesis and successfully demonstrated the first successful sounding of ice with a radar on an UAV. We are planning to build multiple radar-equipped UAVs for collecting fine-resolution data near the grounding lines of fast-flowing glaciers. In this presentation we will provide a brief overview of the radar and UAV, as well as present results obtained at both 14 and 35 MHz. Arcone, S. 2002. Airborne-radar stratigraphy and electrical structure of temperate firn: Bagley Ice Field, Alaska, U.S.A. Journal of Glaciology, 48, 317-334. Blindow, N., C. Salat, and G. Casassa. 2012. Airborne GPR sounding of

  20. Multi‐angular observations of vegetation indices from UAV cameras

    DEFF Research Database (Denmark)

    Sobejano-Paz, Veronica; Wang, Sheng; Jakobsen, Jakob

    Unmanned aerial vehicles (UAVs) are found as an alternative to the classical manned aerial photogrammetry, which can be used to obtain environmental data or as a complementary solution to other methods (Nex and Remondino, 2014). Although UAVs have coverage limitations, they have better resolution...... (Berni et al., 2009), hyper spectral camera (Burkart et al., 2015) and photometric elevation mapping sensor (Shahbazi et al., 2015) among others. Therefore, UAVs can be used in many fields such as agriculture, forestry, archeology, architecture, environment and traffic monitoring (Nex and Remondino, 2014......). In this study, the UAV used is a hexacopter s900 equipped with a Global Positioning System (GPS) and two cameras; a digital RGB photo camera and a multispectral camera (MCA), with a resolution of 5472 x 3648 pixels and 1280 x 1024 pixels, respectively. In terms of applications, traditional methods using...

  1. Comprehensive UAV agricultural remote-sensing research at Texas A M University

    Science.gov (United States)

    Thomasson, J. Alex; Shi, Yeyin; Olsenholler, Jeffrey; Valasek, John; Murray, Seth C.; Bishop, Michael P.

    2016-05-01

    Unmanned aerial vehicles (UAVs) have advantages over manned vehicles for agricultural remote sensing. Flying UAVs is less expensive, is more flexible in scheduling, enables lower altitudes, uses lower speeds, and provides better spatial resolution for imaging. The main disadvantage is that, at lower altitudes and speeds, only small areas can be imaged. However, on large farms with contiguous fields, high-quality images can be collected regularly by using UAVs with appropriate sensing technologies that enable high-quality image mosaics to be created with sufficient metadata and ground-control points. In the United States, rules governing the use of aircraft are promulgated and enforced by the Federal Aviation Administration (FAA), and rules governing UAVs are currently in flux. Operators must apply for appropriate permissions to fly UAVs. In the summer of 2015 Texas A&M University's agricultural research agency, Texas A&M AgriLife Research, embarked on a comprehensive program of remote sensing with UAVs at its 568-ha Brazos Bottom Research Farm. This farm is made up of numerous fields where various crops are grown in plots or complete fields. The crops include cotton, corn, sorghum, and wheat. After gaining FAA permission to fly at the farm, the research team used multiple fixed-wing and rotary-wing UAVs along with various sensors to collect images over all parts of the farm at least once per week. This article reports on details of flight operations and sensing and analysis protocols, and it includes some lessons learned in the process of developing a UAV remote-sensing effort of this sort.

  2. IMPROVED UAV-BORNE 3D MAPPING BY FUSING OPTICAL AND LASERSCANNER DATA

    Directory of Open Access Journals (Sweden)

    B. Jutzi

    2013-08-01

    Full Text Available In this paper, a new method for fusing optical and laserscanner data is presented for improved UAV-borne 3D mapping. We propose to equip an unmanned aerial vehicle (UAV with a small platform which includes two sensors: a standard low-cost digital camera and a lightweight Hokuyo UTM-30LX-EW laserscanning device (210 g without cable. Initially, a calibration is carried out for the utilized devices. This involves a geometric camera calibration and the estimation of the position and orientation offset between the two sensors by lever-arm and bore-sight calibration. Subsequently, a feature tracking is performed through the image sequence by considering extracted interest points as well as the projected 3D laser points. These 2D results are fused with the measured laser distances and fed into a bundle adjustment in order to obtain a Simultaneous Localization and Mapping (SLAM. It is demonstrated that an improvement in terms of precision for the pose estimation is derived by fusing optical and laserscanner data.

  3. Experiment on Uav Photogrammetry and Terrestrial Laser Scanning for Ict-Integrated Construction

    Science.gov (United States)

    Takahashi, N.; Wakutsu, R.; Kato, T.; Wakaizumi, T.; Ooishi, T.; Matsuoka, R.

    2017-08-01

    In the 2016 fiscal year the Ministry of Land, Infrastructure, Transport and Tourism of Japan started a program integrating construction and ICT in earthwork and concrete placing. The new program named "i-Construction" focusing on productivity improvement adopts such new technologies as UAV photogrammetry and TLS. We report a field experiment to investigate whether the procedures of UAV photogrammetry and TLS following the standards for "i-Construction" are feasible or not. In the experiment we measured an embankment of about 80 metres by 160 metres immediately after earthwork was done on the embankment. We used two sets of UAV and camera in the experiment. One is a larger UAV enRoute Zion QC730 and its onboard camera Sony α6000. The other is a smaller UAV DJI Phantom 4 and its dedicated onboard camera. Moreover, we used a terrestrial laser scanner FARO Focus3D X330 based on the phase shift principle. The experiment results indicate that the procedures of UAV photogrammetry using a QC730 with an α6000 and TLS using a Focus3D X330 following the standards for "i-Construction" would be feasible. Furthermore, the experiment results show that UAV photogrammetry using a lower price UAV Phantom 4 was unable to satisfy the accuracy requirement for "i-Construction." The cause of the low accuracy by Phantom 4 is under investigation. We also found that the difference of image resolution on the ground would not have a great influence on the measurement accuracy in UAV photogrammetry.

  4. Perception-based Co-evolutionary Reinforcement Learning for UAV Sensor Allocation

    National Research Council Canada - National Science Library

    Berenji, Hamid

    2003-01-01

    .... A Perception-based reasoning approach based on co-evolutionary reinforcement learning was developed for jointly addressing sensor allocation on each individual UAV and allocation of a team of UAVs...

  5. Precise Positioning of Uavs - Dealing with Challenging Rtk-Gps Measurement Conditions during Automated Uav Flights

    Science.gov (United States)

    Zimmermann, F.; Eling, C.; Klingbeil, L.; Kuhlmann, H.

    2017-08-01

    For some years now, UAVs (unmanned aerial vehicles) are commonly used for different mobile mapping applications, such as in the fields of surveying, mining or archeology. To improve the efficiency of these applications an automation of the flight as well as the processing of the collected data is currently aimed at. One precondition for an automated mapping with UAVs is that the georeferencing is performed directly with cm-accuracies or better. Usually, a cm-accurate direct positioning of UAVs is based on an onboard multi-sensor system, which consists of an RTK-capable (real-time kinematic) GPS (global positioning system) receiver and additional sensors (e.g. inertial sensors). In this case, the absolute positioning accuracy essentially depends on the local GPS measurement conditions. Especially during mobile mapping applications in urban areas, these conditions can be very challenging, due to a satellite shadowing, non-line-of sight receptions, signal diffraction or multipath effects. In this paper, two straightforward and easy to implement strategies will be described and analyzed, which improve the direct positioning accuracies for UAV-based mapping and surveying applications under challenging GPS measurement conditions. Based on a 3D model of the surrounding buildings and vegetation in the area of interest, a GPS geometry map is determined, which can be integrated in the flight planning process, to avoid GPS challenging environments as far as possible. If these challenging environments cannot be avoided, the GPS positioning solution is improved by using obstruction adaptive elevation masks, to mitigate systematic GPS errors in the RTK-GPS positioning. Simulations and results of field tests demonstrate the profit of both strategies.

  6. Cost and effectiveness analysis on unmanned aerial vehicle (UAV) use at border security

    Science.gov (United States)

    Yilmaz, Bahadır.

    2013-06-01

    Drones and Remotely Piloted Vehicles are types of Unmanned Aerial Vehicles. UAVs began to be used with the war of Vietnam, they had a great interest when Israel used them in Bekaa Valley Operations of 1982. UAVs have been used by different countries with different aims with the help of emerging technology and investments. In this article, in the context of areas of UAV usage in national security, benefits and disadvantages of UAVs are put forward. Particularly, it has been evaluated on the basis of cost-effectiveness by focusing the use of UAV in the border security. UAVs have been studied by taking cost analysis, procurement and operational costs into consideration. Analysis of effectiveness has been done with illegal passages of people and drugs from flight times of UAVs. Although the procurement cost of the medium-level UAVs is low, its operational costs are high. For this reason, the idea of less costly alternative systems have been revealed for the border security. As the costs are reduced to acceptable level involving national security and border security in future with high-technology products in their structure, it will continue to be used in an increasing proportion.

  7. Multidepot UAV Routing Problem with Weapon Configuration and Time Window

    Directory of Open Access Journals (Sweden)

    Tianren Zhou

    2018-01-01

    Full Text Available In recent wars, there is an increasing trend that unmanned aerial vehicles (UAVs are utilized to conduct military attacking missions. In this paper, we investigate a novel multidepot UAV routing problem with consideration of weapon configuration in the UAV and the attacking time window of the target. A mixed-integer linear programming model is developed to jointly optimize three kinds of decisions: the weapon configuration strategy in the UAV, the routing strategy of target, and the allocation strategy of weapons to targets. An adaptive large neighborhood search (ALNS algorithm is proposed for solving the problem, which is tested by randomly generated instances covering the small, medium, and large sizes. Experimental results confirm the effectiveness and robustness of the proposed ALNS algorithm.

  8. HIL Tuning of UAV for Exploration of Risky Environments

    Directory of Open Access Journals (Sweden)

    C. D. Melita

    2008-11-01

    Full Text Available In this paper the latest results of an HIL architecture, optimized to develop and test UAV platforms are presented. This architecture has been used to realize the different devices involved in the navigation and stability control of the Volcan UAV, a plane designed to operate in volcanic environments. The proposed architecture is strongly modular and flexible and allows the development of avionic hardware and software, testing and tuning the involved algorithms with non-destructive trials. A flight simulator (X-Plane with a suitable plane model and plug-in, has been adopted to simulate the UAV dynamics. The flight simulator, interfaced with the real electronic boards, allows an easy tuning of all the control parameters and data collecting for test and validation. The effectiveness of adopted methodology was confirmed by several flight tests performed subsequently by using the designed avionic modules on the real UAV.

  9. Common Operating Picture: UAV Security Study

    Science.gov (United States)

    2004-01-01

    This initial communication security study is a top-level assessment of basic security issues related to the operation of Unmanned Aerial Vehicles (UAVs) in the National Airspace System (NAS). Security considerations will include information relating to the use of International Civil Aviation Organization (ICAO) Aeronautical Telecommunications Network (ATN) protocols and applications identifying their maturity, as well as the use of IPV4 and a version of mobile IPV6. The purpose of this assessment is to provide an initial analysis of the security implications of introducing UAVs into the NAS.

  10. Survey on the novel hybrid aquatic-aerial amphibious aircraft: Aquatic unmanned aerial vehicle (AquaUAV)

    Science.gov (United States)

    Yang, Xingbang; Wang, Tianmiao; Liang, Jianhong; Yao, Guocai; Liu, Miao

    2015-04-01

    The aquatic unmanned aerial vehicle (AquaUAV), a kind of vehicle that can operate both in the air and the water, has been regarded as a new breakthrough to broaden the application scenario of UAV. Wide application prospects in military and civil field are more than bright, therefore many institutions have focused on the development of such a vehicle. However, due to the significant difference of the physical properties between the air and the water, it is rather difficult to design a fully-featured AquaUAV. Until now, majority of partially-featured AquaUAVs have been developed and used to verify the feasibility of an aquatic-aerial vehicle. In the present work, we classify the current partially-featured AquaUAV into three categories from the scope of the whole UAV field, i.e., the seaplane UAV, the submarine-launched UAV, and the submersible UAV. Then the recent advancements and common characteristics of the three kinds of AquaUAVs are reviewed in detail respectively. Then the applications of bionics in the design of AquaUAV, the transition mode between the air and the water, the morphing wing structure for air-water adaptation, and the power source and the propulsion type are summarized and discussed. The tradeoff analyses for different transition methods between the air and the water are presented. Furthermore, it indicates that applying the bionics into the design and development of the AquaUAV will be essential and significant. Finally, the significant technical challenges for the AquaUAV to change from a conception to a practical prototype are indicated.

  11. Multimodal UAV detection: study of various intrusion scenarios

    Science.gov (United States)

    Hengy, Sebastien; Laurenzis, Martin; Schertzer, Stéphane; Hommes, Alexander; Kloeppel, Franck; Shoykhetbrod, Alex; Geibig, Thomas; Johannes, Winfried; Rassy, Oussama; Christnacher, Frank

    2017-10-01

    Small unmanned aerial vehicles (UAVs) are becoming increasingly popular and affordable the last years for professional and private consumer market, with varied capacities and performances. Recent events showed that illicit or hostile uses constitute an emergent, quickly evolutionary threat. Recent developments in UAV technologies tend to bring autonomous, highly agile and capable unmanned aerial vehicles to the market. These UAVs can be used for spying operations as well as for transporting illicit or hazardous material (smuggling, flying improvised explosive devices). The scenario of interest concerns the protection of sensitive zones against the potential threat constituted by small drones. In the recent past, field trials were carried out to investigate the detection and tracking of multiple UAV flying at low altitude. Here, we present results which were achieved using a heterogeneous sensor network consisting of acoustic antennas, small FMCW RADAR systems and optical sensors. While acoustics and RADAR was applied to monitor a wide azimuthal area (360°), optical sensors were used for sequentially identification. The localization results have been compared to the ground truth data to estimate the efficiency of each detection system. Seven-microphone acoustic arrays allow single source localization. The mean azimuth and elevation estimation error has been measured equal to 1.5 and -2.5 degrees respectively. The FMCW radar allows tracking of multiple UAVs by estimating their range, azimuth and motion speed. Both technologies can be linked to the electro-optical system for final identification of the detected object.

  12. Thermocouple-based Temperature Sensing System for Chemical Cell Inside Micro UAV Device

    Science.gov (United States)

    Han, Yanhui; Feng, Yue; Lou, Haozhe; Zhang, Xinzhao

    2018-03-01

    Environmental temperature of UAV system is crucial for chemical cell component inside. Once the temperature of this chemical cell is over 259 °C and keeps more than 20 min, the high thermal accumulation would result in an explosion, which seriously damage the whole UAV system. Therefore, we develop a micro temperature sensing system for monitoring the temperature of chemical cell thermally influenced by UAV device deployed in a 300 °C temperature environment, which is quite useful for insensitive munitions and UAV safety enhancement technologies.

  13. IMPLEMENTATION AND TESTING OF LOW COST UAV PLATFORM FOR ORTHOPHOTO IMAGING

    Directory of Open Access Journals (Sweden)

    D. Brucas

    2013-08-01

    Full Text Available Implementation of Unmanned Aerial Vehicles for civilian applications is rapidly increasing. Technologies which were expensive and available only for military use have recently spread on civilian market. There is a vast number of low cost open source components and systems for implementation on UAVs available. Using of low cost hobby and open source components ensures considerable decrease of UAV price, though in some cases compromising its reliability. In Space Science and Technology Institute (SSTI in collaboration with Vilnius Gediminas Technical University (VGTU researches have been performed in field of constructing and implementation of small UAVs composed of low cost open source components (and own developments. Most obvious and simple implementation of such UAVs – orthophoto imaging with data download and processing after the flight. The construction, implementation of UAVs, flight experience, data processing and data implementation will be further covered in the paper and presentation.

  14. Implementation and Testing of Low Cost Uav Platform for Orthophoto Imaging

    Science.gov (United States)

    Brucas, D.; Suziedelyte-Visockiene, J.; Ragauskas, U.; Berteska, E.; Rudinskas, D.

    2013-08-01

    Implementation of Unmanned Aerial Vehicles for civilian applications is rapidly increasing. Technologies which were expensive and available only for military use have recently spread on civilian market. There is a vast number of low cost open source components and systems for implementation on UAVs available. Using of low cost hobby and open source components ensures considerable decrease of UAV price, though in some cases compromising its reliability. In Space Science and Technology Institute (SSTI) in collaboration with Vilnius Gediminas Technical University (VGTU) researches have been performed in field of constructing and implementation of small UAVs composed of low cost open source components (and own developments). Most obvious and simple implementation of such UAVs - orthophoto imaging with data download and processing after the flight. The construction, implementation of UAVs, flight experience, data processing and data implementation will be further covered in the paper and presentation.

  15. Vision-IMU based collaborative control of a blind UAV

    NARCIS (Netherlands)

    Hoogervorst, R.; Stramigioli, Stefano; Wopereis, Han Willem; Fumagalli, Matteo

    2015-01-01

    Position estimation of UAVs is usually done using onboard sensors such as GPS and camera. However, in certain practical situations, the measurements of both the GPS and the onboard camera of the UAV might not always be available or reliable. This paper investigates the possibility to overcome

  16. Development Of Linear Quadratic Regulator Design For Small UAV System

    Directory of Open Access Journals (Sweden)

    Cho Zin Myint

    2015-08-01

    Full Text Available The aim of this paper is to know the importance role of stability analysis for both unmanned aircraft system and for all control system. The objective of paper is to develop a method for dynamic stability analysis of the design process. These are categorized intoTo design model and stability analysis of UAV based on the forces and moment equations of aircraft dynamic model To choose the suitable controller for desired altitude of a particular UAV model To analyze the stability condition for aircraft using mathematical modeling and MATLAB. In this paper the analytical model of the longitudinal dynamic of flying wing UAV has been developed using aerodynamic data. The stability characteristics of UAV can be achieved from the system transfer function with LQR controller.

  17. Using LTE Networks for UAV Command and Control Link

    DEFF Research Database (Denmark)

    Nguyen, Huan Cong; Amorim, Rafhael Medeiros de; Wigard, Jeroen

    2017-01-01

    In this paper we investigate the ability of Long-Term Evolution (LTE) network to provide coverage for Unmanned Aerial Vehicles (UAVs) in a rural area, in particular for the Command and Control (C2) downlink. The study takes into consideration the dependency of the large-scale path loss on the hei......In this paper we investigate the ability of Long-Term Evolution (LTE) network to provide coverage for Unmanned Aerial Vehicles (UAVs) in a rural area, in particular for the Command and Control (C2) downlink. The study takes into consideration the dependency of the large-scale path loss...... on the height of the UAV, which is derived from actual measurements, and a real-world cellular network layout and configuration. The results indicate that interference is the dominant factor limiting the cellular coverage for UAVs in the downlink: outage level increases from 4.2% at 1.5 m height to 51.7% at 120...

  18. Evapotranspiration from UAV Images

    DEFF Research Database (Denmark)

    Nielsen, Helene Hoffmann Munk

    and is thus of importance in both hydrological, agricultural and atmospheric sciences. Still today, accurate measurements of ET are not achieved easily. The state-of the-art method to measure ET, the eddy covariance method, is associated with uncertainties and its footprint, though at the order of around 1...... hectare, varies much with the atmospheric stability and wind conditions. Indirect measurements of ET are obtained with satellite imagery, as a residual of the surface energy balance. Satellite images provide spatially distributed measurements, however high resolution satellite products provide footprints...... of measurements and thus new understandings of ET and its inferred parameters such as crop water stress and heat fluxes in the surface energy balance. However, UAV data collection is a new measuring method and the lightweight sensors are novel instrumentations. Workflows for processing UAV data, and the data...

  19. SAR system development for UAV multicopter platforms

    OpenAIRE

    Escartin Martínez, Antonio

    2015-01-01

    SAR system development for UAV multicopter platforms This thesis describes the optimization of a synthetic aperture radar (SAR) at X-band and its integration into an unmanned aerial vehicle (UAV) of type octocopter. For such optimization the SAR system functionality was extended from singlepol to fulpol and it has been optimized at hardware level in order to improve its quality against noise figure. After its integration into the octocopter platform, its features has been used in order to ...

  20. Mini-Uav LIDAR for Power Line Inspection

    Science.gov (United States)

    Teng, G. E.; Zhou, M.; Li, C. R.; Wu, H. H.; Li, W.; Meng, F. R.; Zhou, C. C.; Ma, L.

    2017-09-01

    Light detection and ranging (LIDAR) system based on unmanned aerial vehicles (UAVs) recently are in rapid advancement, meanwhile portable and flexible mini-UAV-borne laser scanners have been a hot research field, especially for the complex terrain survey in the mountains and other areas. This study proposes a power line inspection system solution based on mini-UAV-borne LIDAR system-AOEagle, developed by Academy of Opto-Electronics, Chinese Academy of Sciences, which mounted on a Multi-rotor unmanned aerial vehicle for complex terrain survey according to real test. Furthermore, the point cloud data was explored to validate its applicability for power line inspection, in terms of corridor and line laser point clouds; deformation detection of power towers, etc. The feasibility and advantages of AOEagle have been demonstrated by the promising results based on the real-measured data in the field of power line inspection.

  1. Control of fixed-wing UAV at levelling phase using artificial intelligence

    Science.gov (United States)

    Sayfeddine, Daher

    2018-03-01

    The increase in the share of fly-by-wire and software controlled UAV is explained by the need to release the human-operator and the desire to reduce the degree of influence of the human factor errors that account for 26% of aircraft accidents. An important reason for the introduction of new control algorithms is also the high level of UAV failures due loss of communication channels and possible hacking. This accounts for 17% of the total number of accidents. The comparison with manned flights shows that the frequency of accidents of unmanned flights is 27,000 times higher. This means that the UAV has 1611 failures per million flight hours and only 0.06 failures at the same time for the manned flight. In view of that, this paper studies the flight autonomy of fixed-wing UAV at the levelling phase. Landing parameters of the UAV are described. They will be used to setup a control scheme for an autopilot based on fuzzy logic algorithm.

  2. Evaluation and development of unmanned aircraft (UAV) for UDOT needs.

    Science.gov (United States)

    2012-05-01

    This research involved the use of high-resolution aerial photography obtained from Unmanned Aerial Vehicles (UAV) to aid UDOT in monitoring and documenting State Roadway structures and associated issues. Using geo-referenced UAV high resolution aeria...

  3. A Survey of Open-Source UAV Flight Controllers and Flight Simulators

    DEFF Research Database (Denmark)

    Ebeid, Emad Samuel Malki; Skriver, Martin; Terkildsen, Kristian Husum

    2018-01-01

    The current disruptive innovation in civilian drone (UAV) applications has led to an increased need for research and development in UAV technology. The key challenges currently being addressed are related to UAV platform properties such as functionality, reliability, fault tolerance, and endurance......-source drone platform elements that can be used for research and development. The survey covers open-source hardware, software, and simulation drone platforms and compares their main features....

  4. Assessing the importance of audio/video synchronization for simultaneous translation of video sequences

    OpenAIRE

    Staelens, Nicolas; De Meulenaere, Jonas; Bleumers, Lizzy; Van Wallendael, Glenn; De Cock, Jan; Geeraert, Koen; Vercammen, Nick; Van den Broeck, Wendy; Vermeulen, Brecht; Van de Walle, Rik; Demeester, Piet

    2012-01-01

    Lip synchronization is considered a key parameter during interactive communication. In the case of video conferencing and television broadcasting, the differential delay between audio and video should remain below certain thresholds, as recommended by several standardization bodies. However, further research has also shown that these thresholds can be relaxed, depending on the targeted application and use case. In this article, we investigate the influence of lip sync on the ability to perfor...

  5. Video processing for human perceptual visual quality-oriented video coding.

    Science.gov (United States)

    Oh, Hyungsuk; Kim, Wonha

    2013-04-01

    We have developed a video processing method that achieves human perceptual visual quality-oriented video coding. The patterns of moving objects are modeled by considering the limited human capacity for spatial-temporal resolution and the visual sensory memory together, and an online moving pattern classifier is devised by using the Hedge algorithm. The moving pattern classifier is embedded in the existing visual saliency with the purpose of providing a human perceptual video quality saliency model. In order to apply the developed saliency model to video coding, the conventional foveation filtering method is extended. The proposed foveation filter can smooth and enhance the video signals locally, in conformance with the developed saliency model, without causing any artifacts. The performance evaluation results confirm that the proposed video processing method shows reliable improvements in the perceptual quality for various sequences and at various bandwidths, compared to existing saliency-based video coding methods.

  6. DTM GENERATION WITH UAV BASED PHOTOGRAMMETRIC POINT CLOUD

    Directory of Open Access Journals (Sweden)

    N. Polat

    2017-11-01

    Full Text Available Nowadays Unmanned Aerial Vehicles (UAVs are widely used in many applications for different purposes. Their benefits however are not entirely detected due to the integration capabilities of other equipment such as; digital camera, GPS, or laser scanner. The main scope of this paper is evaluating performance of cameras integrated UAV for geomatic applications by the way of Digital Terrain Model (DTM generation in a small area. In this purpose, 7 ground control points are surveyed with RTK and 420 photographs are captured. Over 30 million georeferenced points were used in DTM generation process. Accuracy of the DTM was evaluated with 5 check points. The root mean square error is calculated as 17.1 cm for an altitude of 100 m. Besides, a LiDAR derived DTM is used as reference in order to calculate correlation. The UAV based DTM has o 94.5 % correlation with reference DTM. Outcomes of the study show that it is possible to use the UAV Photogrammetry data as map producing, surveying, and some other engineering applications with the advantages of low-cost, time conservation, and minimum field work.

  7. DTM Generation with Uav Based Photogrammetric Point Cloud

    Science.gov (United States)

    Polat, N.; Uysal, M.

    2017-11-01

    Nowadays Unmanned Aerial Vehicles (UAVs) are widely used in many applications for different purposes. Their benefits however are not entirely detected due to the integration capabilities of other equipment such as; digital camera, GPS, or laser scanner. The main scope of this paper is evaluating performance of cameras integrated UAV for geomatic applications by the way of Digital Terrain Model (DTM) generation in a small area. In this purpose, 7 ground control points are surveyed with RTK and 420 photographs are captured. Over 30 million georeferenced points were used in DTM generation process. Accuracy of the DTM was evaluated with 5 check points. The root mean square error is calculated as 17.1 cm for an altitude of 100 m. Besides, a LiDAR derived DTM is used as reference in order to calculate correlation. The UAV based DTM has o 94.5 % correlation with reference DTM. Outcomes of the study show that it is possible to use the UAV Photogrammetry data as map producing, surveying, and some other engineering applications with the advantages of low-cost, time conservation, and minimum field work.

  8. PRECISE POSITIONING OF UAVS – DEALING WITH CHALLENGING RTK-GPS MEASUREMENT CONDITIONS DURING AUTOMATED UAV FLIGHTS

    Directory of Open Access Journals (Sweden)

    F. Zimmermann

    2017-08-01

    Full Text Available For some years now, UAVs (unmanned aerial vehicles are commonly used for different mobile mapping applications, such as in the fields of surveying, mining or archeology. To improve the efficiency of these applications an automation of the flight as well as the processing of the collected data is currently aimed at. One precondition for an automated mapping with UAVs is that the georeferencing is performed directly with cm-accuracies or better. Usually, a cm-accurate direct positioning of UAVs is based on an onboard multi-sensor system, which consists of an RTK-capable (real-time kinematic GPS (global positioning system receiver and additional sensors (e.g. inertial sensors. In this case, the absolute positioning accuracy essentially depends on the local GPS measurement conditions. Especially during mobile mapping applications in urban areas, these conditions can be very challenging, due to a satellite shadowing, non-line-of sight receptions, signal diffraction or multipath effects. In this paper, two straightforward and easy to implement strategies will be described and analyzed, which improve the direct positioning accuracies for UAV-based mapping and surveying applications under challenging GPS measurement conditions. Based on a 3D model of the surrounding buildings and vegetation in the area of interest, a GPS geometry map is determined, which can be integrated in the flight planning process, to avoid GPS challenging environments as far as possible. If these challenging environments cannot be avoided, the GPS positioning solution is improved by using obstruction adaptive elevation masks, to mitigate systematic GPS errors in the RTK-GPS positioning. Simulations and results of field tests demonstrate the profit of both strategies.

  9. Unmanned Aerial Vehicles (UAVs): a new tool in counterterrorism operations?

    Science.gov (United States)

    Dörtbudak, Mehmet F.

    2015-05-01

    Terrorism is not a new phenomenon to the world, yet it remains difficult to define and counter. Countering terrorism requires several measures that must be taken simultaneously; however, counterterrorism strategies of many countries mostly depend on military measures. In the aftermath of the 2001 terrorist attack on the Twin Towers of the World Trade Center, the United States (U.S.) has started and led the campaign of Global War on Terrorism. They have invaded Afghanistan and Iraq and have encountered insurgencies run by terrorist organizations, such as al-Qaeda and its affiliates. The U.S. made the utilization of Air and Space Power very intensively during these operations. In order to implement operations; Intelligence, Surveillance, and Reconnaissance (ISR) assets were used to collect the necessary information. Before the successful insertion of a small number of U.S. Special Operation Force (SOF) teams into Afghanistan, the U.S. Air Force attacked al-Qaeda and Taliban's targets such as infrastructure, airfields, ground forces, command-control facilities etc. As soon as the U.S. troops got on the ground and started to marshal to Kabul, the Air Force supported them by attacking jointly determined targets. The Air Force continued to carry out the missions and played a significant role to achieve the objective of operation during all the time. This is not the only example of utilization of Air and Space Power in counterterrorism and counterinsurgency operations. All around the world, many countries have also made the utilization of Air Power in different missions ranging from ISR to attacking. Thinking that terrorism has a psychological dimension and losing a pilot during operations may result in decreasing the population support to operations, Unmanned Aerial Vehicles (UAVs) started to be used by practitioners and took priority over other assets. Although UAVs have been on the theatre for a long time used for ISR mission in conventional conflicts, with the advent

  10. Interactive Cadastral Boundary Delineation from Uav Data

    Science.gov (United States)

    Crommelinck, S.; Höfle, B.; Koeva, M. N.; Yang, M. Y.; Vosselman, G.

    2018-05-01

    Unmanned aerial vehicles (UAV) are evolving as an alternative tool to acquire land tenure data. UAVs can capture geospatial data at high quality and resolution in a cost-effective, transparent and flexible manner, from which visible land parcel boundaries, i.e., cadastral boundaries are delineable. This delineation is to no extent automated, even though physical objects automatically retrievable through image analysis methods mark a large portion of cadastral boundaries. This study proposes (i) a methodology that automatically extracts and processes candidate cadastral boundary features from UAV data, and (ii) a procedure for a subsequent interactive delineation. Part (i) consists of two state-of-the-art computer vision methods, namely gPb contour detection and SLIC superpixels, as well as a classification part assigning costs to each outline according to local boundary knowledge. Part (ii) allows a user-guided delineation by calculating least-cost paths along previously extracted and weighted lines. The approach is tested on visible road outlines in two UAV datasets from Germany. Results show that all roads can be delineated comprehensively. Compared to manual delineation, the number of clicks per 100 m is reduced by up to 86 %, while obtaining a similar localization quality. The approach shows promising results to reduce the effort of manual delineation that is currently employed for indirect (cadastral) surveying.

  11. Gait Analysis by Multi Video Sequence Analysis

    DEFF Research Database (Denmark)

    Jensen, Karsten; Juhl, Jens

    2009-01-01

    The project presented in this article aims to develop software so that close-range photogrammetry with sufficient accuracy can be used to point out the most frequent foot mal positions and monitor the effect of the traditional treatment. The project is carried out as a cooperation between...... and the calcaneus angle during gait. In the introductory phase of the project the task has been to select, purchase and draw up hardware, select and purchase software concerning video streaming and to develop special software concerning automated registration of the position of the foot during gait by Multi Video...

  12. Establishing a disruptive new capability for NASA to fly UAV's into hazardous conditions

    Science.gov (United States)

    Ely, Jay; Nguyen, Truong; Wilson, Jennifer; Brown, Robert; Laughter, Sean; Teets, Ed; Parker, Allen; Chan, Hon M.; Richards, Lance

    2015-05-01

    A 2015 NASA Aeronautics Mission "Seedling" Proposal is described for a Severe-Environment UAV (SE-UAV) that can perform in-situ measurements in hazardous atmospheric conditions like lightning, volcanic ash and radiation. Specifically, this paper describes the design of a proof-of-concept vehicle and measurement system that can survive lightning attachment during flight operations into thunderstorms. Elements from three NASA centers draw together for the SE-UAV concept. 1) The NASA KSC Genesis UAV was developed in collaboration with the DARPA Nimbus program to measure electric field and X-rays present within thunderstorms. 2) A novel NASA LaRC fiber-optic sensor uses Faraday-effect polarization rotation to measure total lightning electric current on an air vehicle fuselage. 3) NASA AFRC's state-of-the-art Fiber Optics and Systems Integration Laboratory is envisioned to transition the Faraday system to a compact, light-weight, all-fiber design. The SE-UAV will provide in-flight lightning electric-current return stroke and recoil leader data, and serve as a platform for development of emerging sensors and new missions into hazardous environments. NASA's Aeronautics and Science Missions are interested in a capability to perform in-situ volcanic plume measurements and long-endurance UAV operations in various weather conditions. (Figure 1 shows an artist concept of a SE-UAV flying near a volcano.) This paper concludes with an overview of the NASA Aeronautics Strategic Vision, Programs, and how a SE-UAV is envisioned to impact them. The SE-UAV concept leverages high-value legacy research products into a new capability for NASA to fly a pathfinder UAV into hazardous conditions, and is presented in the SPIE DSS venue to explore teaming, collaboration and advocacy opportunities outside NASA.

  13. Establishing a Disruptive New Capability for NASA to Fly UAV's into Hazardous Conditions

    Science.gov (United States)

    Ely, Jay; Nguyen, Truong; Wilson, Jennifer; Brown, Robert; Laughter, Sean; Teets, Ed; Parker, Allen; Chan, Patrick Hon Man; Richards, Lance

    2015-01-01

    A 2015 NASA Aeronautics Mission "Seedling" Proposal is described for a Severe-Environment UAV (SE-UAV) that can perform in-situ measurements in hazardous atmospheric conditions like lightning, volcanic ash and radiation. Specifically, this paper describes the design of a proof-of-concept vehicle and measurement system that can survive lightning attachment during flight operations into thunderstorms. Elements from three NASA centers draw together for the SE-UAV concept. 1) The NASA KSC Genesis UAV was developed in collaboration with the DARPA Nimbus program to measure electric field and X-rays present within thunderstorms. 2) A novel NASA LaRC fiber-optic sensor uses Faraday-effect polarization rotation to measure total lightning electric current on an air vehicle fuselage. 3) NASA AFRC's state-of-the-art Fiber Optics and Systems Integration Laboratory is envisioned to transition the Faraday system to a compact, light-weight, all-fiber design. The SE-UAV will provide in-flight lightning electric-current return stroke and recoil leader data, and serve as a platform for development of emerging sensors and new missions into hazardous environments. NASA's Aeronautics and Science Missions are interested in a capability to perform in-situ volcanic plume measurements and long-endurance UAV operations in various weather conditions. (Figure 1 shows an artist concept of a SE-UAV flying near a volcano.) This paper concludes with an overview of the NASA Aeronautics Strategic Vision, Programs, and how a SE-UAV is envisioned to impact them. The SE-UAV concept leverages high-value legacy research products into a new capability for NASA to fly a pathfinder UAV into hazardous conditions, and is presented in the SPIE DSS venue to explore teaming, collaboration and advocacy opportunities outside NASA.

  14. WETLAND ASSESSMENT USING UNMANNED AERIAL VEHICLE (UAV PHOTOGRAMMETRY

    Directory of Open Access Journals (Sweden)

    M. A. Boon

    2016-06-01

    Full Text Available The use of Unmanned Arial Vehicle (UAV photogrammetry is a valuable tool to enhance our understanding of wetlands. Accurate planning derived from this technological advancement allows for more effective management and conservation of wetland areas. This paper presents results of a study that aimed at investigating the use of UAV photogrammetry as a tool to enhance the assessment of wetland ecosystems. The UAV images were collected during a single flight within 2½ hours over a 100 ha area at the Kameelzynkraal farm, Gauteng Province, South Africa. An AKS Y-6 MKII multi-rotor UAV and a digital camera on a motion compensated gimbal mount were utilised for the survey. Twenty ground control points (GCPs were surveyed using a Trimble GPS to achieve geometrical precision and georeferencing accuracy. Structure-from-Motion (SfM computer vision techniques were used to derive ultra-high resolution point clouds, orthophotos and 3D models from the multi-view photos. The geometric accuracy of the data based on the 20 GCP’s were 0.018 m for the overall, 0.0025 m for the vertical root mean squared error (RMSE and an over all root mean square reprojection error of 0.18 pixel. The UAV products were then edited and subsequently analysed, interpreted and key attributes extracted using a selection of tools/ software applications to enhance the wetland assessment. The results exceeded our expectations and provided a valuable and accurate enhancement to the wetland delineation, classification and health assessment which even with detailed field studies would have been difficult to achieve.

  15. Design of attitude solution algorithm for tail-sitter VTOL UAV

    Directory of Open Access Journals (Sweden)

    Donghui LIU

    2016-02-01

    Full Text Available The tail-sitter Vertical Takeoff and Landing (VTOL Unmanned Aerial Vehicle(UAV, flying in a fixed-wing model, overcomes many shortcomings of traditional fixed-wing UAVs, and inherits the advantage of high overall efficiency, which means it has great development potential and very broad application prospects. The attitude of tail-sitter VTOL UAV shows a wide change range in its takeoff and landing stages, and when the attitude sensor changes more than 90 degrees in pitch direction, the Euler angles converted by the Quaternions will have singular points, which means gimbal deadlock appears. From the solution algorithm, this paper provides a method of changing the order of rotation to avoid the appearance of singular points. The results show that this method can be well applied to the attitude solution of the VTOL UAV.

  16. Motion video analysis using planar parallax

    Science.gov (United States)

    Sawhney, Harpreet S.

    1994-04-01

    Motion and structure analysis in video sequences can lead to efficient descriptions of objects and their motions. Interesting events in videos can be detected using such an analysis--for instance independent object motion when the camera itself is moving, figure-ground segregation based on the saliency of a structure compared to its surroundings. In this paper we present a method for 3D motion and structure analysis that uses a planar surface in the environment as a reference coordinate system to describe a video sequence. The motion in the video sequence is described as the motion of the reference plane, and the parallax motion of all the non-planar components of the scene. It is shown how this method simplifies the otherwise hard general 3D motion analysis problem. In addition, a natural coordinate system in the environment is used to describe the scene which can simplify motion based segmentation. This work is a part of an ongoing effort in our group towards video annotation and analysis for indexing and retrieval. Results from a demonstration system being developed are presented.

  17. No-reference pixel based video quality assessment for HEVC decoded video

    DEFF Research Database (Denmark)

    Huang, Xin; Søgaard, Jacob; Forchhammer, Søren

    2017-01-01

    the quantization step used in the Intra coding is estimated. We map the obtained HEVC features using an Elastic Net to predict subjective video quality scores, Mean Opinion Scores (MOS). The performance is verified on a dataset consisting of HEVC coded 4 K UHD (resolution equal to 3840 x 2160) video sequences...

  18. Generació de mapes a partir d'imatges preses amb un UAV

    OpenAIRE

    Perarnau, Guim; Universitat Autònoma de Barcelona. Escola d'Enginyeria

    2015-01-01

    En els darrers anys s'ha popularitzat l'ús dels UAVs (drones) en una gran varietat d'àmbits. Aquest treball se centra en el camp de generació de mapes (vistes àrees) òptima basat en imatges enregistrades amb un UAV. Per millorar la qualitat del mapa resultant es vol treure profit de la instal•lació de sensors en l'UAV que proporcionin informació que pugui ser útil en el procés, com la posició i l'orientació de l'UAV. Com a tal, es descriuran tots els passos emprats per tal d'aprofitar les dad...

  19. Analysis of Nondeterministic Search Patterns for Minimization of UAV Counter-Targeting

    Science.gov (United States)

    2013-03-01

    64 Figure 4.9 Procerus Unicorn UAV [48] used in multi-UAV look-ahead Levy search demonstration conducted at 13-2 JIFX in February, 2013...minimum time or coverage path, minimal overlap, increased robustness to localization errors, etc. [3–5]. The role of randomized coverage and search...to the Procerus Unicorn UAV employed during these flight experiments, shown in Figure 4.9. Figure 4.10 shows the straight-line path between the major

  20. UAV measurements of aerosol properties at the Cyprus institute

    Science.gov (United States)

    Neitola, Kimmo; Sciare, Jean; Keleshis, Christos; Pikridas, Michael; Argyrides, Marios; Vouterakos, Panagiotis; Antoniou, Panyiota; Apostolou, Apostolos; Savvides, Constantinos; Vrekoussis, Mihalis; Mihalopoulos, Nikos; Biskos, George; Gao, Ru-Shan; Murphy, Daniel; Schrod, Jann; Weber, Daniel; Bingemer, Heinz; Mocnik, Grisa

    2017-04-01

    Unmanned Aerial Vehicles (UAVs) provide a cost-effective and easy-to-use method to document the vertical profiles of aerosol particles and their physical and optical properties, within and above the boundary layer. These observations combined with satellite and ground data together can provide important information and model constrains regarding the impact of aerosols on the air quality and regional climate. Cyprus is a unique place to observe long-range transported pollution and dust originating from different areas (Europe, Africa, Turkey, and Middle East) and perform such aerosol profiling. The USRL team at the Cyprus Institute has recently started weekly routine flights with a newly developed UAV fleet to build a unique dataset of vertical profile observations. Instrumentation on the UAVs includes miniature Scanning Aerosol Sun Photometer (miniSASP, Murphy et al., 2015), Printed Optical Particle Spectrometer (POPS, Gao et al., 2016), Ice nuclei sampler (IN) and Dual Wavelength absorption Prototype (DWP) together with the measured meteorological parameters (P, T and RH). The UAV fleet is still expanding, as well as the instrumentation, and preliminary test flights have led to very promising results. The UAV ascend up to approximately the middle of the boundary layer, defined by LIDAR measurements at Limassol, where the UAV will fly on one altitude for several minutes ensuring stable data collection. After flying on one altitude, the UAV will continue ascending above the boundary layer, where another level flight will take place for data gathering, before descending for safe landing. The miniSASP measures the sun irradiance and sky radiance at four wavelengths (460, 550, 670 and 680nm) by doing continuous almucantar scans every 30 s. The instrument installation compensates for the pitch and roll of the UAV with 4 Hz frequency. For this reason, the flights are designed to maintain level flight conditions, to ensure proper data acquisition, and to obtain data from

  1. Online UAV Mission Planning

    NARCIS (Netherlands)

    Evers, L.; Barros, A.I.; Monsuur, H.; Wagelmans, A.P.M.

    2014-01-01

    Unmanned Aerial Vehicles (UAVs) have become an essential asset for military and law enforcement operations. In particular their use for surveillance and reconnaissance tasks has been growing due to the quick developments in the areal systems themselves, sensor technology, and image processing

  2. Analysis of Unmanned Aerial Vehicle (UAV) hyperspectral remote sensing monitoring key technology in coastal wetland

    Science.gov (United States)

    Ma, Yi; Zhang, Jie; Zhang, Jingyu

    2016-01-01

    The coastal wetland, a transitional zone between terrestrial ecosystems and marine ecosystems, is the type of great value to ecosystem services. For the recent 3 decades, area of the coastal wetland is decreasing and the ecological function is gradually degraded with the rapid development of economy, which restricts the sustainable development of economy and society in the coastal areas of China in turn. It is a major demand of the national reality to carry out the monitoring of coastal wetlands, to master the distribution and dynamic change. UAV, namely unmanned aerial vehicle, is a new platform for remote sensing. Compared with the traditional satellite and manned aerial remote sensing, it has the advantage of flexible implementation, no cloud cover, strong initiative and low cost. Image-spectrum merging is one character of high spectral remote sensing. At the same time of imaging, the spectral curve of each pixel is obtained, which is suitable for quantitative remote sensing, fine classification and target detection. Aimed at the frontier and hotspot of remote sensing monitoring technology, and faced the demand of the coastal wetland monitoring, this paper used UAV and the new remote sensor of high spectral imaging instrument to carry out the analysis of the key technologies of monitoring coastal wetlands by UAV on the basis of the current situation in overseas and domestic and the analysis of developing trend. According to the characteristic of airborne hyperspectral data on UAV, that is "three high and one many", the key technology research that should develop are promoted as follows: 1) the atmosphere correction of the UAV hyperspectral in coastal wetlands under the circumstance of complex underlying surface and variable geometry, 2) the best observation scale and scale transformation method of the UAV platform while monitoring the coastal wetland features, 3) the classification and detection method of typical features with high precision from multi scale

  3. Pathloss Measurements and Modeling for UAVs Connected to Cellular Networks

    DEFF Research Database (Denmark)

    Amorim, Rafhael Medeiros de; Mogensen, Preben Elgaard; Sørensen, Troels Bundgaard

    2017-01-01

    . The measurements were conducted in an operating LTE network (850 MHz), using a commercial cell phone, placed inside the frame of the UAV. Trials were conducted for UAV flying at 5 different heights measured above ground level (20, 40, 60, 80 and 100m) and a pathloss regression line was obtained from results. Then......This paper assess field measurements, as part of the investigation of the suitability of cellular networks for providing connectivity to UAVs (unmanned aerial vehicles). Evaluation is done by means of field measurements obtained in a rural environment in Denmark with an airbone UAV......, downlink (DL) SINR levels obtained during flight measurements are also presented. An important result obtained from the measurents reveal that there is a height-related DL SINR degradation. Three main sources of uncertainty on the pathloss model that could be responsible for the SINR degradation are also...

  4. Data Gathering and Energy Transfer Dilemma in UAV-Assisted Flying Access Network for IoT.

    Science.gov (United States)

    Arabi, Sara; Sabir, Essaid; Elbiaze, Halima; Sadik, Mohamed

    2018-05-11

    Recently, Unmanned Aerial Vehicles (UAVs) have emerged as an alternative solution to assist wireless networks, thanks to numerous advantages they offer in comparison to terrestrial fixed base stations. For instance, a UAV can be used to embed a flying base station providing an on-demand nomadic access to network services. A UAV can also be used to wirelessly recharge out-of-battery ground devices. In this paper, we aim to deal with both data collection and recharging depleted ground Internet-of-Things (IoT) devices through a UAV station used as a flying base station. To extend the network lifetime, we present a novel use of UAV with energy harvesting module and wireless recharging capabilities. However, the UAV is used as an energy source to empower depleted IoT devices. On one hand, the UAV charges depleted ground IoT devices under three policies: (1) low-battery first scheme; (2) high-battery first scheme; and (3) random scheme. On the other hand, the UAV station collects data from IoT devices that have sufficient energy to transmit their packets, and in the same phase, the UAV exploits the Radio Frequency (RF) signals transmitted by IoT devices to extract and harvest energy. Furthermore, and as the UAV station has a limited coverage time due to its energy constraints, we propose and investigate an efficient trade-off between ground users recharging time and data gathering time. Furthermore, we suggest to control and optimize the UAV trajectory in order to complete its travel within a minimum time, while minimizing the energy spent and/or enhancing the network lifetime. Extensive numerical results and simulations show how the system behaves under different scenarios and using various metrics in which we examine the added value of UAV with energy harvesting module.

  5. Data Gathering and Energy Transfer Dilemma in UAV-Assisted Flying Access Network for IoT

    Directory of Open Access Journals (Sweden)

    Sara Arabi

    2018-05-01

    Full Text Available Recently, Unmanned Aerial Vehicles (UAVs have emerged as an alternative solution to assist wireless networks, thanks to numerous advantages they offer in comparison to terrestrial fixed base stations. For instance, a UAV can be used to embed a flying base station providing an on-demand nomadic access to network services. A UAV can also be used to wirelessly recharge out-of-battery ground devices. In this paper, we aim to deal with both data collection and recharging depleted ground Internet-of-Things (IoT devices through a UAV station used as a flying base station. To extend the network lifetime, we present a novel use of UAV with energy harvesting module and wireless recharging capabilities. However, the UAV is used as an energy source to empower depleted IoT devices. On one hand, the UAV charges depleted ground IoT devices under three policies: (1 low-battery first scheme; (2 high-battery first scheme; and (3 random scheme. On the other hand, the UAV station collects data from IoT devices that have sufficient energy to transmit their packets, and in the same phase, the UAV exploits the Radio Frequency (RF signals transmitted by IoT devices to extract and harvest energy. Furthermore, and as the UAV station has a limited coverage time due to its energy constraints, we propose and investigate an efficient trade-off between ground users recharging time and data gathering time. Furthermore, we suggest to control and optimize the UAV trajectory in order to complete its travel within a minimum time, while minimizing the energy spent and/or enhancing the network lifetime. Extensive numerical results and simulations show how the system behaves under different scenarios and using various metrics in which we examine the added value of UAV with energy harvesting module.

  6. Miniature UAVs : An overview

    NARCIS (Netherlands)

    Weimar, P.W.L.; Kerkkamp, J.S.F.; Wiel, R.A.N.; Meiller, P.P.; Bos, J.G.H.

    2014-01-01

    With this book TNO provides an overview of topics related to Miniature Unmanned Aerial Vehicles (MUAVs). Both novices and experts may find this publication valuable. The Netherlands Organisation for Applied Scientific Research TNO conducts research on UAVs and MUAVs, see for example [1], on the

  7. Coastal areas mapping using UAV photogrammetry

    Science.gov (United States)

    Nikolakopoulos, Konstantinos G.; Kozarski, Dimitrios; Kogkas, Stefanos

    2017-10-01

    The coastal areas in the Patras Gulf suffer degradation due to the sea action and other natural and human-induced causes. Changes in beaches, ports, and other man made constructions need to be assessed, both after severe events and on a regular basis, to build models that can predict the evolution in the future. Thus, reliable spatial data acquisition is a critical process for the identification of the coastline and the broader coastal zones for geologists and other scientists involved in the study of coastal morphology. High resolution satellite data, airphotos and airborne Lidar provided in the past the necessary data for the coastline monitoring. High-resolution digital surface models (DSMs) and orthophoto maps had become a necessity in order to map with accuracy all the variations in costal environments. Recently, unmanned aerial vehicles (UAV) photogrammetry offers an alternative solution to the acquisition of high accuracy spatial data along the coastline. This paper presents the use of UAV to map the coastline in Rio area Western Greece. Multiple photogrammetric aerial campaigns were performed. A small commercial UAV (DJI Phantom 3 Advance) was used to acquire thousands of images with spatial resolutions better than 5 cm. Different photogrammetric software's were used to orientate the images, extract point clouds, build a digital surface model and produce orthoimage mosaics. In order to achieve the best positional accuracy signalised ground control points were measured with a differential GNSS receiver. The results of this coastal monitoring programme proved that UAVs can replace many of the conventional surveys, with considerable gains in the cost of the data acquisition and without any loss in the accuracy.

  8. Prognostics Applied to Electric Propulsion UAV

    Science.gov (United States)

    Goebel, Kai; Saha, Bhaskar

    2013-01-01

    Health management plays an important role in operations of UAV. If there is equipment malfunction on critical components, safe operation of the UAV might possibly be compromised. A technology with particular promise in this arena is equipment prognostics. This technology provides a state assessment of the health of components of interest and, if a degraded state has been found, it estimates how long it will take before the equipment will reach a failure threshold, conditional on assumptions about future operating conditions and future environmental conditions. This chapter explores the technical underpinnings of how to perform prognostics and shows an implementation on the propulsion of an electric UAV. A particle filter is shown as the method of choice in performing state assessment and predicting future degradation. The method is then applied to the batteries that provide power to the propeller motors. An accurate run-time battery life prediction algorithm is of critical importance to ensure the safe operation of the vehicle if one wants to maximize in-air time. Current reliability based techniques turn out to be insufficient to manage the use of such batteries where loads vary frequently in uncertain environments.

  9. Comparative study of methods for recognition of an unknown person's action from a video sequence

    Science.gov (United States)

    Hori, Takayuki; Ohya, Jun; Kurumisawa, Jun

    2009-02-01

    This paper proposes a Tensor Decomposition Based method that can recognize an unknown person's action from a video sequence, where the unknown person is not included in the database (tensor) used for the recognition. The tensor consists of persons, actions and time-series image features. For the observed unknown person's action, one of the actions stored in the tensor is assumed. Using the motion signature obtained from the assumption, the unknown person's actions are synthesized. The actions of one of the persons in the tensor are replaced by the synthesized actions. Then, the core tensor for the replaced tensor is computed. This process is repeated for the actions and persons. For each iteration, the difference between the replaced and original core tensors is computed. The assumption that gives the minimal difference is the action recognition result. For the time-series image features to be stored in the tensor and to be extracted from the observed video sequence, the human body silhouette's contour shape based feature is used. To show the validity of our proposed method, our proposed method is experimentally compared with Nearest Neighbor rule and Principal Component analysis based method. Experiments using 33 persons' seven kinds of action show that our proposed method achieves better recognition accuracies for the seven actions than the other methods.

  10. Transmission Tower Environment Monitoring Using UAV

    International Nuclear Information System (INIS)

    Redzuwan, Redia Mohd; Din, Norashidah Md; Baharuddin, Mohd Zafri; Mustafa, Intan Shafinaz; Omar, Rohayu Che'

    2013-01-01

    Power utility engineers used to conduct ground survey to collect topographic data. Therefore, they can get detailed and accurate information, but these techniques take a lot of labors and expenses, and spending times for the surveying. An attractive solution to the ground survey is using images taken using Unmanned Aerial Vehicle (UAV). Images captured from UAV can be collected quickly and efficiently over the same area covered in the land survey, in a fraction of the time. The purpose of this research is to mosaic the large numbers of spectral images together into a region wide panoramic image which allows experts to analyze the data for transmission tower monitoring purposes.

  11. UAV Research, Operations, and Flight Test at the NASA Dryden Flight Research Center

    Science.gov (United States)

    Cosentino, Gary B.

    2009-01-01

    This slide presentation reviews some of the projects that have extended NASA Dryden's capabilities in designing, testing, and using Unmanned Aerial Vehicles (UAV's). Some of the UAV's have been for Science and experimental applications, some have been for flight research and demonstration purposes, and some have been small UAV's for other customers.

  12. Quality-Aware Estimation of Facial Landmarks in Video Sequences

    DEFF Research Database (Denmark)

    Haque, Mohammad Ahsanul; Nasrollahi, Kamal; Moeslund, Thomas B.

    2015-01-01

    Face alignment in video is a primitive step for facial image analysis. The accuracy of the alignment greatly depends on the quality of the face image in the video frames and low quality faces are proven to cause erroneous alignment. Thus, this paper proposes a system for quality aware face...... for facial landmark detection. If the face quality is low the proposed system corrects the facial landmarks that are detected by SDM. Depending upon the face velocity in consecutive video frames and face quality measure, two algorithms are proposed for correction of landmarks in low quality faces by using...

  13. Cooperative control of UAVs for localization of intermittently emitting mobile targets.

    Science.gov (United States)

    Pack, Daniel J; Delima, Pedro; Toussaint, Gregory J; York, George

    2009-08-01

    Compared with a single platform, cooperative autonomous unmanned aerial vehicles (UAVs) offer efficiency and robustness in performing complex tasks. Focusing on ground mobile targets that intermittently emit radio frequency signals, this paper presents a decentralized control architecture for multiple UAVs, equipped only with rudimentary sensors, to search, detect, and locate targets over large areas. The proposed architecture has in its core a decision logic which governs the state of operation for each UAV based on sensor readings and communicated data. To support the findings, extensive simulation results are presented, focusing primarily on two success measures that the UAVs seek to minimize: overall time to search for a group of targets and the final target localization error achieved. The results of the simulations have provided support for hardware flight tests.

  14. A debugging method of the Quadrotor UAV based on infrared thermal imaging

    Science.gov (United States)

    Cui, Guangjie; Hao, Qian; Yang, Jianguo; Chen, Lizhi; Hu, Hongkang; Zhang, Lijun

    2018-01-01

    High-performance UAV has been popular and in great need in recent years. The paper introduces a new method in debugging Quadrotor UAVs. Based on the infrared thermal technology and heat transfer theory, a UAV is under debugging above a hot-wire grid which is composed of 14 heated nichrome wires. And the air flow propelled by the rotating rotors has an influence on the temperature distribution of the hot-wire grid. An infrared thermal imager below observes the distribution and gets thermal images of the hot-wire grid. With the assistance of mathematic model and some experiments, the paper discusses the relationship between thermal images and the speed of rotors. By means of getting debugged UAVs into test, the standard information and thermal images can be acquired. The paper demonstrates that comparing to the standard thermal images, a UAV being debugging in the same test can draw some critical data directly or after interpolation. The results are shown in the paper and the advantages are discussed.

  15. Summarization of Surveillance Video Sequences Using Face Quality Assessment

    DEFF Research Database (Denmark)

    Nasrollahi, Kamal; Moeslund, Thomas B.; Rahmati, Mohammad

    2011-01-01

    Constant working surveillance cameras in public places, such as airports and banks, produce huge amount of video data. Faces in such videos can be extracted in real time. However, most of these detected faces are either redundant or useless. Redundant information adds computational costs to facial...

  16. Multi-Unmanned Aerial Vehicle (UAV) Cooperative Fault Detection Employing Differential Global Positioning (DGPS), Inertial and Vision Sensors.

    Science.gov (United States)

    Heredia, Guillermo; Caballero, Fernando; Maza, Iván; Merino, Luis; Viguria, Antidio; Ollero, Aníbal

    2009-01-01

    This paper presents a method to increase the reliability of Unmanned Aerial Vehicle (UAV) sensor Fault Detection and Identification (FDI) in a multi-UAV context. Differential Global Positioning System (DGPS) and inertial sensors are used for sensor FDI in each UAV. The method uses additional position estimations that augment individual UAV FDI system. These additional estimations are obtained using images from the same planar scene taken from two different UAVs. Since accuracy and noise level of the estimation depends on several factors, dynamic replanning of the multi-UAV team can be used to obtain a better estimation in case of faults caused by slow growing errors of absolute position estimation that cannot be detected by using local FDI in the UAVs. Experimental results with data from two real UAVs are also presented.

  17. APPLICABILITY ANALYSIS OF ULTRA-LIGHT UAV FOR FLOODING SITE SURVEY IN SOUTH KOREA

    Directory of Open Access Journals (Sweden)

    I. Lee

    2013-05-01

    Full Text Available Recently, UAV (Unmanned Aerial Vehicle is used in a variety of fields such as the military service, fire prevention, traffic supervision, mapping, and etc. The increased demand for UAVs is typically attributed to the low manufacturing and operational costs, flexibility of the platforms to accommodate the consumer’s particular needs and the elimination of the risk to pilots’ lives in difficult missions. But, in South Korea, UAV might be first introduced to military service, and is still in its infancy, just being available for construction site monitoring, landscape photographing, spraying agricultural chemicals, broadcasting fields. This study presents the background and the aim of flood mapping, and presents the possibility analysis of how to use UAV effectively for flooding area. And author tries to overlap UAV image with the flooding area trace surveyed by ground surveys. As a result, it is expected that UAV photogrammetry will contributes to investigating the flooded area by providing images, which is describing the flooded area in near real-time and also making a decision like paying compensation.

  18. EVALUATION OF THE QUALITY OF ACTION CAMERAS WITH WIDE-ANGLE LENSES IN UAV PHOTOGRAMMETRY

    OpenAIRE

    Hastedt, H.; Ekkel, T.; Luhmann, T.

    2016-01-01

    The application of light-weight cameras in UAV photogrammetry is required due to restrictions in payload. In general, consumer cameras with normal lens type are applied to a UAV system. The availability of action cameras, like the GoPro Hero4 Black, including a wide-angle lens (fish-eye lens) offers new perspectives in UAV projects. With these investigations, different calibration procedures for fish-eye lenses are evaluated in order to quantify their accuracy potential in UAV photogrammetry....

  19. Observing Crop-Height Dynamics Using a UAV

    Science.gov (United States)

    Ziliani, M. G.; Parkes, S. D.; McCabe, M.

    2017-12-01

    Retrieval of vegetation height during a growing season is a key indicator for monitoring crop status, offering insight to the forecast yield relative to previous planting cycles. Improvement in Unmanned Aerial Vehicle (UAV) technologies, supported by advances in computer vision and photogrammetry software, has enabled retrieval of crop heights with much higher spatial resolution and coverage. These methodologies retrieve a Digital Surface Map (DSM), which combine terrain and crop elements to obtain a Crop Surface Map (CSM). Here we describe an automated method for deriving high resolution CSMs from a DSM, using RGB imagery from a UAV platform. Importantly, the approach does not require the need for a digital terrain map (DTM). The method involves distinguishing between vegetation and bare-ground cover pixels, using vegetation index maps from the RGB orthomosaic derived from the same flight as the DSM. We show that the absolute crop height can be extracted to within several centimeters, exploiting the data captured from a single UAV flight. In addition, the method is applied across five surveys during a maize growing cycle and compared against a terrain map constructed from a baseline UAV survey undertaken prior to crop growth. Results show that the approach is able to reproduce the observed spatial variability of the crop height within the maize field throughout the duration of the growing season. This is particularly valuable since it may be employed to detect intra-field problems (i.e. fertilizer variability, inefficiency in the irrigation system, salinity etc.) at different stages of the season, from which remedial action can be initiated to mitigate against yield loss. The method also demonstrates that UAV imagery combined with commercial photogrammetry software can determine a CSM from a single flight without the requirement of a prior DTM. This, together with the dynamic crop height estimation, provide useful information with which to inform precision

  20. Possibilities of Use of UAVS for Technical Inspection of Buildings and Constructions

    Science.gov (United States)

    Banaszek, Anna; Banaszek, Sebastian; Cellmer, Anna

    2017-12-01

    In recent years, Unmanned Aerial Vehicles (UAVs) have been used in various sectors of the economy. This is due to the development of new technologies for acquiring and processing geospatial data. The paper presents the results of experiments using UAV, equipped with a high resolution digital camera, for a visual assessment of the technical condition of the building roof and for the inventory of energy infrastructure and its surroundings. The usefulness of digital images obtained from the UAV deck is presented in concrete examples. The use of UAV offers new opportunities in the area of technical inspection due to the detail and accuracy of the data, low operating costs and fast data acquisition.

  1. An Efficient Genetic Algorithm for Routing Multiple UAVs under Flight Range and Service Time Window Constraints

    OpenAIRE

    KARAKAYA, Murat; SEVİNÇ, Ender

    2017-01-01

    Recently using Unmanned Aerial Vehicles (UAVs) either for military or civilian purposes is getting popularity. However, UAVs have their own limitations which require adopted approaches to satisfy the Quality of Service (QoS) promised by the applications depending on effective use of UAVs. One of the important limitations of the UAVs encounter is the flight range. Most of the time, UAVs have very scarce energy resources and, thus, they have relatively short flight ranges. Besides, for the appl...

  2. Effects of Hearing Protection Device Attenuation on Unmanned Aerial Vehicle (UAV) Audio Signatures

    Science.gov (United States)

    2016-03-01

    UAV ) Audio Signatures by Melissa Bezandry, Adrienne Raglin, and John Noble Approved for public release; distribution...Research Laboratory Effects of Hearing Protection Device Attenuation on Unmanned Aerial Vehicle ( UAV ) Audio Signatures by Melissa Bezandry...Aerial Vehicle ( UAV ) Audio Signatures 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) Melissa Bezandry

  3. An Application of UAV Attitude Estimation Using a Low-Cost Inertial Navigation System

    Science.gov (United States)

    Eure, Kenneth W.; Quach, Cuong Chi; Vazquez, Sixto L.; Hogge, Edward F.; Hill, Boyd L.

    2013-01-01

    Unmanned Aerial Vehicles (UAV) are playing an increasing role in aviation. Various methods exist for the computation of UAV attitude based on low cost microelectromechanical systems (MEMS) and Global Positioning System (GPS) receivers. There has been a recent increase in UAV autonomy as sensors are becoming more compact and onboard processing power has increased significantly. Correct UAV attitude estimation will play a critical role in navigation and separation assurance as UAVs share airspace with civil air traffic. This paper describes attitude estimation derived by post-processing data from a small low cost Inertial Navigation System (INS) recorded during the flight of a subscale commercial off the shelf (COTS) UAV. Two discrete time attitude estimation schemes are presented here in detail. The first is an adaptation of the Kalman Filter to accommodate nonlinear systems, the Extended Kalman Filter (EKF). The EKF returns quaternion estimates of the UAV attitude based on MEMS gyro, magnetometer, accelerometer, and pitot tube inputs. The second scheme is the complementary filter which is a simpler algorithm that splits the sensor frequency spectrum based on noise characteristics. The necessity to correct both filters for gravity measurement errors during turning maneuvers is demonstrated. It is shown that the proposed algorithms may be used to estimate UAV attitude. The effects of vibration on sensor measurements are discussed. Heuristic tuning comments pertaining to sensor filtering and gain selection to achieve acceptable performance during flight are given. Comparisons of attitude estimation performance are made between the EKF and the complementary filter.

  4. Automated geographic registration and radiometric correction for UAV-based mosaics

    Science.gov (United States)

    Texas A&M University has been operating a large-scale, UAV-based, agricultural remote-sensing research project since 2015. To use UAV-based images in agricultural production, many high-resolution images must be mosaicked together to create an image of an agricultural field. Two key difficulties to s...

  5. Subjective quality of video sequences rendered on LCD with local backlight dimming at different lighting conditions

    DEFF Research Database (Denmark)

    Mantel, Claire; Korhonen, Jari; Pedersen, Jesper Mørkhøj

    2015-01-01

    This paper focuses on the influence of ambient light on the perceived quality of videos displayed on Liquid Crystal Display (LCD) with local backlight dimming. A subjective test assessing the quality of videos with two backlight dimming methods and three lighting conditions, i.e. no light, low...... light level (5 lux) and higher light level (60 lux) was organized to collect subjective data. Results show that participants prefer the method exploiting local dimming possibilities to the conventional full backlight but that this preference varies depending on the ambient light level. The clear...... preference for one method at the low light conditions decreases at the high ambient light, confirming that the ambient light significantly attenuates the perception of the leakage defect (light leaking through dark pixels). Results are also highly dependent on the content of the sequence, which can modulate...

  6. Cross Validation on the Equality of Uav-Based and Contour-Based Dems

    Science.gov (United States)

    Ma, R.; Xu, Z.; Wu, L.; Liu, S.

    2018-04-01

    Unmanned Aerial Vehicles (UAV) have been widely used for Digital Elevation Model (DEM) generation in geographic applications. This paper proposes a novel framework of generating DEM from UAV images. It starts with the generation of the point clouds by image matching, where the flight control data are used as reference for searching for the corresponding images, leading to a significant time saving. Besides, a set of ground control points (GCP) obtained from field surveying are used to transform the point clouds to the user's coordinate system. Following that, we use a multi-feature based supervised classification method for discriminating non-ground points from ground ones. In the end, we generate DEM by constructing triangular irregular networks and rasterization. The experiments are conducted in the east of Jilin province in China, which has been suffered from soil erosion for several years. The quality of UAV based DEM (UAV-DEM) is compared with that generated from contour interpolation (Contour-DEM). The comparison shows a higher resolution, as well as higher accuracy of UAV-DEMs, which contains more geographic information. In addition, the RMSE errors of the UAV-DEMs generated from point clouds with and without GCPs are ±0.5 m and ±20 m, respectively.

  7. Doppler Effect-Based Automatic Landing Procedure for UAV in Difficult Access Environments

    Directory of Open Access Journals (Sweden)

    Jan M. Kelner

    2017-01-01

    Full Text Available Currently, almost unrestricted access to low-lying areas of airspace creates an opportunity to use unmanned aerial vehicles (UAVs, especially those capable of vertical take-off and landing (VTOL, in transport services. UAVs become increasingly popular for transporting postal items over small, medium, and large distances. It is forecasted that, in the near future, VTOL UAVs with a high take-off weight will also deliver goods to very distant and hard-to-reach locations. Therefore, UAV navigation plays a very important role in the process of carrying out transport services. At present, during the flight phase, drones make use of the integrated global navigation satellite system (GNSS and the inertial navigation system (INS. However, the inaccuracy of GNSS + INS makes it unsuitable for landing and take-off, necessitating the guidance of a human UAV operator during those phases. Available navigation systems do not provide sufficiently high positioning accuracy for an UAV. For this reason, full automation of the landing approach is not possible. This paper puts forward a proposal to solve this problem. The authors show the structure of an autonomous system and a Doppler-based navigation procedure that allows for automatic landing approaches. An accuracy evaluation of the developed solution for VTOL is made on the basis of simulation studies.

  8. Comparison of a UAV-derived point-cloud to Lidar data at Haig Glacier, Alberta, Canada

    Science.gov (United States)

    Bash, E. A.; Moorman, B.; Montaghi, A.; Menounos, B.; Marshall, S. J.

    2016-12-01

    The use of unmanned aerial vehicles (UAVs) is expanding rapidly in glaciological research as a result of technological improvements that make UAVs a cost-effective solution for collecting high resolution datasets with relative ease. The cost and difficult access traditionally associated with performing fieldwork in glacial environments makes UAVs a particularly attractive tool. In the small, but growing, body of literature using UAVs in glaciology the accuracy of UAV data is tested through the comparison of a UAV-derived DEM to measured control points. A field campaign combining simultaneous lidar and UAV flights over Haig Glacier in April 2015, provided the unique opportunity to directly compare UAV data to lidar. The UAV was a six-propeller Mikrokopter carrying a Panasonic Lumix DMC-GF1 camera with a 12 Megapixel Live MOS sensor and Lumix G 20 mm lens flown at a height of 90 m, resulting in sub-centimetre ground resolution per image pixel. Lidar data collection took place April 20, while UAV flights were conducted April 20-21. A set of 65 control points were laid out and surveyed on the glacier surface on April 19 and 21 using a RTK GPS with a vertical uncertainty of 5 cm. A direct comparison of lidar points to these control points revealed a 9 cm offset between the control points and the lidar points on average, but the difference changed distinctly from points collected on April 19 versus those collected April 21 (7 cm and 12 cm). Agisoft Photoscan was used to create a point-cloud from imagery collected with the UAV and CloudCompare was used to calculate the difference between this and the lidar point cloud, revealing an average difference of less than 17 cm. This field campaign also highlighted some of the benefits and drawbacks of using a rotary UAV for glaciological research. The vertical takeoff and landing capabilities, combined with quick responsiveness and higher carrying capacity, make the rotary vehicle favourable for high-resolution photos when

  9. An automated 3D reconstruction method of UAV images

    Science.gov (United States)

    Liu, Jun; Wang, He; Liu, Xiaoyang; Li, Feng; Sun, Guangtong; Song, Ping

    2015-10-01

    In this paper a novel fully automated 3D reconstruction approach based on low-altitude unmanned aerial vehicle system (UAVs) images will be presented, which does not require previous camera calibration or any other external prior knowledge. Dense 3D point clouds are generated by integrating orderly feature extraction, image matching, structure from motion (SfM) and multi-view stereo (MVS) algorithms, overcoming many of the cost, time limitations of rigorous photogrammetry techniques. An image topology analysis strategy is introduced to speed up large scene reconstruction by taking advantage of the flight-control data acquired by UAV. Image topology map can significantly reduce the running time of feature matching by limiting the combination of images. A high-resolution digital surface model of the study area is produced base on UAV point clouds by constructing the triangular irregular network. Experimental results show that the proposed approach is robust and feasible for automatic 3D reconstruction of low-altitude UAV images, and has great potential for the acquisition of spatial information at large scales mapping, especially suitable for rapid response and precise modelling in disaster emergency.

  10. Accuracy assessment of topographic mapping using UAV image integrated with satellite images

    International Nuclear Information System (INIS)

    Azmi, S M; Ahmad, Baharin; Ahmad, Anuar

    2014-01-01

    Unmanned Aerial Vehicle or UAV is extensively applied in various fields such as military applications, archaeology, agriculture and scientific research. This study focuses on topographic mapping and map updating. UAV is one of the alternative ways to ease the process of acquiring data with lower operating costs, low manufacturing and operational costs, plus it is easy to operate. Furthermore, UAV images will be integrated with QuickBird images that are used as base maps. The objective of this study is to make accuracy assessment and comparison between topographic mapping using UAV images integrated with aerial photograph and satellite image. The main purpose of using UAV image is as a replacement for cloud covered area which normally exists in aerial photograph and satellite image, and for updating topographic map. Meanwhile, spatial resolution, pixel size, scale, geometric accuracy and correction, image quality and information contents are important requirements needed for the generation of topographic map using these kinds of data. In this study, ground control points (GCPs) and check points (CPs) were established using real time kinematic Global Positioning System (RTK-GPS) technique. There are two types of analysis that are carried out in this study which are quantitative and qualitative assessments. Quantitative assessment is carried out by calculating root mean square error (RMSE). The outputs of this study include topographic map and orthophoto. From this study, the accuracy of UAV image is ± 0.460 m. As conclusion, UAV image has the potential to be used for updating of topographic maps

  11. Sensor-Oriented Path Planning for Multiregion Surveillance with a Single Lightweight UAV SAR

    Science.gov (United States)

    Li, Jincheng; Chen, Jie; Wang, Pengbo; Li, Chunsheng

    2018-01-01

    In the surveillance of interested regions by unmanned aerial vehicle (UAV), system performance relies greatly on the motion control strategy of the UAV and the operation characteristics of the onboard sensors. This paper investigates the 2D path planning problem for the lightweight UAV synthetic aperture radar (SAR) system in an environment of multiple regions of interest (ROIs), the sizes of which are comparable to the radar swath width. Taking into account the special requirements of the SAR system on the motion of the platform, we model path planning for UAV SAR as a constrained multiobjective optimization problem (MOP). Based on the fact that the UAV route can be designed in the map image, an image-based path planner is proposed in this paper. First, the neighboring ROIs are merged by the morphological operation. Then, the parts of routes for data collection of the ROIs can be located according to the geometric features of the ROIs and the observation geometry of UAV SAR. Lastly, the route segments for ROIs surveillance are connected by a path planning algorithm named the sampling-based sparse A* search (SSAS) algorithm. Simulation experiments in real scenarios demonstrate that the proposed sensor-oriented path planner can improve the reconnaissance performance of lightweight UAV SAR greatly compared with the conventional zigzag path planner. PMID:29439447

  12. Sensor-Oriented Path Planning for Multiregion Surveillance with a Single Lightweight UAV SAR.

    Science.gov (United States)

    Li, Jincheng; Chen, Jie; Wang, Pengbo; Li, Chunsheng

    2018-02-11

    In the surveillance of interested regions by unmanned aerial vehicle (UAV), system performance relies greatly on the motion control strategy of the UAV and the operation characteristics of the onboard sensors. This paper investigates the 2D path planning problem for the lightweight UAV synthetic aperture radar (SAR) system in an environment of multiple regions of interest (ROIs), the sizes of which are comparable to the radar swath width. Taking into account the special requirements of the SAR system on the motion of the platform, we model path planning for UAV SAR as a constrained multiobjective optimization problem (MOP). Based on the fact that the UAV route can be designed in the map image, an image-based path planner is proposed in this paper. First, the neighboring ROIs are merged by the morphological operation. Then, the parts of routes for data collection of the ROIs can be located according to the geometric features of the ROIs and the observation geometry of UAV SAR. Lastly, the route segments for ROIs surveillance are connected by a path planning algorithm named the sampling-based sparse A* search (SSAS) algorithm. Simulation experiments in real scenarios demonstrate that the proposed sensor-oriented path planner can improve the reconnaissance performance of lightweight UAV SAR greatly compared with the conventional zigzag path planner.

  13. Technologies Advance UAVs for Science, Military

    Science.gov (United States)

    2010-01-01

    A Space Act Agreement with Goddard Space Flight Center and West Virginia University enabled Aurora Flight Sciences Corporation, of Manassas, Virginia, to develop cost-effective composite manufacturing capabilities and open a facility in West Virginia. The company now employs 160 workers at the plant, tasked with crafting airframe components for the Global Hawk unmanned aerial vehicle (UAV) program. While one third of the company's workforce focuses on Global Hawk production, the rest of the company develops advanced UAV technologies that are redefining traditional approaches to unmanned aviation. Since the company's founding, Aurora s cutting-edge work has been supported with funding from NASA's Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) programs.

  14. UAV MONITORING FOR ENVIROMENTAL MANAGEMENT IN GALAPAGOS ISLANDS

    Directory of Open Access Journals (Sweden)

    D. Ballaria

    2016-06-01

    Full Text Available In the Galapagos Islands, where 97% of the territory is protected and ecosystem dynamics are highly vulnerable, timely and accurate information is key for decision making. An appropriate monitoring system must meet two key features: on one hand, being able to capture information in a systematic and regular basis, and on the other hand, to quickly gather information on demand for specific purposes. The lack of such a system for geographic information limits the ability of Galapagos Islands’ institutions to evaluate and act upon environmental threats such as invasive species spread and vegetation degradation. In this context, the use of UAVs (unmanned aerial vehicles for capturing georeferenced images is a promising technology for environmental monitoring and management. This paper explores the potential of UAV images for monitoring degradation of littoral vegetation in Puerto Villamil (Isabela Island, Galapagos, Ecuador. Imagery was captured using two camera types: Red Green Blue (RGB and Infrarred Red Green (NIR. First, vegetation presence was identified through NDVI. Second, object-based classification was carried out for characterization of vegetation vigor. Results demonstrates the feasibility of UAV technology for base-line studies and monitoring on the amount and vigorousness of littoral vegetation in the Galapagos Islands. It is also showed that UAV images are not only useful for visual interpretation and object delineation, but also to timely produce useful thematic information for environmental management.

  15. UAV Monitoring for Enviromental Management in Galapagos Islands

    Science.gov (United States)

    Ballari, D.; Orellana, D.; Acosta, E.; Espinoza, A.; Morocho, V.

    2016-06-01

    In the Galapagos Islands, where 97% of the territory is protected and ecosystem dynamics are highly vulnerable, timely and accurate information is key for decision making. An appropriate monitoring system must meet two key features: on one hand, being able to capture information in a systematic and regular basis, and on the other hand, to quickly gather information on demand for specific purposes. The lack of such a system for geographic information limits the ability of Galapagos Islands' institutions to evaluate and act upon environmental threats such as invasive species spread and vegetation degradation. In this context, the use of UAVs (unmanned aerial vehicles) for capturing georeferenced images is a promising technology for environmental monitoring and management. This paper explores the potential of UAV images for monitoring degradation of littoral vegetation in Puerto Villamil (Isabela Island, Galapagos, Ecuador). Imagery was captured using two camera types: Red Green Blue (RGB) and Infrarred Red Green (NIR). First, vegetation presence was identified through NDVI. Second, object-based classification was carried out for characterization of vegetation vigor. Results demonstrates the feasibility of UAV technology for base-line studies and monitoring on the amount and vigorousness of littoral vegetation in the Galapagos Islands. It is also showed that UAV images are not only useful for visual interpretation and object delineation, but also to timely produce useful thematic information for environmental management.

  16. Recce and UAV: mass memory an enabling technology for merger

    Science.gov (United States)

    Hall, Walter J., Jr.

    1996-11-01

    In the era of Declining Defense Dollars, the cost of sophisticated aircraft and highly trained personnel has heightened interest in Unmanned Air Vehicles (UAVs). The obvious lure is the lower vehicle cost (no crew station and crew support systems) and reduced needs for highly skilled air crews. Reconnaissance (commonly called recce) aircraft and their missions are among the commonly sighted applications for UAVs. Today's UAV recce aircraft (such as the Predator) are the genesis of much more sophisticated UAVs of the future. The evolution of the UAV will not be constrained to recce aircraft, but the recce mission will be significant for UAVs. The recce hole has historically been that of a battlefield data collector for post mission review and planning. In the electronic battlefield of the future, that role will be expanded. Envisioned mission for future recce aircraft include real-time scout, target location and fire coordination, battle damage assessment, and large area surveillance. Associated with many of these new roles is the need to store or assess much higher volumes of data. The higher volume data requirements are the result of higher resolution sensors (the Advanced Helicopter Pilotage infrared sensor has a data rate of near 1.2 Gigabits per second) and multi-sensor applications (the Multi-Sensor Aided Targeting program considered infrared, TV, and radar). The evolution of the UAV recce role, and associated increased data storage needs (from higher data rates and increased coverage requirements), requires the development of new data storage equipment. One solution to the increased storage needs is solid-state memory. As solid-state memories become faster, smaller, and cheaper they will enable the UAV recce mission capability to expand. Because of the speed of the memory, it will be possible to buffer and assess (identify the existence of targets or other points of interest) data before committing to consumption of limited storage assets. Faster memory

  17. Development of a variable stability, modular UAV airframe for local research purposes

    CSIR Research Space (South Africa)

    Monk, John S

    2008-11-01

    Full Text Available /DPSS Wind tunnel Test CAD Patterns &Moulds Future partners Manufacture XDM 1 Auto pilot spec. A/P design Univ. Stellenbosch A/P manufacture A/P update Manufacture UAVs 1&2 Integrate XM 2D Structural Design A/P integrate Iron Bird... Manufacture XDM 2 Slide 30 © CSIR 2008 www.csir.co.za UAV Systems Integration Laboratory Servos UAV Flight SimulatorIron Bird (XDM) Motors and Controllers Looms Wind Tunnel? Control algorithms Flight models Atmospheric...

  18. Automatic detection of blurred images in UAV image sets

    Science.gov (United States)

    Sieberth, Till; Wackrow, Rene; Chandler, Jim H.

    2016-12-01

    Unmanned aerial vehicles (UAV) have become an interesting and active research topic for photogrammetry. Current research is based on images acquired by an UAV, which have a high ground resolution and good spectral and radiometrical resolution, due to the low flight altitudes combined with a high resolution camera. UAV image flights are also cost effective and have become attractive for many applications including, change detection in small scale areas. One of the main problems preventing full automation of data processing of UAV imagery is the degradation effect of blur caused by camera movement during image acquisition. This can be caused by the normal flight movement of the UAV as well as strong winds, turbulence or sudden operator inputs. This blur disturbs the visual analysis and interpretation of the data, causes errors and can degrade the accuracy in automatic photogrammetric processing algorithms. The detection and removal of these images is currently achieved manually, which is both time consuming and prone to error, particularly for large image-sets. To increase the quality of data processing an automated process is necessary, which must be both reliable and quick. This paper describes the development of an automatic filtering process, which is based upon the quantification of blur in an image. Images with known blur are processed digitally to determine a quantifiable measure of image blur. The algorithm is required to process UAV images fast and reliably to relieve the operator from detecting blurred images manually. The newly developed method makes it possible to detect blur caused by linear camera displacement and is based on human detection of blur. Humans detect blurred images best by comparing it to other images in order to establish whether an image is blurred or not. The developed algorithm simulates this procedure by creating an image for comparison using image processing. Creating internally a comparable image makes the method independent of

  19. Standardized access, display, and retrieval of medical video

    Science.gov (United States)

    Bellaire, Gunter; Steines, Daniel; Graschew, Georgi; Thiel, Andreas; Bernarding, Johannes; Tolxdorff, Thomas; Schlag, Peter M.

    1999-05-01

    The system presented here enhances documentation and data- secured, second-opinion facilities by integrating video sequences into DICOM 3.0. We present an implementation for a medical video server extended by a DICOM interface. Security mechanisms conforming with DICOM are integrated to enable secure internet access. Digital video documents of diagnostic and therapeutic procedures should be examined regarding the clip length and size necessary for second opinion and manageable with today's hardware. Image sources relevant for this paper include 3D laparoscope, 3D surgical microscope, 3D open surgery camera, synthetic video, and monoscopic endoscopes, etc. The global DICOM video concept and three special workplaces of distinct applications are described. Additionally, an approach is presented to analyze the motion of the endoscopic camera for future automatic video-cutting. Digital stereoscopic video sequences are especially in demand for surgery . Therefore DSVS are also integrated into the DICOM video concept. Results are presented describing the suitability of stereoscopic display techniques for the operating room.

  20. Improved Seam-Line Searching Algorithm for UAV Image Mosaic with Optical Flow.

    Science.gov (United States)

    Zhang, Weilong; Guo, Bingxuan; Li, Ming; Liao, Xuan; Li, Wenzhuo

    2018-04-16

    Ghosting and seams are two major challenges in creating unmanned aerial vehicle (UAV) image mosaic. In response to these problems, this paper proposes an improved method for UAV image seam-line searching. First, an image matching algorithm is used to extract and match the features of adjacent images, so that they can be transformed into the same coordinate system. Then, the gray scale difference, the gradient minimum, and the optical flow value of pixels in adjacent image overlapped area in a neighborhood are calculated, which can be applied to creating an energy function for seam-line searching. Based on that, an improved dynamic programming algorithm is proposed to search the optimal seam-lines to complete the UAV image mosaic. This algorithm adopts a more adaptive energy aggregation and traversal strategy, which can find a more ideal splicing path for adjacent UAV images and avoid the ground objects better. The experimental results show that the proposed method can effectively solve the problems of ghosting and seams in the panoramic UAV images.

  1. Optimizing the presentation of UAV images in an attack helicopter cockpit

    NARCIS (Netherlands)

    Jansen, C.; Vries, S.C. de; Duistermaat, M.

    2006-01-01

    Future Unmanned Aerial Vehicles (UAV) will collaborate more directly with military manned aircraft. TNO Defence, Security and Safety investigated how to present UAV sensor images in a fighter aircraft cockpit in order to maximize target identification and flying performance. Ten military pilots

  2. Application Possibility of Smartphone as Payload for Photogrammetric Uav System

    Science.gov (United States)

    Yun, M. H.; Kim, J.; Seo, D.; Lee, J.; Choi, C.

    2012-07-01

    Smartphone can not only be operated under 3G network environment anytime and anyplace but also cost less than the existing photogrammetric UAV since it provides high-resolution image, 3D location and attitude data on a real-time basis from a variety of built-in sensors. This study is aimed to assess the possibility of smartphone as a payload for photogrammetric UAV system. Prior to such assessment, a smartphone-based photogrammetric UAV system application was developed, through which real-time image, location and attitude data was obtained using smartphone under both static and dynamic conditions. Subsequently the accuracy assessment on the location and attitude data obtained and sent by this system was conducted. The smartphone images were converted into ortho-images through image triangulation. The image triangulation was conducted in accordance with presence or absence of consideration of the interior orientation (IO) parameters determined by camera calibration. In case IO parameters were taken into account in the static experiment, the results from triangulation for any smartphone type were within 1.5 pixel (RMSE), which was improved at least by 35% compared to when IO parameters were not taken into account. On the contrary, the improvement effect of considering IO parameters on accuracy in triangulation for smartphone images in dynamic experiment was not significant compared to the static experiment. It was due to the significant impact of vibration and sudden attitude change of UAV on the actuator for automatic focus control within the camera built in smartphone under the dynamic condition. This cause appears to have a negative impact on the image-based DEM generation. Considering these study findings, it is suggested that smartphone is very feasible as a payload for UAV system. It is also expected that smartphone may be loaded onto existing UAV playing direct or indirect roles significantly.

  3. Probabilistic Approaches to Video Retrieval

    NARCIS (Netherlands)

    Ianeva, Tzvetanka; Boldareva, L.; Westerveld, T.H.W.; Cornacchia, Roberto; Hiemstra, Djoerd; de Vries, A.P.

    Our experiments for TRECVID 2004 further investigate the applicability of the so-called “Generative Probabilistic Models to video retrieval��?. TRECVID 2003 results demonstrated that mixture models computed from video shot sequences improve the precision of “query by examples��? results when

  4. High spatial resolution mapping of folds and fractures using Unmanned Aerial Vehicle (UAV) photogrammetry

    Science.gov (United States)

    Cruden, A. R.; Vollgger, S.

    2016-12-01

    The emerging capability of UAV photogrammetry combines a simple and cost-effective method to acquire digital aerial images with advanced computer vision algorithms that compute spatial datasets from a sequence of overlapping digital photographs from various viewpoints. Depending on flight altitude and camera setup, sub-centimeter spatial resolution orthophotographs and textured dense point clouds can be achieved. Orientation data can be collected for detailed structural analysis by digitally mapping such high-resolution spatial datasets in a fraction of time and with higher fidelity compared to traditional mapping techniques. Here we describe a photogrammetric workflow applied to a structural study of folds and fractures within alternating layers of sandstone and mudstone at a coastal outcrop in SE Australia. We surveyed this location using a downward looking digital camera mounted on commercially available multi-rotor UAV that autonomously followed waypoints at a set altitude and speed to ensure sufficient image overlap, minimum motion blur and an appropriate resolution. The use of surveyed ground control points allowed us to produce a geo-referenced 3D point cloud and an orthophotograph from hundreds of digital images at a spatial resolution automatically extracted from these high-resolution datasets using open-source software. This resulted in an extensive and statistically relevant orientation dataset that was used to 1) interpret the progressive development of folds and faults in the region, and 2) to generate a 3D structural model that underlines the complex internal structure of the outcrop and quantifies spatial variations in fold geometries. Overall, our work highlights how UAV photogrammetry can contribute to new insights in structural analysis.

  5. Hurricane Harvey Building Damage Assessment Using UAV Data

    Science.gov (United States)

    Yeom, J.; Jung, J.; Chang, A.; Choi, I.

    2017-12-01

    Hurricane Harvey which was extremely destructive major hurricane struck southern Texas, U.S.A on August 25, causing catastrophic flooding and storm damages. We visited Rockport suffered severe building destruction and conducted UAV (Unmanned Aerial Vehicle) surveying for building damage assessment. UAV provides very high resolution images compared with traditional remote sensing data. In addition, prompt and cost-effective damage assessment can be performed regardless of several limitations in other remote sensing platforms such as revisit interval of satellite platforms, complicated flight plan in aerial surveying, and cloud amounts. In this study, UAV flight and GPS surveying were conducted two weeks after hurricane damage to generate an orthomosaic image and a DEM (Digital Elevation Model). 3D region growing scheme has been proposed to quantitatively estimate building damages considering building debris' elevation change and spectral difference. The result showed that the proposed method can be used for high definition building damage assessment in a time- and cost-effective way.

  6. An Ecological Approach to the Design of UAV Ground Control Station (GCS) Status Displays

    Science.gov (United States)

    Dowell, Susan; Morphew, Ephimia; Shively, Jay

    2003-01-01

    Use of UAVs in military and commercial applications will continue to increase. However, there has been limited research devoted to UAV GCS design. The current study employed an ecological approach to interfac e design. Ecological Interface Design (EID) can be characterized as r epresenting the properties of a system, such that an operator is enco uraged to use skill-based behavior when problem solving. When more ef fortful cognitive processes become necessary due to unfamiliar situations, the application of EID philosophy supports the application of kn owledge-based behavior. With advances toward multiple UAV command and control, operators need GCS interfaces designed to support understan ding of complex systems. We hypothesized that use of EID principles f or the display of UAV status information would result in better opera tor performance and situational awareness, while decreasing workload. Pilots flew a series of missions with three UAV GCS displays of statu s information (Alphanumeric, Ecological, and Hybrid display format). Measures of task performance, Situational Awareness, and workload dem onstrated the benefits of using an ecological approach to designing U AV GCS displays. The application of ecological principles to the design of UAV GCSs is a promising area for improving UAV operations.

  7. Preliminary Study on Earthquake Surface Rupture Extraction from Uav Images

    Science.gov (United States)

    Yuan, X.; Wang, X.; Ding, X.; Wu, X.; Dou, A.; Wang, S.

    2018-04-01

    Because of the advantages of low-cost, lightweight and photography under the cloud, UAVs have been widely used in the field of seismic geomorphology research in recent years. Earthquake surface rupture is a typical seismic tectonic geomorphology that reflects the dynamic and kinematic characteristics of crustal movement. The quick identification of earthquake surface rupture is of great significance for understanding the mechanism of earthquake occurrence, disasters distribution and scale. Using integrated differential UAV platform, series images were acquired with accuracy POS around the former urban area (Qushan town) of Beichuan County as the area stricken seriously by the 2008 Wenchuan Ms8.0 earthquake. Based on the multi-view 3D reconstruction technique, the high resolution DSM and DOM are obtained from differential UAV images. Through the shade-relief map and aspect map derived from DSM, the earthquake surface rupture is extracted and analyzed. The results show that the surface rupture can still be identified by using the UAV images although the time of earthquake elapse is longer, whose middle segment is characterized by vertical movement caused by compression deformation from fault planes.

  8. Multiple Event Localization in a Sparse Acoustic Sensor Network Using UAVs as Data Mules

    Science.gov (United States)

    2012-12-01

    the events to arrive in different orders at the sensors. Consequently , simple rules to group the ToAs from an event at different sensors, such as...a Microhard radio to forward the ToAs to the mule-UAV. Two Procerus Unicorn UAVs were used with different payloads. The imaging- UAV was equipped

  9. Two-UAV Intersection Localization System Based on the Airborne Optoelectronic Platform.

    Science.gov (United States)

    Bai, Guanbing; Liu, Jinghong; Song, Yueming; Zuo, Yujia

    2017-01-06

    To address the limitation of the existing UAV (unmanned aerial vehicles) photoelectric localization method used for moving objects, this paper proposes an improved two-UAV intersection localization system based on airborne optoelectronic platforms by using the crossed-angle localization method of photoelectric theodolites for reference. This paper introduces the makeup and operating principle of intersection localization system, creates auxiliary coordinate systems, transforms the LOS (line of sight, from the UAV to the target) vectors into homogeneous coordinates, and establishes a two-UAV intersection localization model. In this paper, the influence of the positional relationship between UAVs and the target on localization accuracy has been studied in detail to obtain an ideal measuring position and the optimal localization position where the optimal intersection angle is 72.6318°. The result shows that, given the optimal position, the localization root mean square error (RMS) will be 25.0235 m when the target is 5 km away from UAV baselines. Finally, the influence of modified adaptive Kalman filtering on localization results is analyzed, and an appropriate filtering model is established to reduce the localization RMS error to 15.7983 m. Finally, An outfield experiment was carried out and obtained the optimal results: σ B = 1.63 × 10 - 4 ( ° ) , σ L = 1.35 × 10 - 4 ( ° ) , σ H = 15.8 ( m ) , σ s u m = 27.6 ( m ) , where σ B represents the longitude error, σ L represents the latitude error, σ H represents the altitude error, and σ s u m represents the error radius.

  10. A MICRO-UAV SYSTEM FOR FOREST MANAGEMENT

    Directory of Open Access Journals (Sweden)

    T. Hormigo

    2013-08-01

    Full Text Available Spin.Works has developed a complete micro-UAV system with the purpose of supporting forest management activities. The aircraft is based on a winged-body design spanning 1.8 m with a maximum take-off weight of 2 kg, and can carry out missions lasting up to 2 h at a cruise speed of about 60 km/h. The corresponding ground station ensures the mission planning functions, real-time flight monitoring and visualization, and serves also as a real-time and post-flight data exploitation platform. A particular emphasis is placed on image processing techniques applied to two operational concepts: a fire detection service and a forest mapping service. The real-time operations related to fire detection consist on object tracking and geo-referencing functions, which can be operated by a user directly over the video stream, enabling the quick estimation of the 3D location (latitude, longitude, altitude of suspected fires. The post-flight processing consists of extracting valuable knowledge from the payload data, in particular tree coverage maps, orthophoto mosaics and Digital Surface Models (DSMs, which can be used for further forest characterization such as wood and cork volume estimation. The system is currently entering initial operations, with expanded operations expected during Q3 2013.

  11. No Reference Video-Quality-Assessment Model for Monitoring Video Quality of IPTV Services

    Science.gov (United States)

    Yamagishi, Kazuhisa; Okamoto, Jun; Hayashi, Takanori; Takahashi, Akira

    Service providers should monitor the quality of experience of a communication service in real time to confirm its status. To do this, we previously proposed a packet-layer model that can be used for monitoring the average video quality of typical Internet protocol television content using parameters derived from transmitted packet headers. However, it is difficult to monitor the video quality per user using the average video quality because video quality depends on the video content. To accurately monitor the video quality per user, a model that can be used for estimating the video quality per video content rather than the average video quality should be developed. Therefore, to take into account the impact of video content on video quality, we propose a model that calculates the difference in video quality between the video quality of the estimation-target video and the average video quality estimated using a packet-layer model. We first conducted extensive subjective quality assessments for different codecs and video sequences. We then model their characteristics based on parameters related to compression and packet loss. Finally, we verify the performance of the proposed model by applying it to unknown data sets different from the training data sets used for developing the model.

  12. Visual navigation of the UAVs on the basis of 3D natural landmarks

    Science.gov (United States)

    Karpenko, Simon; Konovalenko, Ivan; Miller, Alexander; Miller, Boris; Nikolaev, Dmitry

    2015-12-01

    This work considers the tracking of the UAV (unmanned aviation vehicle) on the basis of onboard observations of natural landmarks including azimuth and elevation angles. It is assumed that UAV's cameras are able to capture the angular position of reference points and to measure the angles of the sight line. Such measurements involve the real position of UAV in implicit form, and therefore some of nonlinear filters such as Extended Kalman filter (EKF) or others must be used in order to implement these measurements for UAV control. Recently it was shown that modified pseudomeasurement method may be used to control UAV on the basis of the observation of reference points assigned along the UAV path in advance. However, the use of such set of points needs the cumbersome recognition procedure with the huge volume of on-board memory. The natural landmarks serving as such reference points which may be determined on-line can significantly reduce the on-board memory and the computational difficulties. The principal difference of this work is the usage of the 3D reference points coordinates which permits to determine the position of the UAV more precisely and thereby to guide along the path with higher accuracy which is extremely important for successful performance of the autonomous missions. The article suggests the new RANSAC for ISOMETRY algorithm and the use of recently developed estimation and control algorithms for tracking of given reference path under external perturbation and noised angular measurements.

  13. Integration of Multiple UAVs for Collaborative ISR Missions in an Urban Environment

    OpenAIRE

    Chua, Chee Nam

    2012-01-01

    Military conflicts are shifting from jungles and deserts to cities. This is because terrorists, insurgents, and guerillas find these areas provide a rich target environment and good hideouts. With the use of UAVs, urban threats can be tracked and targeted effectively. However, in an urban environment where there is little or no GPS signals and many obstacles, navigation of UAVs is a major challenge. Multiple UAVs can be employed to share sensor information to counter these challenges and to p...

  14. UAV Deployment Exercise for Mapping Purposes: Evaluation of Emergency Response Applications

    Directory of Open Access Journals (Sweden)

    Piero Boccardo

    2015-07-01

    Full Text Available Exploiting the decrease of costs related to UAV technology, the humanitarian community started piloting the use of similar systems in humanitarian crises several years ago in different application fields, i.e., disaster mapping and information gathering, community capacity building, logistics and even transportation of goods. Part of the author’s group, composed of researchers in the field of applied geomatics, has been piloting the use of UAVs since 2006, with a specific focus on disaster management application. In the framework of such activities, a UAV deployment exercise was jointly organized with the Regional Civil Protection authority, mainly aimed at assessing the operational procedures to deploy UAVs for mapping purposes and the usability of the acquired data in an emergency response context. In the paper the technical features of the UAV platforms will be described, comparing the main advantages/disadvantages of fixed-wing versus rotor platforms. The main phases of the adopted operational procedure will be discussed and assessed especially in terms of time required to carry out each step, highlighting potential bottlenecks and in view of the national regulation framework, which is rapidly evolving. Different methodologies for the processing of the acquired data will be described and discussed, evaluating the fitness for emergency response applications.

  15. UAV Deployment Exercise for Mapping Purposes: Evaluation of Emergency Response Applications.

    Science.gov (United States)

    Boccardo, Piero; Chiabrando, Filiberto; Dutto, Furio; Tonolo, Fabio Giulio; Lingua, Andrea

    2015-07-02

    Exploiting the decrease of costs related to UAV technology, the humanitarian community started piloting the use of similar systems in humanitarian crises several years ago in different application fields, i.e., disaster mapping and information gathering, community capacity building, logistics and even transportation of goods. Part of the author's group, composed of researchers in the field of applied geomatics, has been piloting the use of UAVs since 2006, with a specific focus on disaster management application. In the framework of such activities, a UAV deployment exercise was jointly organized with the Regional Civil Protection authority, mainly aimed at assessing the operational procedures to deploy UAVs for mapping purposes and the usability of the acquired data in an emergency response context. In the paper the technical features of the UAV platforms will be described, comparing the main advantages/disadvantages of fixed-wing versus rotor platforms. The main phases of the adopted operational procedure will be discussed and assessed especially in terms of time required to carry out each step, highlighting potential bottlenecks and in view of the national regulation framework, which is rapidly evolving. Different methodologies for the processing of the acquired data will be described and discussed, evaluating the fitness for emergency response applications.

  16. Quality Analysis on 3d Buidling Models Reconstructed from Uav Imagery

    Science.gov (United States)

    Jarzabek-Rychard, M.; Karpina, M.

    2016-06-01

    Recent developments in UAV technology and structure from motion techniques have effected that UAVs are becoming standard platforms for 3D data collection. Because of their flexibility and ability to reach inaccessible urban parts, drones appear as optimal solution for urban applications. Building reconstruction from the data collected with UAV has the important potential to reduce labour cost for fast update of already reconstructed 3D cities. However, especially for updating of existing scenes derived from different sensors (e.g. airborne laser scanning), a proper quality assessment is necessary. The objective of this paper is thus to evaluate the potential of UAV imagery as an information source for automatic 3D building modeling at LOD2. The investigation process is conducted threefold: (1) comparing generated SfM point cloud to ALS data; (2) computing internal consistency measures of the reconstruction process; (3) analysing the deviation of Check Points identified on building roofs and measured with a tacheometer. In order to gain deep insight in the modeling performance, various quality indicators are computed and analysed. The assessment performed according to the ground truth shows that the building models acquired with UAV-photogrammetry have the accuracy of less than 18 cm for the plannimetric position and about 15 cm for the height component.

  17. QUALITY ANALYSIS ON 3D BUIDLING MODELS RECONSTRUCTED FROM UAV IMAGERY

    Directory of Open Access Journals (Sweden)

    M. Jarzabek-Rychard

    2016-06-01

    Full Text Available Recent developments in UAV technology and structure from motion techniques have effected that UAVs are becoming standard platforms for 3D data collection. Because of their flexibility and ability to reach inaccessible urban parts, drones appear as optimal solution for urban applications. Building reconstruction from the data collected with UAV has the important potential to reduce labour cost for fast update of already reconstructed 3D cities. However, especially for updating of existing scenes derived from different sensors (e.g. airborne laser scanning, a proper quality assessment is necessary. The objective of this paper is thus to evaluate the potential of UAV imagery as an information source for automatic 3D building modeling at LOD2. The investigation process is conducted threefold: (1 comparing generated SfM point cloud to ALS data; (2 computing internal consistency measures of the reconstruction process; (3 analysing the deviation of Check Points identified on building roofs and measured with a tacheometer. In order to gain deep insight in the modeling performance, various quality indicators are computed and analysed. The assessment performed according to the ground truth shows that the building models acquired with UAV-photogrammetry have the accuracy of less than 18 cm for the plannimetric position and about 15 cm for the height component.

  18. Predicting human activities in sequences of actions in RGB-D videos

    Science.gov (United States)

    Jardim, David; Nunes, Luís.; Dias, Miguel

    2017-03-01

    In our daily activities we perform prediction or anticipation when interacting with other humans or with objects. Prediction of human activity made by computers has several potential applications: surveillance systems, human computer interfaces, sports video analysis, human-robot-collaboration, games and health-care. We propose a system capable of recognizing and predicting human actions using supervised classifiers trained with automatically labeled data evaluated in our human activity RGB-D dataset (recorded with a Kinect sensor) and using only the position of the main skeleton joints to extract features. Using conditional random fields (CRFs) to model the sequential nature of actions in a sequence has been used before, but where other approaches try to predict an outcome or anticipate ahead in time (seconds), we try to predict what will be the next action of a subject. Our results show an activity prediction accuracy of 89.9% using an automatically labeled dataset.

  19. Vision based systems for UAV applications

    CERN Document Server

    Kuś, Zygmunt

    2013-01-01

    This monograph is motivated by a significant number of vision based algorithms for Unmanned Aerial Vehicles (UAV) that were developed during research and development projects. Vision information is utilized in various applications like visual surveillance, aim systems, recognition systems, collision-avoidance systems and navigation. This book presents practical applications, examples and recent challenges in these mentioned application fields. The aim of the book is to create a valuable source of information for researchers and constructors of solutions utilizing vision from UAV. Scientists, researchers and graduate students involved in computer vision, image processing, data fusion, control algorithms, mechanics, data mining, navigation and IC can find many valuable, useful and practical suggestions and solutions. The latest challenges for vision based systems are also presented.

  20. Closing the Gap Between Research and Field Applications for Multi-UAV Cooperative Missions

    Science.gov (United States)

    2013-09-01

    REPORT DATE September 2013 3. REPORT TYPE AND DATES COVERED Master’s Thesis 4. TITLE AND SUBTITLE CLOSING THE GAP BETWEEN RESEARCH AND FIELD...iii Approved for public release; distribution is unlimited CLOSING THE GAP BETWEEN RESEARCH AND FIELD APPLICATIONS FOR MULTI-UAV COOPERATIVE...the report is to lay the groundwork for future analysis in multi-UAV analysis to close the gap between existing research and efficient multi-UAV

  1. Enabling UAV Navigation with Sensor and Environmental Uncertainty in Cluttered and GPS-Denied Environments

    Directory of Open Access Journals (Sweden)

    Fernando Vanegas

    2016-05-01

    Full Text Available Unmanned Aerial Vehicles (UAV can navigate with low risk in obstacle-free environments using ground control stations that plan a series of GPS waypoints as a path to follow. This GPS waypoint navigation does however become dangerous in environments where the GPS signal is faulty or is only present in some places and when the airspace is filled with obstacles. UAV navigation then becomes challenging because the UAV uses other sensors, which in turn generate uncertainty about its localisation and motion systems, especially if the UAV is a low cost platform. Additional uncertainty affects the mission when the UAV goal location is only partially known and can only be discovered by exploring and detecting a target. This navigation problem is established in this research as a Partially-Observable Markov Decision Process (POMDP, so as to produce a policy that maps a set of motion commands to belief states and observations. The policy is calculated and updated on-line while flying with a newly-developed system for UAV Uncertainty-Based Navigation (UBNAV, to navigate in cluttered and GPS-denied environments using observations and executing motion commands instead of waypoints. Experimental results in both simulation and real flight tests show that the UAV finds a path on-line to a region where it can explore and detect a target without colliding with obstacles. UBNAV provides a new method and an enabling technology for scientists to implement and test UAV navigation missions with uncertainty where targets must be detected using on-line POMDP in real flight scenarios.

  2. Enabling UAV Navigation with Sensor and Environmental Uncertainty in Cluttered and GPS-Denied Environments.

    Science.gov (United States)

    Vanegas, Fernando; Gonzalez, Felipe

    2016-05-10

    Unmanned Aerial Vehicles (UAV) can navigate with low risk in obstacle-free environments using ground control stations that plan a series of GPS waypoints as a path to follow. This GPS waypoint navigation does however become dangerous in environments where the GPS signal is faulty or is only present in some places and when the airspace is filled with obstacles. UAV navigation then becomes challenging because the UAV uses other sensors, which in turn generate uncertainty about its localisation and motion systems, especially if the UAV is a low cost platform. Additional uncertainty affects the mission when the UAV goal location is only partially known and can only be discovered by exploring and detecting a target. This navigation problem is established in this research as a Partially-Observable Markov Decision Process (POMDP), so as to produce a policy that maps a set of motion commands to belief states and observations. The policy is calculated and updated on-line while flying with a newly-developed system for UAV Uncertainty-Based Navigation (UBNAV), to navigate in cluttered and GPS-denied environments using observations and executing motion commands instead of waypoints. Experimental results in both simulation and real flight tests show that the UAV finds a path on-line to a region where it can explore and detect a target without colliding with obstacles. UBNAV provides a new method and an enabling technology for scientists to implement and test UAV navigation missions with uncertainty where targets must be detected using on-line POMDP in real flight scenarios.

  3. Standing "the Watches" with Armed UAVs

    National Research Council Canada - National Science Library

    McCulloch, Francis

    2002-01-01

    This paper addresses the additional Options available to the operational commander in charge of conducting 'presence and monitoring' missions with the introduction of an armed capability on Unmanned Aerial Vehicles (UAVs...

  4. UAV FOR GEODATA ACQUISITION IN AGRICULTUREAL AND FORESTAL APPLICATIONS

    Directory of Open Access Journals (Sweden)

    P. Reidelstürz

    2012-09-01

    The airframe´s wingspan is about 3,45m weighting 4.2 kg, ready to fly. The hand launchable UAV can start from any place in agricultural regions. The wing is configured with flaps, allowing steep approaches and short landings using a „butterfly“ brake configuration. In spite of the lightweight configuration the UAV yet proves its worth under windy baltic wether situations by collecting regular sharp images of fields under wind speed up to 15m/s (Beaufort 6 –7. In further projects the development of further payload modules and a user friendly flight planning tool is scheduled considering different payload – and airframe requirements for different precision farming purposes and forest applications. Data processing and workflow will be optimized. Cooperation with further partners to establish UAV systems in agricultural, forest and geodata aquisition is desired.

  5. Uav Photogrammetry: a Practical Solution for Challenging Mapping Projects

    Science.gov (United States)

    Saadatseresht, M.; Hashempour, A. H.; Hasanlou, M.

    2015-12-01

    We have observed huge attentions to application of unmanned aerial vehicle (UAV) in aerial mapping since a decade ago. Though, it has several advantages for handling time/cost/quality issues, there are a dozen of challenges in working with UAVs. In this paper, we; as the Robotic Photogrammetry Research Group (RPRG), will firstly review these challenges then show its advantages in three special practical projects. For each project, we will share our experiences through description of the UAV specifications, flight settings and processing steps. At the end, we will illustrate final result of each project and show how this technology could make unbelievable benefits to clients including 3D city realistic model in decimetre level, ultra high quality map production in several centimetre level, and accessing to a high risk and rough relief area for mapping aims.

  6. Multisensor Equipped Uav/ugv for Automated Exploration

    Science.gov (United States)

    Batzdorfer, S.; Bobbe, M.; Becker, M.; Harms, H.; Bestmann, U.

    2017-08-01

    The usage of unmanned systems for exploring disaster scenarios has become more and more important in recent times as a supporting system for action forces. These systems have to offer a well-balanced relationship between the quality of support and additional workload. Therefore within the joint research project ANKommEn - german acronym for Automated Navigation and Communication for Exploration - a system for exploration of disaster scenarios is build-up using multiple UAV und UGV controlled via a central ground station. The ground station serves as user interface for defining missions and tasks conducted by the unmanned systems, equipped with different environmental sensors like cameras - RGB as well as IR - or LiDAR. Depending on the exploration task results, in form of pictures, 2D stitched orthophoto or LiDAR point clouds will be transmitted via datalinks and displayed online at the ground station or will be processed in short-term after a mission, e.g. 3D photogrammetry. For mission planning and its execution, UAV/UGV monitoring and georeferencing of environmental sensor data, reliable positioning and attitude information is required. This is gathered using an integrated GNSS/IMU positioning system. In order to increase availability of positioning information in GNSS challenging scenarios, a GNSS-Multiconstellation based approach is used, amongst others. The present paper focuses on the overall system design including the ground station and sensor setups on the UAVs and UGVs, the underlying positioning techniques as well as 2D and 3D exploration based on a RGB camera mounted on board the UAV and its evaluation based on real world field tests.

  7. MULTISENSOR EQUIPPED UAV/UGV FOR AUTOMATED EXPLORATION

    Directory of Open Access Journals (Sweden)

    S. Batzdorfer

    2017-08-01

    Full Text Available The usage of unmanned systems for exploring disaster scenarios has become more and more important in recent times as a supporting system for action forces. These systems have to offer a well-balanced relationship between the quality of support and additional workload. Therefore within the joint research project ANKommEn – german acronym for Automated Navigation and Communication for Exploration – a system for exploration of disaster scenarios is build-up using multiple UAV und UGV controlled via a central ground station. The ground station serves as user interface for defining missions and tasks conducted by the unmanned systems, equipped with different environmental sensors like cameras – RGB as well as IR – or LiDAR. Depending on the exploration task results, in form of pictures, 2D stitched orthophoto or LiDAR point clouds will be transmitted via datalinks and displayed online at the ground station or will be processed in short-term after a mission, e.g. 3D photogrammetry. For mission planning and its execution, UAV/UGV monitoring and georeferencing of environmental sensor data, reliable positioning and attitude information is required. This is gathered using an integrated GNSS/IMU positioning system. In order to increase availability of positioning information in GNSS challenging scenarios, a GNSS-Multiconstellation based approach is used, amongst others. The present paper focuses on the overall system design including the ground station and sensor setups on the UAVs and UGVs, the underlying positioning techniques as well as 2D and 3D exploration based on a RGB camera mounted on board the UAV and its evaluation based on real world field tests.

  8. Wavelength-Adaptive Dehazing Using Histogram Merging-Based Classification for UAV Images

    Directory of Open Access Journals (Sweden)

    Inhye Yoon

    2015-03-01

    Full Text Available Since incoming light to an unmanned aerial vehicle (UAV platform can be scattered by haze and dust in the atmosphere, the acquired image loses the original color and brightness of the subject. Enhancement of hazy images is an important task in improving the visibility of various UAV images. This paper presents a spatially-adaptive dehazing algorithm that merges color histograms with consideration of the wavelength-dependent atmospheric turbidity. Based on the wavelength-adaptive hazy image acquisition model, the proposed dehazing algorithm consists of three steps: (i image segmentation based on geometric classes; (ii generation of the context-adaptive transmission map; and (iii intensity transformation for enhancing a hazy UAV image. The major contribution of the research is a novel hazy UAV image degradation model by considering the wavelength of light sources. In addition, the proposed transmission map provides a theoretical basis to differentiate visually important regions from others based on the turbidity and merged classification results.

  9. Wavelength-adaptive dehazing using histogram merging-based classification for UAV images.

    Science.gov (United States)

    Yoon, Inhye; Jeong, Seokhwa; Jeong, Jaeheon; Seo, Doochun; Paik, Joonki

    2015-03-19

    Since incoming light to an unmanned aerial vehicle (UAV) platform can be scattered by haze and dust in the atmosphere, the acquired image loses the original color and brightness of the subject. Enhancement of hazy images is an important task in improving the visibility of various UAV images. This paper presents a spatially-adaptive dehazing algorithm that merges color histograms with consideration of the wavelength-dependent atmospheric turbidity. Based on the wavelength-adaptive hazy image acquisition model, the proposed dehazing algorithm consists of three steps: (i) image segmentation based on geometric classes; (ii) generation of the context-adaptive transmission map; and (iii) intensity transformation for enhancing a hazy UAV image. The major contribution of the research is a novel hazy UAV image degradation model by considering the wavelength of light sources. In addition, the proposed transmission map provides a theoretical basis to differentiate visually important regions from others based on the turbidity and merged classification results.

  10. Semiautonomous Avionics-and-Sensors System for a UAV

    Science.gov (United States)

    Shams, Qamar

    2006-01-01

    Unmanned Aerial Vehicles (UAVs) autonomous or remotely controlled pilotless aircraft have been recently thrust into the spotlight for military applications, for homeland security, and as test beds for research. In addition to these functions, there are many space applications in which lightweight, inexpensive, small UAVS can be used e.g., to determine the chemical composition and other qualities of the atmospheres of remote planets. Moreover, on Earth, such UAVs can be used to obtain information about weather in various regions; in particular, they can be used to analyze wide-band acoustic signals to aid in determining the complex dynamics of movement of hurricanes. The Advanced Sensors and Electronics group at Langley Research Center has developed an inexpensive, small, integrated avionics-and-sensors system to be installed in a UAV that serves two purposes. The first purpose is to provide flight data to an AI (Artificial Intelligence) controller as part of an autonomous flight-control system. The second purpose is to store data from a subsystem of distributed MEMS (microelectromechanical systems) sensors. Examples of these MEMS sensors include humidity, temperature, and acoustic sensors, plus chemical sensors for detecting various vapors and other gases in the environment. The critical sensors used for flight control are a differential- pressure sensor that is part of an apparatus for determining airspeed, an absolute-pressure sensor for determining altitude, three orthogonal accelerometers for determining tilt and acceleration, and three orthogonal angular-rate detectors (gyroscopes). By using these eight sensors, it is possible to determine the orientation, height, speed, and rates of roll, pitch, and yaw of the UAV. This avionics-and-sensors system is shown in the figure. During the last few years, there has been rapid growth and advancement in the technological disciplines of MEMS, of onboard artificial-intelligence systems, and of smaller, faster, and

  11. Algorithm for Video Summarization of Bronchoscopy Procedures

    Directory of Open Access Journals (Sweden)

    Leszczuk Mikołaj I

    2011-12-01

    Full Text Available Abstract Background The duration of bronchoscopy examinations varies considerably depending on the diagnostic and therapeutic procedures used. It can last more than 20 minutes if a complex diagnostic work-up is included. With wide access to videobronchoscopy, the whole procedure can be recorded as a video sequence. Common practice relies on an active attitude of the bronchoscopist who initiates the recording process and usually chooses to archive only selected views and sequences. However, it may be important to record the full bronchoscopy procedure as documentation when liability issues are at stake. Furthermore, an automatic recording of the whole procedure enables the bronchoscopist to focus solely on the performed procedures. Video recordings registered during bronchoscopies include a considerable number of frames of poor quality due to blurry or unfocused images. It seems that such frames are unavoidable due to the relatively tight endobronchial space, rapid movements of the respiratory tract due to breathing or coughing, and secretions which occur commonly in the bronchi, especially in patients suffering from pulmonary disorders. Methods The use of recorded bronchoscopy video sequences for diagnostic, reference and educational purposes could be considerably extended with efficient, flexible summarization algorithms. Thus, the authors developed a prototype system to create shortcuts (called summaries or abstracts of bronchoscopy video recordings. Such a system, based on models described in previously published papers, employs image analysis methods to exclude frames or sequences of limited diagnostic or education value. Results The algorithm for the selection or exclusion of specific frames or shots from video sequences recorded during bronchoscopy procedures is based on several criteria, including automatic detection of "non-informative", frames showing the branching of the airways and frames including pathological lesions. Conclusions

  12. Evaluating the effectiveness of low cost UAV generated topography for geomorphic change detection

    Science.gov (United States)

    Cook, K. L.

    2014-12-01

    With the recent explosion in the use and availability of unmanned aerial vehicle platforms and development of easy to use structure from motion software, UAV based photogrammetry is increasingly being adopted to produce high resolution topography for the study of surface processes. UAV systems can vary substantially in price and complexity, but the tradeoffs between these and the quality of the resulting data are not well constrained. We look at one end of this spectrum and evaluate the effectiveness of a simple low cost UAV setup for obtaining high resolution topography in a challenging field setting. Our study site is the Daan River gorge in western Taiwan, a rapidly eroding bedrock gorge that we have monitored with terrestrial Lidar since 2009. The site presents challenges for the generation and analysis of high resolution topography, including vertical gorge walls, vegetation, wide variation in surface roughness, and a complicated 3D morphology. In order to evaluate the accuracy of the UAV-derived topography, we compare it with terrestrial Lidar data collected during the same survey period. Our UAV setup combines a DJI Phantom 2 quadcopter with a 16 megapixel Canon Powershot camera for a total platform cost of less than $850. The quadcopter is flown manually, and the camera is programmed to take a photograph every 5 seconds, yielding 200-250 pictures per flight. We measured ground control points and targets for both the Lidar scans and the aerial surveys using a Leica RTK GPS with 1-2 cm accuracy. UAV derived point clouds were obtained using Agisoft Photoscan software. We conducted both Lidar and UAV surveys before and after a summer typhoon season, allowing us to evaluate the reliability of the UAV survey to detect geomorphic changes in the range of one to several meters. We find that this simple UAV setup can yield point clouds with an average accuracy on the order of 10 cm compared to the Lidar point clouds. Well-distributed and accurately located ground

  13. UAV Swarm Tactics: An Agent-Based Simulation and Markov Process Analysis

    Science.gov (United States)

    2013-06-01

    research UAV platforms, namely the (a) Procerus Unicorn UAV and (b) modified Ritewing ZephyrII RC plane, for ongoing live-fly field experimentation of the...number of possible states would grow exponentially, but short excursions with baseline two-on-one models, as found in the literature, could provide

  14. A Novel Method for Vertical Acceleration Noise Suppression of a Thrust-Vectored VTOL UAV.

    Science.gov (United States)

    Li, Huanyu; Wu, Linfeng; Li, Yingjie; Li, Chunwen; Li, Hangyu

    2016-12-02

    Acceleration is of great importance in motion control for unmanned aerial vehicles (UAVs), especially during the takeoff and landing stages. However, the measured acceleration is inevitably polluted by severe noise. Therefore, a proper noise suppression procedure is required. This paper presents a novel method to reduce the noise in the measured vertical acceleration for a thrust-vectored tail-sitter vertical takeoff and landing (VTOL) UAV. In the new procedure, a Kalman filter is first applied to estimate the UAV mass by using the information in the vertical thrust and measured acceleration. The UAV mass is then used to compute an estimate of UAV vertical acceleration. The estimated acceleration is finally fused with the measured acceleration to obtain the minimum variance estimate of vertical acceleration. By doing this, the new approach incorporates the thrust information into the acceleration estimate. The method is applied to the data measured in a VTOL UAV takeoff experiment. Two other denoising approaches developed by former researchers are also tested for comparison. The results demonstrate that the new method is able to suppress the acceleration noise substantially. It also maintains the real-time performance in the final estimated acceleration, which is not seen in the former denoising approaches. The acceleration treated with the new method can be readily used in the motion control applications for UAVs to achieve improved accuracy.

  15. A Novel Method for Vertical Acceleration Noise Suppression of a Thrust-Vectored VTOL UAV

    Directory of Open Access Journals (Sweden)

    Huanyu Li

    2016-12-01

    Full Text Available Acceleration is of great importance in motion control for unmanned aerial vehicles (UAVs, especially during the takeoff and landing stages. However, the measured acceleration is inevitably polluted by severe noise. Therefore, a proper noise suppression procedure is required. This paper presents a novel method to reduce the noise in the measured vertical acceleration for a thrust-vectored tail-sitter vertical takeoff and landing (VTOL UAV. In the new procedure, a Kalman filter is first applied to estimate the UAV mass by using the information in the vertical thrust and measured acceleration. The UAV mass is then used to compute an estimate of UAV vertical acceleration. The estimated acceleration is finally fused with the measured acceleration to obtain the minimum variance estimate of vertical acceleration. By doing this, the new approach incorporates the thrust information into the acceleration estimate. The method is applied to the data measured in a VTOL UAV takeoff experiment. Two other denoising approaches developed by former researchers are also tested for comparison. The results demonstrate that the new method is able to suppress the acceleration noise substantially. It also maintains the real-time performance in the final estimated acceleration, which is not seen in the former denoising approaches. The acceleration treated with the new method can be readily used in the motion control applications for UAVs to achieve improved accuracy.

  16. Energy-Efficient Systems Eliminate Icing Danger for UAVs

    Science.gov (United States)

    2010-01-01

    Ames Research Center engineer Leonard Haslim invented an anti-icing t echnology called an electroexpulsive separation system, which uses m echanical force to shatter potentially dangerous ice buildup on an ai rcraft surface. Temecula, California-based Ice Management Systems (no w known as IMS-ESS) licensed the technology from Ames and has discov ered a niche market for the lightweight, energy-efficient technology: unmanned aerial vehicles (UAVs). IMS-ESS systems now prevent damagi ng ice accumulation on military UAVs, allowing the vehicles to carry out crucial missions year round.

  17. MPEG-2 Compressed-Domain Algorithms for Video Analysis

    Directory of Open Access Journals (Sweden)

    Hesseler Wolfgang

    2006-01-01

    Full Text Available This paper presents new algorithms for extracting metadata from video sequences in the MPEG-2 compressed domain. Three algorithms for efficient low-level metadata extraction in preprocessing stages are described. The first algorithm detects camera motion using the motion vector field of an MPEG-2 video. The second method extends the idea of motion detection to a limited region of interest, yielding an efficient algorithm to track objects inside video sequences. The third algorithm performs a cut detection using macroblock types and motion vectors.

  18. Evaluation of resampling applied to UAV imagery for weed detection using OBIA

    OpenAIRE

    Borra, I.; Peña Barragán, José Manuel; Torres Sánchez, Jorge; López Granados, Francisca

    2015-01-01

    Los vehículos aéreos no tripulados (UAVs) son una tecnología emergente en el estudio de parámetros agrícolas por sus características y por portar sensores en diferente rango espectral. En este trabajo se ha detectado y cartografiado rodales de malas hierbas en fase temprana mediante análisis OBIA para elaborar mapas que optimicen el tratamiento herbicida localizado. Se ha aplicado resampling (resampleo) sobre imágenes tomadas en campo desde un UAV (UAV-I) para crear una nueva imagen con disti...

  19. UAV Control on the Basis of 3D Landmark Bearing-Only Observations.

    Science.gov (United States)

    Karpenko, Simon; Konovalenko, Ivan; Miller, Alexander; Miller, Boris; Nikolaev, Dmitry

    2015-11-27

    The article presents an approach to the control of a UAV on the basis of 3D landmark observations. The novelty of the work is the usage of the 3D RANSAC algorithm developed on the basis of the landmarks' position prediction with the aid of a modified Kalman-type filter. Modification of the filter based on the pseudo-measurements approach permits obtaining unbiased UAV position estimation with quadratic error characteristics. Modeling of UAV flight on the basis of the suggested algorithm shows good performance, even under significant external perturbations.

  20. Subjective quality of video sequences rendered on LCD with local backlight dimming at different lighting conditions

    Science.gov (United States)

    Mantel, Claire; Korhonen, Jari; Pedersen, Jesper M.; Bech, Søren; Andersen, Jakob Dahl; Forchhammer, Søren

    2015-01-01

    This paper focuses on the influence of ambient light on the perceived quality of videos displayed on Liquid Crystal Display (LCD) with local backlight dimming. A subjective test assessing the quality of videos with two backlight dimming methods and three lighting conditions, i.e. no light, low light level (5 lux) and higher light level (60 lux) was organized to collect subjective data. Results show that participants prefer the method exploiting local dimming possibilities to the conventional full backlight but that this preference varies depending on the ambient light level. The clear preference for one method at the low light conditions decreases at the high ambient light, confirming that the ambient light significantly attenuates the perception of the leakage defect (light leaking through dark pixels). Results are also highly dependent on the content of the sequence, which can modulate the effect of the ambient light from having an important influence on the quality grades to no influence at all.

  1. Secure Utilization of Beacons and UAVs in Emergency Response Systems for Building Fire Hazard.

    Science.gov (United States)

    Seo, Seung-Hyun; Choi, Jung-In; Song, Jinseok

    2017-09-25

    An intelligent emergency system for hazard monitoring and building evacuation is a very important application area in Internet of Things (IoT) technology. Through the use of smart sensors, such a system can provide more vital and reliable information to first-responders and also reduce the incidents of false alarms. Several smart monitoring and warning systems do already exist, though they exhibit key weaknesses such as a limited monitoring coverage and security, which have not yet been sufficiently addressed. In this paper, we propose a monitoring and emergency response method for buildings by utilizing beacons and Unmanned Aerial Vehicles (UAVs) on an IoT security platform. In order to demonstrate the practicability of our method, we also implement a proof of concept prototype, which we call the UAV-EMOR (UAV-assisted Emergency Monitoring and Response) system. Our UAV-EMOR system provides the following novel features: (1) secure communications between UAVs, smart sensors, the control server and a smartphone app for security managers; (2) enhanced coordination between smart sensors and indoor/outdoor UAVs to expand real-time monitoring coverage; and (3) beacon-aided rescue and building evacuation.

  2. Roving UAV IED Interdiction System

    Science.gov (United States)

    2011-03-01

    UAVs (Raven, Wasp, and Puma) do not advertise any payload capability, the Tier I operators that Team Bravo contacted claimed small payload...www.ncca.navy.mil/services/inflation.cfm (accessed February 2011). Net Resources International. "Javelin Anti- Armour Missile." Army-Technology.com. 2011. http

  3. Cycloidal Propulsion for UAV VTOL Applications

    National Research Council Canada - National Science Library

    Boschma, James

    1998-01-01

    .... This propulsion concept holds significant promise for adaptation to UAV VTOL operations. Thrust levels demonstrated were substantially higher than achievable by the best screw type propellers, and approximately equal to those of high end helicopters...

  4. ANALISA OPTIMALISASI TEKNIK ESTIMASI DAN KOMPENSASI GERAK PADA ENKODER VIDEO H.263

    Directory of Open Access Journals (Sweden)

    Oka Widyantara

    2009-05-01

    Full Text Available Mode baseline encoder video H.263 menerapkan teknik estimasi dan kompensasi gerak dengan satu vector gerak untuk setiap macroblock. Prosedur area pencarian menggunakan pencarian penuh dengan akurasi setengah pixel pada bidang [16,15.5] membuat prediksi di tepian frame tidak dapat diprediksi dengan baik. Peningkatan unjuk kerja pengkodean prediksi interframe encoder video H.263 dengan optimalisasi teknik estimasi dan kompensasi gerak diimplementasikan dengan penambahan area pencarian [31.5,31.5] (unrestricted motion vector, Annex D dan 4 motion vector (advanced prediction mode, Annex F. Hasil penelitian menunjukkan bahwa advanced mode mampu meningkatkan nilai SNR sebesar 0.03 dB untuk sequence video claire, 0.2 dB untuk sequence video foreman, 0.041 dB untuk sequence video Glasgow, dan juga mampu menurunkan bit rate pengkodean sebesar 2.3 % untuk video Claire, 15.63 % untuk video Foreman,  dan 9.8% untuk video Glasgow dibandingkan dengan implementasi 1 motion vector pada pengkodean baseline mode.

  5. Visual hashing of digital video : applications and techniques

    NARCIS (Netherlands)

    Oostveen, J.; Kalker, A.A.C.M.; Haitsma, J.A.; Tescher, A.G.

    2001-01-01

    his paper present the concept of robust video hashing as a tool for video identification. We present considerations and a technique for (i) extracting essential perceptual features from a moving image sequences and (ii) for identifying any sufficiently long unknown video segment by efficiently

  6. The Practical Application of Uav-Based Photogrammetry Under Economic Aspects

    Science.gov (United States)

    Sauerbier, M.; Siegrist, E.; Eisenbeiss, H.; Demir, N.

    2011-09-01

    Nowadays, small size UAVs (Unmanned Aerial Vehicles) have reached a level of practical reliability and functionality that enables this technology to enter the geomatics market as an additional platform for spatial data acquisition. Though one could imagine a wide variety of interesting sensors to be mounted on such a device, here we will focus on photogrammetric applications using digital cameras. In praxis, UAV-based photogrammetry will only be accepted if it a) provides the required accuracy and an additional value and b) if it is competitive in terms of economic application compared to other measurement technologies. While a) was already proven by the scientific community and results were published comprehensively during the last decade, b) still has to be verified under real conditions. For this purpose, a test data set representing a realistic scenario provided by ETH Zurich was used to investigate cost effectiveness and to identify weak points in the processing chain that require further development. Our investigations are limited to UAVs carrying digital consumer cameras, for larger UAVs equipped with medium format cameras the situation has to be considered as significantly different. Image data was acquired during flights using a microdrones MD4-1000 quadrocopter equipped with an Olympus PE-1 digital compact camera. From these images, a subset of 5 images was selected for processing in order to register the effort of time required for the whole production chain of photogrammetric products. We see the potential of mini UAV-based photogrammetry mainly in smaller areas, up to a size of ca. 100 hectares. Larger areas can be efficiently covered by small airplanes with few images, reducing processing effort drastically. In case of smaller areas of a few hectares only, it depends more on the products required. UAVs can be an enhancement or alternative to GNSS measurements, terrestrial laser scanning and ground based photogrammetry. We selected the above mentioned

  7. UAV telemetry communications using ZigBee protocol

    Science.gov (United States)

    Nasution, T. H.; Siregar, I.; Yasir, M.

    2017-10-01

    Wireless communication has been widely used in various fields or disciplines such as agriculture, health, engineering, military, and aerospace so as to support the work in that field. The communication technology is typically used for controlling devices and data monitoring. One development of wireless communication is the widely used telemetry system used to reach areas that cannot be reached by humans using UAV (Unmanned Aerial Vehicle) or unmanned aircraft. In this paper we discuss the design of telemetry system in UAV using ZigBee protocol. From the test obtained the system can work well with visualization displays without pause is 20 data per second with a maximum data length of 120 characters.

  8. A proposed UAV for indoor patient care.

    Science.gov (United States)

    Todd, Catherine; Watfa, Mohamed; El Mouden, Yassine; Sahir, Sana; Ali, Afrah; Niavarani, Ali; Lutfi, Aoun; Copiaco, Abigail; Agarwal, Vaibhavi; Afsari, Kiyan; Johnathon, Chris; Okafor, Onyeka; Ayad, Marina

    2015-09-10

    Indoor flight, obstacle avoidance and client-server communication of an Unmanned Aerial Vehicle (UAV) raises several unique research challenges. This paper examines current methods and associated technologies adapted within the literature toward autonomous UAV flight, for consideration in a proposed system for indoor healthcare administration with a quadcopter. We introduce Healthbuddy, a unique research initiative towards overcoming challenges associated with indoor navigation, collision detection and avoidance, stability, wireless drone-server communications and automated decision support for patient care in a GPS-denied environment. To address the identified research deficits, a drone-based solution is presented. The solution is preliminary as we develop and refine the suggested algorithms and hardware system to achieve the research objectives.

  9. A Multi-Disciplinary Approach to Remote Sensing through Low-Cost UAVs.

    Science.gov (United States)

    Calvario, Gabriela; Sierra, Basilio; Alarcón, Teresa E; Hernandez, Carmen; Dalmau, Oscar

    2017-06-16

    The use of Unmanned Aerial Vehicles (UAVs) based on remote sensing has generated low cost monitoring, since the data can be acquired quickly and easily. This paper reports the experience related to agave crop analysis with a low cost UAV. The data were processed by traditional photogrammetric flow and data extraction techniques were applied to extract new layers and separate the agave plants from weeds and other elements of the environment. Our proposal combines elements of photogrammetry, computer vision, data mining, geomatics and computer science. This fusion leads to very interesting results in agave control. This paper aims to demonstrate the potential of UAV monitoring in agave crops and the importance of information processing with reliable data flow.

  10. A Biologically Based Chemo-Sensing UAV for Humanitarian Demining

    Directory of Open Access Journals (Sweden)

    Paul F.M.J. Verschure

    2008-11-01

    Full Text Available Antipersonnel mines, weapons of cheap manufacture but lethal effect, have a high impact on the population even decades after the conflicts have finished. Here we investigate the use of a chemo-sensing Unmanned Aerial Vehicle (cUAV for demining tasks. We developed a blimp based UAV that is equipped with a broadly tuned metal-thin oxide chemo-sensor. A number of chemical mapping strategies were investigated including two biologically based localization strategies derived from the moth chemical search that can optimize the efficiency of the detection and localization of explosives and therefore be used in the demining process. Additionally, we developed a control layer that allows for both fully autonomous and manual controlled flight, as well as for the scheduling of a fleet of cUAVs. Our results confirm the feasibility of this technology for demining in real-world scenarios and give further support to a biologically based approach where the understanding of biological systems is used to solve difficult engineering problems.

  11. A Biologically Based Chemo-Sensing UAV for Humanitarian Demining

    Directory of Open Access Journals (Sweden)

    Sergi Bermúdez i Badia

    2007-06-01

    Full Text Available Antipersonnel mines, weapons of cheap manufacture but lethal effect, have a high impact on the population even decades after the conflicts have finished. Here we investigate the use of a chemo-sensing Unmanned Aerial Vehicle (cUAV for demining tasks. We developed a blimp based UAV that is equipped with a broadly tuned metal-thin oxide chemo-sensor. A number of chemical mapping strategies were investigated including two biologically based localization strategies derived from the moth chemical search that can optimize the efficiency of the detection and localization of explosives and therefore be used in the demining process. Additionally, we developed a control layer that allows for both fully autonomous and manual controlled flight, as well as for the scheduling of a fleet of cUAVs. Our results confirm the feasibility of this technology for demining in real-world scenarios and give further support to a biologically based approach where the understanding of biological systems is used to solve difficult engineering problems.

  12. Deriving video content type from HEVC bitstream semantics

    Science.gov (United States)

    Nightingale, James; Wang, Qi; Grecos, Christos; Goma, Sergio R.

    2014-05-01

    As network service providers seek to improve customer satisfaction and retention levels, they are increasingly moving from traditional quality of service (QoS) driven delivery models to customer-centred quality of experience (QoE) delivery models. QoS models only consider metrics derived from the network however, QoE models also consider metrics derived from within the video sequence itself. Various spatial and temporal characteristics of a video sequence have been proposed, both individually and in combination, to derive methods of classifying video content either on a continuous scale or as a set of discrete classes. QoE models can be divided into three broad categories, full reference, reduced reference and no-reference models. Due to the need to have the original video available at the client for comparison, full reference metrics are of limited practical value in adaptive real-time video applications. Reduced reference metrics often require metadata to be transmitted with the bitstream, while no-reference metrics typically operate in the decompressed domain at the client side and require significant processing to extract spatial and temporal features. This paper proposes a heuristic, no-reference approach to video content classification which is specific to HEVC encoded bitstreams. The HEVC encoder already makes use of spatial characteristics to determine partitioning of coding units and temporal characteristics to determine the splitting of prediction units. We derive a function which approximates the spatio-temporal characteristics of the video sequence by using the weighted averages of the depth at which the coding unit quadtree is split and the prediction mode decision made by the encoder to estimate spatial and temporal characteristics respectively. Since the video content type of a sequence is determined by using high level information parsed from the video stream, spatio-temporal characteristics are identified without the need for full decoding and can

  13. Exploring Naval Tactics with UAVs in an Island Complex Using Agent-Based Simulation

    National Research Council Canada - National Science Library

    Lalis, Vasileios

    2007-01-01

    The benefits of Unmanned Aerial Vehicles (UAV) at sea are undisputed. The amount and speed of the incoming information from a UAV, combined with its maneuverability and time-on-task capability, are assets to any navy...

  14. Study on the aerodynamic behavior of a UAV with an applied seeder for agricultural practices

    Science.gov (United States)

    Felismina, Raimundo; Silva, Miguel; Mateus, Artur; Malça, Cândida

    2017-06-01

    It is irrefutable that the use of Unmanned Airborne Vehicle Systems (UAVs) in agricultural tasks and on the analysis of health and vegetative conditions represents a powerful tool in modern agriculture. To contribute to the growth of the agriculture economic sector a seeder to be coupled to any type of UAV was previously developed and designed by the authors. This seeder allows for the deposition of seeds with positional accuracy, i.e., seeds are accurately deposited at pre-established distances between plants [1]. This work aims at analyzing the aerodynamic behavior of UAV/Seeder assembly to determine the suitable inclination - among 0°, 15° and 30° - for its takeoff and for its motion during the seeding operation and, in turn, to define the suitable flight plan that increases the batteries autonomy. For this the ANSYS® FLUENT computational tool was used to simulate a wind tunnel which has as principle the Navier-Stokes differential equations, that designates the fluid flow around the UAV/Seeder assembly. The aerodynamic results demonstrated that for take-off the UAV inclination of 30° is the aerodynamically most favorable position due to the lower aerodynamic drag during the climb. Concerning flying motion during the seeding procedure the UAV inclination of 0° is that which leads to lower UAV/Seeder frontal area and drag coefficient.

  15. Hybrid compression of video with graphics in DTV communication systems

    OpenAIRE

    Schaar, van der, M.; With, de, P.H.N.

    2000-01-01

    Advanced broadcast manipulation of TV sequences and enhanced user interfaces for TV systems have resulted in an increased amount of pre- and post-editing of video sequences, where graphical information is inserted. However, in the current broadcasting chain, there are no provisions for enabling an efficient transmission/storage of these mixed video and graphics signals and, at this emerging stage of DTV systems, introducing new standards is not desired. Nevertheless, in the professional video...

  16. Estimation and Extrapolation of Tree Parameters Using Spectral Correlation between UAV and Pléiades Data

    Directory of Open Access Journals (Sweden)

    Azadeh Abdollahnejad

    2018-02-01

    Full Text Available The latest technological advances in space-borne imagery have significantly enhanced the acquisition of high-quality data. With the availability of very high-resolution satellites, such as Pléiades, it is now possible to estimate tree parameters at the individual level with high fidelity. Despite innovative advantages on high-precision satellites, data acquisition is not yet available to the public at a reasonable cost. Unmanned aerial vehicles (UAVs have the practical advantage of data acquisition at a higher spatial resolution than that of satellites. This study is divided into two main parts: (1 we describe the estimation of basic tree attributes, such as tree height, crown diameter, diameter at breast height (DBH, and stem volume derived from UAV data based on structure from motion (SfM algorithms; and (2 we consider the extrapolation of the UAV data to a larger area, using correlation between satellite and UAV observations as an economically viable approach. Results have shown that UAVs can be used to predict tree characteristics with high accuracy (i.e., crown projection, stem volume, cross-sectional area (CSA, and height. We observed a significant relation between extracted data from UAV and ground data with R2 = 0.71 for stem volume, R2 = 0.87 for height, and R2 = 0.60 for CSA. In addition, our results showed a high linear relation between spectral data from the UAV and the satellite (R2 = 0.94. Overall, the accuracy of the results between UAV and Pléiades was reasonable and showed that the used methods are feasible for extrapolation of extracted data from UAV to larger areas.

  17. Feasibility of Using Synthetic Aperture Radar to Aid UAV Navigation.

    Science.gov (United States)

    Nitti, Davide O; Bovenga, Fabio; Chiaradia, Maria T; Greco, Mario; Pinelli, Gianpaolo

    2015-07-28

    This study explores the potential of Synthetic Aperture Radar (SAR) to aid Unmanned Aerial Vehicle (UAV) navigation when Inertial Navigation System (INS) measurements are not accurate enough to eliminate drifts from a planned trajectory. This problem can affect medium-altitude long-endurance (MALE) UAV class, which permits heavy and wide payloads (as required by SAR) and flights for thousands of kilometres accumulating large drifts. The basic idea is to infer position and attitude of an aerial platform by inspecting both amplitude and phase of SAR images acquired onboard. For the amplitude-based approach, the system navigation corrections are obtained by matching the actual coordinates of ground landmarks with those automatically extracted from the SAR image. When the use of SAR amplitude is unfeasible, the phase content can be exploited through SAR interferometry by using a reference Digital Terrain Model (DTM). A feasibility analysis was carried out to derive system requirements by exploring both radiometric and geometric parameters of the acquisition setting. We showed that MALE UAV, specific commercial navigation sensors and SAR systems, typical landmark position accuracy and classes, and available DTMs lead to estimated UAV coordinates with errors bounded within ±12 m, thus making feasible the proposed SAR-based backup system.

  18. Feasibility of Using Synthetic Aperture Radar to Aid UAV Navigation

    Directory of Open Access Journals (Sweden)

    Davide O. Nitti

    2015-07-01

    Full Text Available This study explores the potential of Synthetic Aperture Radar (SAR to aid Unmanned Aerial Vehicle (UAV navigation when Inertial Navigation System (INS measurements are not accurate enough to eliminate drifts from a planned trajectory. This problem can affect medium-altitude long-endurance (MALE UAV class, which permits heavy and wide payloads (as required by SAR and flights for thousands of kilometres accumulating large drifts. The basic idea is to infer position and attitude of an aerial platform by inspecting both amplitude and phase of SAR images acquired onboard. For the amplitude-based approach, the system navigation corrections are obtained by matching the actual coordinates of ground landmarks with those automatically extracted from the SAR image. When the use of SAR amplitude is unfeasible, the phase content can be exploited through SAR interferometry by using a reference Digital Terrain Model (DTM. A feasibility analysis was carried out to derive system requirements by exploring both radiometric and geometric parameters of the acquisition setting. We showed that MALE UAV, specific commercial navigation sensors and SAR systems, typical landmark position accuracy and classes, and available DTMs lead to estimated UAV coordinates with errors bounded within ±12 m, thus making feasible the proposed SAR-based backup system.

  19. The Quality of Quantity: Mini-UAVS As An Alternative UAV Acquisition Strategy at the Army Brigade Level

    National Research Council Canada - National Science Library

    Weed, Shawn

    2002-01-01

    This monograph asks should the U.S. Army alter its current UAV acquisition strategy for maneuver brigades from one in which limited numbers of high capability systems are acquired, in favor of another that fields a large quantity...

  20. A Robust Photogrammetric Processing Method of Low-Altitude UAV Images

    Directory of Open Access Journals (Sweden)

    Mingyao Ai

    2015-02-01

    Full Text Available Low-altitude Unmanned Aerial Vehicles (UAV images which include distortion, illumination variance, and large rotation angles are facing multiple challenges of image orientation and image processing. In this paper, a robust and convenient photogrammetric approach is proposed for processing low-altitude UAV images, involving a strip management method to automatically build a standardized regional aerial triangle (AT network, a parallel inner orientation algorithm, a ground control points (GCPs predicting method, and an improved Scale Invariant Feature Transform (SIFT method to produce large number of evenly distributed reliable tie points for bundle adjustment (BA. A multi-view matching approach is improved to produce Digital Surface Models (DSM and Digital Orthophoto Maps (DOM for 3D visualization. Experimental results show that the proposed approach is robust and feasible for photogrammetric processing of low-altitude UAV images and 3D visualization of products.

  1. Performance Analysis of Video Transmission Using Sequential Distortion Minimization Method for Digital Video Broadcasting Terrestrial

    Directory of Open Access Journals (Sweden)

    Novita Astin

    2016-12-01

    Full Text Available This paper presents about the transmission of Digital Video Broadcasting system with streaming video resolution 640x480 on different IQ rate and modulation. In the video transmission, distortion often occurs, so the received video has bad quality. Key frames selection algorithm is flexibel on a change of video, but on these methods, the temporal information of a video sequence is omitted. To minimize distortion between the original video and received video, we aimed at adding methodology using sequential distortion minimization algorithm. Its aim was to create a new video, better than original video without significant loss of content between the original video and received video, fixed sequentially. The reliability of video transmission was observed based on a constellation diagram, with the best result on IQ rate 2 Mhz and modulation 8 QAM. The best video transmission was also investigated using SEDIM (Sequential Distortion Minimization Method and without SEDIM. The experimental result showed that the PSNR (Peak Signal to Noise Ratio average of video transmission using SEDIM was an increase from 19,855 dB to 48,386 dB and SSIM (Structural Similarity average increase 10,49%. The experimental results and comparison of proposed method obtained a good performance. USRP board was used as RF front-end on 2,2 GHz.

  2. Distributed Flight Controls for UAVs, Phase I

    Data.gov (United States)

    National Aeronautics and Space Administration — Two novel flight control actuation concepts for UAV applications are proposed for research and development, both of which incorporate shape memory alloy (SMA) wires...

  3. Impact of Prior Flight Experience on Learning Predator UAV Operator Skills

    Science.gov (United States)

    2002-02-01

    UAVs are becoming a mainstay of intelligence , surveillance, and reconnaissance (ISR) information gathering, with the capability of supplying, in...indicators of UAV pilot skill, namely frequency and type of videogame playing, and experience with remote-controlled hobby aircraft. Experience with...indicator, artificial horizon, heading rate indicator, and engine revolutions per minute. The right monitor displays other useful information, such as a

  4. STRUCTURE FROM MOTION (SfM) PROCESSING FOR UNMANNED AERIAL VEHICLE (UAV)

    KAUST Repository

    Smith, Neil G.; Shalaby, Mohamed; Passone, Luca

    2016-01-01

    A method of imaging an area using an unmanned aerial vehicle (UAV) collects a plurality of images from a sensor mounted to the UAV. The plurality of images are processed to detect regions that require additional imaging and an updated flight plan and sensor gimbal position plan is created to capture portions of the area identified as requiring additional imaging.

  5. STRUCTURE FROM MOTION (SfM) PROCESSING FOR UNMANNED AERIAL VEHICLE (UAV)

    KAUST Repository

    Smith, Neil G.

    2016-04-07

    A method of imaging an area using an unmanned aerial vehicle (UAV) collects a plurality of images from a sensor mounted to the UAV. The plurality of images are processed to detect regions that require additional imaging and an updated flight plan and sensor gimbal position plan is created to capture portions of the area identified as requiring additional imaging.

  6. An analysis of the development and application of plant protection UAV based on advanced materials

    Science.gov (United States)

    Huang, Yuan-hui; Wei, Neng; Quan, Zhi-cheng; Huang, Yu-rong

    2018-06-01

    The development and application of a number of advanced materials plant protection unmanned aerial vehicle (UAV) is an important part of the comprehensive production of agricultural modernization. The paper is taken as an example of Guangxi No. 1 agricultural service aviation science and Technology Co., Ltd. This paper introduces the internal and external environment of the research and development of the plant protection UAV for the advanced materials of the company. The external environment focuses on the role of the plant protection UAV on the development of the agricultural mechanization; the internal environment focuses on the advantages of the UAV in technology research, market promotion and application, which is imperative. Finally, according to the background of the whole industry, we put forward some suggestions for the developing opportunities and challenges faced by plant protection UAV, hoping to proving some ideas for operators, experts and scholars engaged in agricultural industry.

  7. Using Unmanned Aerial Vehicles (UAVs) to Modeling Tornado Impacts

    Science.gov (United States)

    Wagner, M.; Doe, R. K.

    2017-12-01

    Using Unmanned Aerial Vehicles (UAVs) to assess storm damage is a useful research tool. Benefits include their ability to access remote or impassable areas post-storm, identify unknown damages and assist with more detailed site investigations and rescue efforts. Technological advancement of UAVs mean that they can capture high resolution images often at an affordable price. These images can be used to create 3D environments to better interpret and delineate damages from large areas that would have been difficult in ground surveys. This research presents the results of a rapid response site investigation of the 29 April 2017 Canton, Texas, USA, tornado using low cost UAVs. This was a multiple, high impact tornado event measuring EF4 at maximum. Rural farmland was chosen as a challenging location to test both equipment and methodology. Such locations provide multiple impacts at a variety of scales including structural and vegetation damage and even animal fatalities. The 3D impact models allow for a more comprehensive study prior to clean-up. The results show previously unseen damages and better quantify damage impacts at the local level. 3D digital track swaths were created allowing for a more accurate track width determination. These results demonstrate how effective the use of low cost UAVs can be for rapid response storm damage assessments, the high quality of data they can achieve, and how they can help us better visualize tornado site investigations.

  8. Use of UAV-Borne Spectrometer for Land Cover Classification

    Directory of Open Access Journals (Sweden)

    Sowmya Natesan

    2018-04-01

    Full Text Available Unmanned aerial vehicles (UAV are being used for low altitude remote sensing for thematic land classification using visible light and multi-spectral sensors. The objective of this work was to investigate the use of UAV equipped with a compact spectrometer for land cover classification. The UAV platform used was a DJI Flamewheel F550 hexacopter equipped with GPS and Inertial Measurement Unit (IMU navigation sensors, and a Raspberry Pi processor and camera module. The spectrometer used was the FLAME-NIR, a near-infrared spectrometer for hyperspectral measurements. RGB images and spectrometer data were captured simultaneously. As spectrometer data do not provide continuous terrain coverage, the locations of their ground elliptical footprints were determined from the bundle adjustment solution of the captured images. For each of the spectrometer ground ellipses, the land cover signature at the footprint location was determined to enable the characterization, identification, and classification of land cover elements. To attain a continuous land cover classification map, spatial interpolation was carried out from the irregularly distributed labeled spectrometer points. The accuracy of the classification was assessed using spatial intersection with the object-based image classification performed using the RGB images. Results show that in homogeneous land cover, like water, the accuracy of classification is 78% and in mixed classes, like grass, trees and manmade features, the average accuracy is 50%, thus, indicating the contribution of hyperspectral measurements of low altitude UAV-borne spectrometers to improve land cover classification.

  9. Monitoring landslide dynamics using timeseries of UAV imagery

    Science.gov (United States)

    de Jong, S. M.; Van Beek, L. P.

    2017-12-01

    Landslides are worldwide occurring processes that can have large economic impact and sometimes result in fatalities. Multiple factors are important in landslide processes and can make an area prone to landslide activity. Human factors like drainage and removal of vegetation or land clearing are examples of factors that may cause a landslide. Other environmental factors such as topography and the shear strength of the slope material are more difficult to control. Triggering factors for landslides are typically heavy rainfall events or sometimes by earthquakes or under cutting processes by a river. The collection of data about existing landslides in a given area is important for predicting future landslides in that region. We have setup a monitoring program for landslide using cameras aboard Unmanned Airborne Vehicles. UAV with cameras are able to collect ultra-high resolution images and UAVs can be operated in a very flexible way, they just fit in the back of a car. Here, in this study we used Unmanned Aerial Vehicles to collect a time series of high-resolution images over landslides in France and Australia. The algorithm used to process the UAV images into OrthoMosaics and OrthoDEMs is Structure from Motion (SfM). The process generally results in centimeter precision in the horizontal and vertical direction. Such multi-temporal datasets enable the detection of landslide area, the leading edge slope, temporal patterns and volumetric changes of particular areas of the landslide. We measured and computed surface movement of the landslide using the COSI-Corr image correlation algorithm with ground validation. Our study shows the possibilities of generating accurate Digital Surface Models (DSMs) of landslides using images collected with an Unmanned Aerial Vehicle (UAV). The technique is robust and repeatable such that a substantial time series of datasets can be routinely collected. It is shown that a time-series of UAV images can be used to map landslide movements with

  10. Brief communication: Landslide motion from cross correlation of UAV-derived morphological attributes

    Science.gov (United States)

    Peppa, Maria V.; Mills, Jon P.; Moore, Phil; Miller, Pauline E.; Chambers, Jonathan E.

    2017-12-01

    Unmanned aerial vehicles (UAVs) can provide observations of high spatio-temporal resolution to enable operational landslide monitoring. In this research, the construction of digital elevation models (DEMs) and orthomosaics from UAV imagery is achieved using structure-from-motion (SfM) photogrammetric procedures. The study examines the additional value that the morphological attribute of openness, amongst others, can provide to surface deformation analysis. Image-cross-correlation functions and DEM subtraction techniques are applied to the SfM outputs. Through the proposed integrated analysis, the automated quantification of a landslide's motion over time is demonstrated, with implications for the wider interpretation of landslide kinematics via UAV surveys.

  11. Multimodal Feature Learning for Video Captioning

    Directory of Open Access Journals (Sweden)

    Sujin Lee

    2018-01-01

    Full Text Available Video captioning refers to the task of generating a natural language sentence that explains the content of the input video clips. This study proposes a deep neural network model for effective video captioning. Apart from visual features, the proposed model learns additionally semantic features that describe the video content effectively. In our model, visual features of the input video are extracted using convolutional neural networks such as C3D and ResNet, while semantic features are obtained using recurrent neural networks such as LSTM. In addition, our model includes an attention-based caption generation network to generate the correct natural language captions based on the multimodal video feature sequences. Various experiments, conducted with the two large benchmark datasets, Microsoft Video Description (MSVD and Microsoft Research Video-to-Text (MSR-VTT, demonstrate the performance of the proposed model.

  12. Storage, access, and retrieval of endoscopic and laparoscopic video

    Science.gov (United States)

    Bellaire, Gunter; Steines, Daniel; Graschew, Georgi; Thiel, Andreas; Bernarding, Johannes; Tolxdorff, Thomas; Schlag, Peter M.

    1999-05-01

    The system presented here enhances documentation and data- secured, second-opinion facilities by integrating video into DICOM3.0. Digital stereoscopic video sequences (DSVS) are especially in demand for surgery (laparoscopy, microsurgery, surgical microscopy, second opinion, virtual reality). Therefore DSVS are also integrated into the DICOM video concept. We present an implementation for a medical video server extended by a DICOM interface. Security mechanisms conforming with DICOM are integrated to enable secure internet access. Digital (stereoscopic) video sequences relevant for surgery should be examined regarding the clip length necessary for diagnosis and documentation and the clip size manageable with today's hardware. Methods for DSVS compression are described, implemented, and tested. Image sources relevant for this paper include, among others, a stereoscopic laparoscope and a monoscopic endoscope. Additionally, an approach is presented to analyze the motion of the endoscopic camera for future automatic video- cutting.

  13. Authenticity and privacy of a team of mini-UAVs by means of nonlinear recursive shuffling

    Science.gov (United States)

    Szu, Harold; Hsu, Ming-Kai; Baier, Patrick; Lee, Ting N.; Buss, James R.; Madan, Rabinder N.

    2006-04-01

    We have developed a real-time EOIR video counter-jittering sub-pixel image correction algorithm for a single mini- Unmanned Air Vehicle (m-UAV) for surveillance and communication (Szu et al. SPIE Proc. V 5439 5439, pp.183-197, April 12, 2004). In this paper, we wish to plan and execute the next challenge---- a team of m-UAVs. The minimum unit for a robust chain saw communication must have the connectivity of five second-nearest-neighbor members with a sliding, arbitrary center. The team members require an authenticity check (AC) among a unit of five, in order to carry out a jittering mosaic image processing (JMIP) on-board for every m-UAV without gimbals. The JMIP does not use any NSA security protocol ("cardinal rule: no-man, no-NSA codec"). Besides team flight dynamics (Szu et al "Nanotech applied to aerospace and aeronautics: swarming,' AIAA 2005-6933 Sept 26-29 2005), several new modules: AOA, AAM, DSK, AC, FPGA are designed, and the JMIP must develop their own control, command and communication system, safeguarded by the authenticity and privacy checks presented in this paper. We propose a Nonlinear Invertible (deck of card) Shuffler (NIS) algorithm, which has a Feistel structure similar to the Data Encryption Standard (DES) developed by Feistel et. al. at IBM in the 1970's; but DES is modified here by a set of chaotic dynamical shuffler Key (DSK), as re-computable lookup tables generated by every on-board Chaotic Neural Network (CNN). The initializations of CNN are periodically provided by the private version of RSA from the ground control to team members to avoid any inadvertent failure of broken chain among m-UAVs. Efficient utilization of communication bandwidth is necessary for a constantly moving and jittering m-UAV platform, e.g. the wireless LAN protocol wastes the bandwidth due to a constant need of hand-shaking procedures (as demonstrated by NRL; though sensible for PCs and 3 rd gen. mobile phones). Thus, the chaotic DSK must be embedded in a fault

  14. Battery Health Management System for Electric UAVs

    Data.gov (United States)

    National Aeronautics and Space Administration — In summary, this paper lays out a novel battery health management technique for application onboard an electric UAV. This technique is also applicable to other...

  15. A Q-Learning Approach to Flocking With UAVs in a Stochastic Environment.

    Science.gov (United States)

    Hung, Shao-Ming; Givigi, Sidney N

    2017-01-01

    In the past two decades, unmanned aerial vehicles (UAVs) have demonstrated their efficacy in supporting both military and civilian applications, where tasks can be dull, dirty, dangerous, or simply too costly with conventional methods. Many of the applications contain tasks that can be executed in parallel, hence the natural progression is to deploy multiple UAVs working together as a force multiplier. However, to do so requires autonomous coordination among the UAVs, similar to swarming behaviors seen in animals and insects. This paper looks at flocking with small fixed-wing UAVs in the context of a model-free reinforcement learning problem. In particular, Peng's Q(λ) with a variable learning rate is employed by the followers to learn a control policy that facilitates flocking in a leader-follower topology. The problem is structured as a Markov decision process, where the agents are modeled as small fixed-wing UAVs that experience stochasticity due to disturbances such as winds and control noises, as well as weight and balance issues. Learned policies are compared to ones solved using stochastic optimal control (i.e., dynamic programming) by evaluating the average cost incurred during flight according to a cost function. Simulation results demonstrate the feasibility of the proposed learning approach at enabling agents to learn how to flock in a leader-follower topology, while operating in a nonstationary stochastic environment.

  16. On-board processing of video image sequences

    DEFF Research Database (Denmark)

    Andersen, Jakob Dahl; Chanrion, Olivier Arnaud; Forchhammer, Søren

    2008-01-01

    and evaluated. On-board there are six video cameras each capturing images of 1024times1024 pixels of 12 bpp at a frame rate of 15 fps, thus totalling 1080 Mbits/s. In comparison the average downlink data rate for these images is projected to be 50 kbit/s. This calls for efficient on-board processing to select...

  17. On decentralized adaptive full-order sliding mode control of multiple UAVs.

    Science.gov (United States)

    Xiang, Xianbo; Liu, Chao; Su, Housheng; Zhang, Qin

    2017-11-01

    In this study, a novel decentralized adaptive full-order sliding mode control framework is proposed for the robust synchronized formation motion of multiple unmanned aerial vehicles (UAVs) subject to system uncertainty. First, a full-order sliding mode surface in a decentralized manner is designed to incorporate both the individual position tracking error and the synchronized formation error while the UAV group is engaged in building a certain desired geometric pattern in three dimensional space. Second, a decentralized virtual plant controller is constructed which allows the embedded low-pass filter to attain the chattering free property of the sliding mode controller. In addition, robust adaptive technique is integrated in the decentralized chattering free sliding control design in order to handle unknown bounded uncertainties, without requirements for assuming a priori knowledge of bounds on the system uncertainties as stated in conventional chattering free control methods. Subsequently, system robustness as well as stability of the decentralized full-order sliding mode control of multiple UAVs is synthesized. Numerical simulation results illustrate the effectiveness of the proposed control framework to achieve robust 3D formation flight of the multi-UAV system. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

  18. Correction of projective distortion in long-image-sequence mosaics without prior information

    Science.gov (United States)

    Yang, Chenhui; Mao, Hongwei; Abousleman, Glen; Si, Jennie

    2010-04-01

    Image mosaicking is the process of piecing together multiple video frames or still images from a moving camera to form a wide-area or panoramic view of the scene being imaged. Mosaics have widespread applications in many areas such as security surveillance, remote sensing, geographical exploration, agricultural field surveillance, virtual reality, digital video, and medical image analysis, among others. When mosaicking a large number of still images or video frames, the quality of the resulting mosaic is compromised by projective distortion. That is, during the mosaicking process, the image frames that are transformed and pasted to the mosaic become significantly scaled down and appear out of proportion with respect to the mosaic. As more frames continue to be transformed, important target information in the frames can be lost since the transformed frames become too small, which eventually leads to the inability to continue further. Some projective distortion correction techniques make use of prior information such as GPS information embedded within the image, or camera internal and external parameters. Alternatively, this paper proposes a new algorithm to reduce the projective distortion without using any prior information whatsoever. Based on the analysis of the projective distortion, we approximate the projective matrix that describes the transformation between image frames using an affine model. Using singular value decomposition, we can deduce the affine model scaling factor that is usually very close to 1. By resetting the image scale of the affine model to 1, the transformed image size remains unchanged. Even though the proposed correction introduces some error in the image matching, this error is typically acceptable and more importantly, the final mosaic preserves the original image size after transformation. We demonstrate the effectiveness of this new correction algorithm on two real-world unmanned air vehicle (UAV) sequences. The proposed method is

  19. UAV based hydromorphological mapping of a river reach to improve hydrodynamic numerical models

    Science.gov (United States)

    Lükő, Gabriella; Baranya, Sándor; Rüther, Nils

    2017-04-01

    Unmanned Aerial Vehicles (UAVs) are increasingly used in the field of engineering surveys. In river engineering, or in general, water resources engineering, UAV based measurements have a huge potential. For instance, indirect measurements of the flow discharge using e.g. large-scale particle image velocimetry (LSPIV), particle tracking velocimetry (PTV), space-time image velocimetry (STIV) or radars became a real alternative for direct flow measurements. Besides flow detection, topographic surveys are also essential for river flow studies as the channel and floodplain geometry is the primary steering feature of the flow. UAVs can play an important role in this field, too. The widely used laser based topographic survey method (LIDAR) can be deployed on UAVs, moreover, the application of the Structure from Motion (SfM) method, which is based on images taken by UAVs, might be an even more cost-efficient alternative to reveal the geometry of distinct objects in the river or on the floodplain. The goal of this study is to demonstrate the utilization of photogrammetry and videogrammetry from airborne footage to provide geometry and flow data for a hydrodynamic numerical simulation of a 2 km long river reach in Albania. First, the geometry of the river is revealed from photogrammetry using the SfM method. Second, a more detailed view of the channel bed at low water level is taken. Using the fine resolution images, a Matlab based code, BASEGrain, developed by the ETH in Zürich, will be applied to determine the grain size characteristics of the river bed. This information will be essential to define the hydraulic roughness in the numerical model. Third, flow mapping is performed using UAV measurements and LSPIV method to quantitatively asses the flow field at the free surface and to estimate the discharge in the river. All data collection and analysis will be carried out using a simple, low-cost UAV, moreover, for all the data processing, open source, freely available

  20. Distributed UAV-Swarm Real-Time Geomatic Data Collection Under Dynamically Changing Resolution Requirements

    Science.gov (United States)

    Almeida, Miguel; Hildmann, Hanno; Solmaz, Gürkan

    2017-08-01

    Unmanned Aerial Vehicles (UAVs) have been used for reconnaissance and surveillance missions as far back as the Vietnam War, but with the recent rapid increase in autonomy, precision and performance capabilities - and due to the massive reduction in cost and size - UAVs have become pervasive products, available and affordable for the general public. The use cases for UAVs are in the areas of disaster recovery, environmental mapping & protection and increasingly also as extended eyes and ears of civil security forces such as fire-fighters and emergency response units. In this paper we present a swarm algorithm that enables a fleet of autonomous UAVs to collectively perform sensing tasks related to environmental and rescue operations and to dynamically adapt to e.g. changing resolution requirements. We discuss the hardware used to build our own drones and the settings under which we validate the proposed approach.

  1. D Modeling with Photogrammetry by Uavs and Model Quality Verification

    Science.gov (United States)

    Barrile, V.; Bilotta, G.; Nunnari, A.

    2017-11-01

    This paper deals with a test lead by Geomatics laboratory (DICEAM, Mediterranea University of Reggio Calabria), concerning the application of UAV photogrammetry for survey, monitoring and checking. The study case relies with the surroundings of the Department of Agriculture Sciences. In the last years, such area was interested by landslides and survey activities carried out to take the phenomenon under control. For this purpose, a set of digital images were acquired through a UAV equipped with a digital camera and GPS. Successively, the processing for the production of a 3D georeferenced model was performed by using the commercial software Agisoft PhotoScan. Similarly, the use of a terrestrial laser scanning technique allowed to product dense cloud and 3D models of the same area. To assess the accuracy of the UAV-derived 3D models, a comparison between image and range-based methods was performed.

  2. UAV Based Agricultural Planning and Landslide Monitoring

    Directory of Open Access Journals (Sweden)

    Servet Yaprak

    2017-12-01

    Full Text Available The use of Unmanned Aerial Vehicle (UAV tools has become widespread in map production, land surveying, landslide, erosion monitoring, monitoring of agricultural activities, aerial crop surveying, forest fire detection and monitoring operations. In this study, GEO 2 UAV manufactured by TEKNOMER equipped with SONY A6000 camera has been used. The flight plan have been performed with 100 m altitude, with 80% longitudinal and 60% side overlapping. Ground Control Points (GCPs have been observed with Topcon and Trimble GNSS geodetic receivers. Recorded GNSS signals have been processed with LGO V.8.4 software to get sensitive location information. 985 photos have been taken for the 344 hectares the agricultural area. 291 photos have been taken for 50 hectares the landslide area. All photos were processed by PIX4D software. For the agricultural area, 25 GCPs and for the landslide area, 8 GCPs have been included in the evaluation. 3D images were produced with pixel matching algorithms. As a result, the RMS evaluation was obtained as ±0.054 m for the agricultural area and as ±0.018 m for the landslide area. UAV images have indisputable contributions to the management of catastrophes such as landslides and earthquakes, and it is impossible to make terrestrial measurements in areas where disaster impact continues.

  3. The emerging High Efficiency Video Coding standard (HEVC)

    International Nuclear Information System (INIS)

    Raja, Gulistan; Khan, Awais

    2013-01-01

    High definition video (HDV) is becoming popular day by day. This paper describes the performance analysis of latest upcoming video standard known as High Efficiency Video Coding (HEVC). HEVC is designed to fulfil all the requirements for future high definition videos. In this paper, three configurations (intra only, low delay and random access) of HEVC are analyzed using various 480p, 720p and 1080p high definition test video sequences. Simulation results show the superior objective and subjective quality of HEVC

  4. Semantic web technologies for video surveillance metadata

    OpenAIRE

    Poppe, Chris; Martens, Gaëtan; De Potter, Pieterjan; Van de Walle, Rik

    2012-01-01

    Video surveillance systems are growing in size and complexity. Such systems typically consist of integrated modules of different vendors to cope with the increasing demands on network and storage capacity, intelligent video analytics, picture quality, and enhanced visual interfaces. Within a surveillance system, relevant information (like technical details on the video sequences, or analysis results of the monitored environment) is described using metadata standards. However, different module...

  5. Unmanned aerial vehicles (UAVs) for surveying marine fauna: a dugong case study.

    Science.gov (United States)

    Hodgson, Amanda; Kelly, Natalie; Peel, David

    2013-01-01

    Aerial surveys of marine mammals are routinely conducted to assess and monitor species' habitat use and population status. In Australia, dugongs (Dugong dugon) are regularly surveyed and long-term datasets have formed the basis for defining habitat of high conservation value and risk assessments of human impacts. Unmanned aerial vehicles (UAVs) may facilitate more accurate, human-risk free, and cheaper aerial surveys. We undertook the first Australian UAV survey trial in Shark Bay, western Australia. We conducted seven flights of the ScanEagle UAV, mounted with a digital SLR camera payload. During each flight, ten transects covering a 1.3 km(2) area frequently used by dugongs, were flown at 500, 750 and 1000 ft. Image (photograph) capture was controlled via the Ground Control Station and the capture rate was scheduled to achieve a prescribed 10% overlap between images along transect lines. Images were manually reviewed post hoc for animals and scored according to sun glitter, Beaufort Sea state and turbidity. We captured 6243 images, 627 containing dugongs. We also identified whales, dolphins, turtles and a range of other fauna. Of all possible dugong sightings, 95% (CI = 90%, 98%) were subjectively classed as 'certain' (unmistakably dugongs). Neither our dugong sighting rate, nor our ability to identify dugongs with certainty, were affected by UAV altitude. Turbidity was the only environmental variable significantly affecting the dugong sighting rate. Our results suggest that UAV systems may not be limited by sea state conditions in the same manner as sightings from manned surveys. The overlap between images proved valuable for detecting animals that were masked by sun glitter in the corners of images, and identifying animals initially captured at awkward body angles. This initial trial of a basic camera system has successfully demonstrated that the ScanEagle UAV has great potential as a tool for marine mammal aerial surveys.

  6. Unmanned aerial vehicles (UAVs for surveying marine fauna: a dugong case study.

    Directory of Open Access Journals (Sweden)

    Amanda Hodgson

    Full Text Available Aerial surveys of marine mammals are routinely conducted to assess and monitor species' habitat use and population status. In Australia, dugongs (Dugong dugon are regularly surveyed and long-term datasets have formed the basis for defining habitat of high conservation value and risk assessments of human impacts. Unmanned aerial vehicles (UAVs may facilitate more accurate, human-risk free, and cheaper aerial surveys. We undertook the first Australian UAV survey trial in Shark Bay, western Australia. We conducted seven flights of the ScanEagle UAV, mounted with a digital SLR camera payload. During each flight, ten transects covering a 1.3 km(2 area frequently used by dugongs, were flown at 500, 750 and 1000 ft. Image (photograph capture was controlled via the Ground Control Station and the capture rate was scheduled to achieve a prescribed 10% overlap between images along transect lines. Images were manually reviewed post hoc for animals and scored according to sun glitter, Beaufort Sea state and turbidity. We captured 6243 images, 627 containing dugongs. We also identified whales, dolphins, turtles and a range of other fauna. Of all possible dugong sightings, 95% (CI = 90%, 98% were subjectively classed as 'certain' (unmistakably dugongs. Neither our dugong sighting rate, nor our ability to identify dugongs with certainty, were affected by UAV altitude. Turbidity was the only environmental variable significantly affecting the dugong sighting rate. Our results suggest that UAV systems may not be limited by sea state conditions in the same manner as sightings from manned surveys. The overlap between images proved valuable for detecting animals that were masked by sun glitter in the corners of images, and identifying animals initially captured at awkward body angles. This initial trial of a basic camera system has successfully demonstrated that the ScanEagle UAV has great potential as a tool for marine mammal aerial surveys.

  7. A Novel Online Data-Driven Algorithm for Detecting UAV Navigation Sensor Faults.

    Science.gov (United States)

    Sun, Rui; Cheng, Qi; Wang, Guanyu; Ochieng, Washington Yotto

    2017-09-29

    The use of Unmanned Aerial Vehicles (UAVs) has increased significantly in recent years. On-board integrated navigation sensors are a key component of UAVs' flight control systems and are essential for flight safety. In order to ensure flight safety, timely and effective navigation sensor fault detection capability is required. In this paper, a novel data-driven Adaptive Neuron Fuzzy Inference System (ANFIS)-based approach is presented for the detection of on-board navigation sensor faults in UAVs. Contrary to the classic UAV sensor fault detection algorithms, based on predefined or modelled faults, the proposed algorithm combines an online data training mechanism with the ANFIS-based decision system. The main advantages of this algorithm are that it allows real-time model-free residual analysis from Kalman Filter (KF) estimates and the ANFIS to build a reliable fault detection system. In addition, it allows fast and accurate detection of faults, which makes it suitable for real-time applications. Experimental results have demonstrated the effectiveness of the proposed fault detection method in terms of accuracy and misdetection rate.

  8. Solar Cell to Support Perpetual Flight of High Altitude Long Endurance UAV ITB

    Science.gov (United States)

    Luqmanul Hakim, Muhammad; Silitonga, Faber Y.; Rosid, Nurhayyan H.; Mochammad Agoes Moelyadi, Ing., Dr.

    2018-04-01

    Research on a High Altitude Long Endurance (HALE) Unmanned Aerial Vehicle (UAV) is currently being conducted at Bandung Institute of Technology to reach the flight duration needed and to get the solution of today’s challenges, minimizing pollution. Besides the good aerodynamic efficiency needed, energy resource is now becoming important. The energy resource must have a good endurance, easy to get, and of course, less pollution. Discussion in this paper is about the analysis of power needed by HALE UAV while takeoff and cruise flight conditions, and then determine the amount of solar cell and battery needed by the UAV.

  9. Positional quality assessment of orthophotos obtained from sensors onboard multi-rotor UAV platforms.

    Science.gov (United States)

    Mesas-Carrascosa, Francisco Javier; Rumbao, Inmaculada Clavero; Berrocal, Juan Alberto Barrera; Porras, Alfonso García-Ferrer

    2014-11-26

    In this study we explored the positional quality of orthophotos obtained by an unmanned aerial vehicle (UAV). A multi-rotor UAV was used to obtain images using a vertically mounted digital camera. The flight was processed taking into account the photogrammetry workflow: perform the aerial triangulation, generate a digital surface model, orthorectify individual images and finally obtain a mosaic image or final orthophoto. The UAV orthophotos were assessed with various spatial quality tests used by national mapping agencies (NMAs). Results showed that the orthophotos satisfactorily passed the spatial quality tests and are therefore a useful tool for NMAs in their production flowchart.

  10. POTENTIAL OF UAV-BASED LASER SCANNER AND MULTISPECTRAL CAMERA DATA IN BUILDING INSPECTION

    Directory of Open Access Journals (Sweden)

    D. Mader

    2016-06-01

    Full Text Available Conventional building inspection of bridges, dams or large constructions in general is rather time consuming and often cost expensive due to traffic closures and the need of special heavy vehicles such as under-bridge inspection units or other large lifting platforms. In consideration that, an unmanned aerial vehicle (UAV will be more reliable and efficient as well as less expensive and simpler to operate. The utilisation of UAVs as an assisting tool in building inspections is obviously. Furthermore, light-weight special sensors such as infrared and thermal cameras as well as laser scanner are available and predestined for usage on unmanned aircraft systems. Such a flexible low-cost system is realized in the ADFEX project with the goal of time-efficient object exploration, monitoring and damage detection. For this purpose, a fleet of UAVs, equipped with several sensors for navigation, obstacle avoidance and 3D object-data acquisition, has been developed and constructed. This contribution deals with the potential of UAV-based data in building inspection. Therefore, an overview of the ADFEX project, sensor specifications and requirements of building inspections in general are given. On the basis of results achieved in practical studies, the applicability and potential of the UAV system in building inspection will be presented and discussed.

  11. Learning with Technology: Video Modeling with Concrete-Representational-Abstract Sequencing for Students with Autism Spectrum Disorder.

    Science.gov (United States)

    Yakubova, Gulnoza; Hughes, Elizabeth M; Shinaberry, Megan

    2016-07-01

    The purpose of this study was to determine the effectiveness of a video modeling intervention with concrete-representational-abstract instructional sequence in teaching mathematics concepts to students with autism spectrum disorder (ASD). A multiple baseline across skills design of single-case experimental methodology was used to determine the effectiveness of the intervention on the acquisition and maintenance of addition, subtraction, and number comparison skills for four elementary school students with ASD. Findings supported the effectiveness of the intervention in improving skill acquisition and maintenance at a 3-week follow-up. Implications for practice and future research are discussed.

  12. Perceived Quality of Full HD Video - Subjective Quality Assessment

    Directory of Open Access Journals (Sweden)

    Juraj Bienik

    2016-01-01

    Full Text Available In recent years, an interest in multimedia services has become a global trend and this trend is still rising. The video quality is a very significant part from the bundle of multimedia services, which leads to a requirement for quality assessment in the video domain. Video quality of a streamed video across IP networks is generally influenced by two factors “transmission link imperfection and efficiency of compression standards. This paper deals with subjective video quality assessment and the impact of the compression standards H.264, H.265 and VP9 on perceived video quality of these compression standards. The evaluation is done for four full HD sequences, the difference of scenes is in the content“ distinction is based on Spatial (SI and Temporal (TI Index of test sequences. Finally, experimental results follow up to 30% bitrate reducing of H.265 and VP9 compared with the reference H.264.

  13. Real-time Multiple Abnormality Detection in Video Data

    DEFF Research Database (Denmark)

    Have, Simon Hartmann; Ren, Huamin; Moeslund, Thomas B.

    2013-01-01

    Automatic abnormality detection in video sequences has recently gained an increasing attention within the research community. Although progress has been seen, there are still some limitations in current research. While most systems are designed at detecting specific abnormality, others which...... are capable of detecting more than two types of abnormalities rely on heavy computation. Therefore, we provide a framework for detecting abnormalities in video surveillance by using multiple features and cascade classifiers, yet achieve above real-time processing speed. Experimental results on two datasets...... show that the proposed framework can reliably detect abnormalities in the video sequence, outperforming the current state-of-the-art methods....

  14. Subjective Quality Assessment of H.264/AVC Video Streaming with Packet Losses

    Directory of Open Access Journals (Sweden)

    Naccari Matteo

    2011-01-01

    Full Text Available Research in the field of video quality assessment relies on the availability of subjective scores, collected by means of experiments in which groups of people are asked to rate the quality of video sequences. The availability of subjective scores is fundamental to enable validation and comparative benchmarking of the objective algorithms that try to predict human perception of video quality by automatically analyzing the video sequences, in a way to support reproducible and reliable research results. In this paper, a publicly available database of subjective quality scores and corrupted video sequences is described. The scores refer to 156 sequences at CIF and 4CIF spatial resolutions, encoded with H.264/AVC and corrupted by simulating the transmission over an error-prone network. The subjective evaluation has been performed by 40 subjects at the premises of two academic institutions, in standard-compliant controlled environments. In order to support reproducible research in the field of full-reference, reduced-reference, and no-reference video quality assessment algorithms, both the uncompressed files and the H.264/AVC bitstreams, as well as the packet loss patterns, have been made available to the research community.

  15. PROCESSING OF UAV BASED RANGE IMAGING DATA TO GENERATE DETAILED ELEVATION MODELS OF COMPLEX NATURAL STRUCTURES

    Directory of Open Access Journals (Sweden)

    T. K. Kohoutek

    2012-07-01

    Full Text Available Unmanned Aerial Vehicles (UAVs are more and more used in civil areas like geomatics. Autonomous navigated platforms have a great flexibility in flying and manoeuvring in complex environments to collect remote sensing data. In contrast to standard technologies such as aerial manned platforms (airplanes and helicopters UAVs are able to fly closer to the object and in small-scale areas of high-risk situations such as landslides, volcano and earthquake areas and floodplains. Thus, UAVs are sometimes the only practical alternative in areas where access is difficult and where no manned aircraft is available or even no flight permission is given. Furthermore, compared to terrestrial platforms, UAVs are not limited to specific view directions and could overcome occlusions from trees, houses and terrain structures. Equipped with image sensors and/or laser scanners they are able to provide elevation models, rectified images, textured 3D-models and maps. In this paper we will describe a UAV platform, which can carry a range imaging (RIM camera including power supply and data storage for the detailed mapping and monitoring of complex structures, such as alpine riverbed areas. The UAV platform NEO from Swiss UAV was equipped with the RIM camera CamCube 2.0 by PMD Technologies GmbH to capture the surface structures. Its navigation system includes an autopilot. To validate the UAV-trajectory a 360° prism was installed and tracked by a total station. Within the paper a workflow for the processing of UAV-RIM data is proposed, which is based on the processing of differential GNSS data in combination with the acquired range images. Subsequently, the obtained results for the trajectory are compared and verified with a track of a UAV (Falcon 8, Ascending Technologies carried out with a total station simultaneously to the GNSS data acquisition. The results showed that the UAV's position using differential GNSS could be determined in the centimetre to the decimetre

  16. UAVs: Holy Grail for Intel, Panacea for RSTA, or Much Ado about Nothing? UAVs for the Operational Commander

    National Research Council Canada - National Science Library

    Fox, Roy

    1998-01-01

    ..., operational, and tactical objectives. UAVs have supported military operations including the Vietnam War, the 1983 Israeli War, the Gulf War and most recently the United Nations Peace Keeping Operation in Bosnia, to name a few. Although U.S...

  17. The optimal design of UAV wing structure

    Science.gov (United States)

    Długosz, Adam; Klimek, Wiktor

    2018-01-01

    The paper presents an optimal design of UAV wing, made of composite materials. The aim of the optimization is to improve strength and stiffness together with reduction of the weight of the structure. Three different types of functionals, which depend on stress, stiffness and the total mass are defined. The paper presents an application of the in-house implementation of the evolutionary multi-objective algorithm in optimization of the UAV wing structure. Values of the functionals are calculated on the basis of results obtained from numerical simulations. Numerical FEM model, consisting of different composite materials is created. Adequacy of the numerical model is verified by results obtained from the experiment, performed on a tensile testing machine. Examples of multi-objective optimization by means of Pareto-optimal set of solutions are presented.

  18. An innovative experimental sequence on electromagnetic induction and eddy currents based on video analysis and cheap data acquisition

    International Nuclear Information System (INIS)

    Bonanno, A; Sapia, P; Bozzo, G

    2017-01-01

    In this work, we present a coherent sequence of experiments on electromagnetic (EM) induction and eddy currents, appropriate for university undergraduate students, based on a magnet falling through a drilled aluminum disk. The sequence, leveraging on the didactical interplay between the EM and mechanical aspects of the experiments, allows us to exploit the students’ awareness of mechanics to elicit their comprehension of EM phenomena. The proposed experiments feature two kinds of measurements: (i) kinematic measurements (performed by means of high-speed video analysis) give information on the system’s kinematics and, via appropriate numerical data processing, allow us to get dynamic information, in particular on energy dissipation; (ii) induced electromagnetic field (EMF) measurements (by using a homemade multi-coil sensor connected to a cheap data acquisition system) allow us to quantitatively determine the inductive effects of the moving magnet on its neighborhood. The comparison between experimental results and the predictions from an appropriate theoretical model (of the dissipative coupling between the moving magnet and the conducting disk) offers many educational hints on relevant topics related to EM induction, such as Maxwell’s displacement current, magnetic field flux variation, and the conceptual link between induced EMF and induced currents. Moreover, the didactical activity gives students the opportunity to be trained in video analysis, data acquisition and numerical data processing. (paper)

  19. Micro-Doppler extraction of a small UAV in a non-line-of-sight urban scenario

    Science.gov (United States)

    Gustavsson, Magnus; Andersson, Åsa; Johansson, Tommy; Jonsson, Rolf; Karlsson, Nils; Nilsson, Stefan

    2017-05-01

    The appearance of small UAVs on the commercial market poses a real threat to both civilian safety and to military operations. In open terrain a radar can detect and track even small UAVs at long distances. In an urban environment with limited line-of-sight and strong static and non-static background, this capability can be severely reduced. The radar cross section of these UAVs are normally small compared to the background. However, the rotors of the UAVs produce a characteristic micro-Doppler signature that can be exploited for detection and classification. In this paper, we investigate in an experimental set-up whether it is possible in the radar non-line-of-sight to retrieve the micro-Doppler signature of the UAV rotors. This is done by exploring up to three multipath bounces in the measured signal. The measurements were made with a semi-monostatic single receiver-transmitter radar system operating at X-band in a pulsed single frequency mode. The radar response of the UAV, with plastic and metallic rotors, was measured at several positions inside a 4 m wide corridor with metallic walls. In this paper, data from one line-of-sight and two non-line-ofsight positions are presented. Results show that we are able to detect the micro-Doppler of the rotors and to retrieve the number of revolutions per minute, for both rotor types. Free space Finite-Difference Time-Domain calculations have also been performed on a CAD-model of the UAV rotor to determine the optimal choice of polarization and the short-time Fourier transform filter length.

  20. Implementation Of Vision-Based Landing Target Detection For VTOL UAV Using Raspberry Pi

    Directory of Open Access Journals (Sweden)

    Ei Ei Nyein

    2017-04-01

    Full Text Available This paper presents development and implementation of a real-time vision-based landing system for VTOL UAV. We use vision for precise target detection and recognition. A UAV is equipped with the onboard raspberry pi camera to take images and raspberry pi platform to operate the image processing techniques. Today image processing is used for various applications in this paper it is used for landing target extraction. And vision system is also used for take-off and landing function in VTOL UAV. Our landing target design is used as the helipad H shape. Firstly the image is captured to detect the target by the onboard camera. Next the capture image is operated in the onboard processor. Finally the alert sound signal is sent to the remote control RC for landing VTOL UAV. The information obtained from vision system is used to navigate a safe landing. The experimental results from real tests are presented.

  1. Shigaraki UAV-Radar Experiment (ShUREX): overview of the campaign with some preliminary results

    Science.gov (United States)

    Kantha, Lakshmi; Lawrence, Dale; Luce, Hubert; Hashiguchi, Hiroyuki; Tsuda, Toshitaka; Wilson, Richard; Mixa, Tyler; Yabuki, Masanori

    2017-12-01

    The Shigaraki unmanned aerial vehicle (UAV)-Radar Experiment (ShUREX) is an international (USA-Japan-France) observational campaign, whose overarching goal is to demonstrate the utility of small, lightweight, inexpensive, autonomous UAVs in probing and monitoring the lower troposphere and to promote synergistic use of UAVs and very high frequency (VHF) radars. The 2-week campaign lasting from June 1 to June 14, 2015, was carried out at the Middle and Upper Atmosphere (MU) Observatory in Shigaraki, Japan. During the campaign, the DataHawk UAV, developed at the University of Colorado, Boulder, and equipped with high-frequency response cold wire and pitot tube sensors (as well as an iMET radiosonde), was flown near and over the VHF-band MU radar. Measurements in the atmospheric column in the immediate vicinity of the radar were obtained. Simultaneous and continuous operation of the radar in range imaging mode enabled fine-scale structures in the atmosphere to be visualized by the radar. It also permitted the UAV to be commanded to sample interesting structures, guided in near real time by the radar images. This overview provides a description of the ShUREX campaign and some interesting but preliminary results of the very first simultaneous and intensive probing of turbulent structures by UAVs and the MU radar. The campaign demonstrated the validity and utility of the radar range imaging technique in obtaining very high vertical resolution ( 20 m) images of echo power in the atmospheric column, which display evolving fine-scale atmospheric structures in unprecedented detail. The campaign also permitted for the very first time the evaluation of the consistency of turbulent kinetic energy dissipation rates in turbulent structures inferred from the spectral broadening of the backscattered radar signal and direct, in situ measurements by the high-frequency response velocity sensor on the UAV. The data also enabled other turbulence parameters such as the temperature

  2. Application of Low-Cost Fixed-Wing UAV for Inland Lakes Shoreline Investigation

    Science.gov (United States)

    Templin, Tomasz; Popielarczyk, Dariusz; Kosecki, Rafał

    2017-10-01

    One of the most important factors that influences the performance of geomorphologic parameters on urban lakes is the water level. It fluctuates periodically, causing shoreline changes. It is especially significant for typical environmental studies like bathymetric surveys, morphometric parameters calculation, sediment depth changes, thermal structure, water quality monitoring, etc. In most reservoirs, it can be obtained from digitized historical maps or plans or directly measured using the instruments such as: geodetic total station, GNSS receivers, UAV with different sensors, satellite and aerial photos, terrestrial and airborne light detection and ranging, or others. Today one of the most popular measuring platforms, increasingly applied in many applications is UAV. Unmanned aerial system can be a cheap, easy to use, on-demand technology for gathering remote sensing data. Our study presents a reliable methodology for shallow lake shoreline investigation with the use of a low-cost fixed-wing UAV system. The research was implemented on a small, eutrophic urban inland reservoir located in the northern part of Poland—Lake Suskie. The geodetic TS, and RTK/GNSS measurements, hydroacoustic soundings and experimental aerial mapping were conducted by the authors in 2012-2015. The article specifically describes the UAV system used for experimental measurements, the obtained results and the accuracy analysis. Final conclusions demonstrate that even a low-cost fixed-wing UAV can provide an excellent tool for accurately surveying a shallow lake shoreline and generate valuable geoinformation data collected definitely faster than when traditional geodetic methods are employed.

  3. Robust drone detection for day/night counter-UAV with static VIS and SWIR cameras

    Science.gov (United States)

    Müller, Thomas

    2017-05-01

    Recent progress in the development of unmanned aerial vehicles (UAVs) has led to more and more situations in which drones like quadrocopters or octocopters pose a potential serious thread or could be used as a powerful tool for illegal activities. Therefore, counter-UAV systems are required in a lot of applications to detect approaching drones as early as possible. In this paper, an efficient and robust algorithm is presented for UAV detection using static VIS and SWIR cameras. Whereas VIS cameras with a high resolution enable to detect UAVs in the daytime in further distances, surveillance at night can be performed with a SWIR camera. First, a background estimation and structural adaptive change detection process detects movements and other changes in the observed scene. Afterwards, the local density of changes is computed used for background density learning and to build up the foreground model which are compared in order to finally get the UAV alarm result. The density model is used to filter out noise effects, on the one hand. On the other hand, moving scene parts like moving leaves in the wind or driving cars on a street can easily be learned in order to mask such areas out and suppress false alarms there. This scene learning is done automatically simply by processing without UAVs in order to capture the normal situation. The given results document the performance of the presented approach in VIS and SWIR in different situations.

  4. Modeling and Flocking Consensus Analysis for Large-Scale UAV Swarms

    Directory of Open Access Journals (Sweden)

    Li Bing

    2013-01-01

    Full Text Available Recently, distributed coordination control of the unmanned aerial vehicle (UAV swarms has been a particularly active topic in intelligent system field. In this paper, through understanding the emergent mechanism of the complex system, further research on the flocking and the dynamic characteristic of UAV swarms will be given. Firstly, this paper analyzes the current researches and existent problems of UAV swarms. Afterwards, by the theory of stochastic process and supplemented variables, a differential-integral model is established, converting the system model into Volterra integral equation. The existence and uniqueness of the solution of the system are discussed. Then the flocking control law is given based on artificial potential with system consensus. At last, we analyze the stability of the proposed flocking control algorithm based on the Lyapunov approach and prove that the system in a limited time can converge to the consensus direction of the velocity. Simulation results are provided to verify the conclusion.

  5. Reconstruction of 3d video from 2d real-life sequences

    Directory of Open Access Journals (Sweden)

    Eduardo Ramos Diaz

    2010-01-01

    Full Text Available En este artículo, se propone un método novedoso que permite generar secuencias de video en 3D usando secuencias de video reales en 2D. La reconstrucción de la secuencia de video en 3D se realiza usando el cálculo del mapa de profundidad y la síntesis de anaglifos. El mapa de profundidad es formado usando la técnica de correspondencia estéreo basada en la minimización de la energía de error global a partir de funciones de suavizado. La construcción del anaglifo es realizada usando la alineación del componente de color interpolándolo con el mapa de profundidad previamente formado. Adicionalmente, se emplea la transformación del mapa de profundidad para reducir el rango dinámico de los valores de disparidad, minimizando el efecto fantasma mejorando la preservación de color. Se usaron numerosas secuencias de video a color reales que contienen diferentes tipos de movimientos como traslacional, rotacional, acercamiento, y la combinación de los anteriores, demostrando buen funcionamiento visual de la reconstrucción de secuencias de video en 3D propuesta.

  6. Comparison of Uncalibrated Rgbvi with Spectrometer-Based Ndvi Derived from Uav Sensing Systems on Field Scale

    Science.gov (United States)

    Bareth, G.; Bolten, A.; Gnyp, M. L.; Reusch, S.; Jasper, J.

    2016-06-01

    The development of UAV-based sensing systems for agronomic applications serves the improvement of crop management. The latter is in the focus of precision agriculture which intends to optimize yield, fertilizer input, and crop protection. Besides, in some cropping systems vehicle-based sensing devices are less suitable because fields cannot be entered from certain growing stages onwards. This is true for rice, maize, sorghum, and many more crops. Consequently, UAV-based sensing approaches fill a niche of very high resolution data acquisition on the field scale in space and time. While mounting RGB digital compact cameras to low-weight UAVs (modified version of the Yara N-Sensor. The latter is a well-established tractor-based hyperspectral sensor for crop management and is available on the market since a decade. It was modified for this study to fit the requirements of UAV-based data acquisition. Consequently, we focus on three objectives in this contribution: (1) to evaluate the potential of the uncalibrated RGBVI for monitoring nitrogen status in winter wheat, (2) investigate the UAV-based performance of the modified Yara N-Sensor, and (3) compare the results of the two different UAV-based sensing approaches for winter wheat.

  7. Accuracy and Optimal Altitude for Physical Habitat Assessment (PHA of Stream Environments Using Unmanned Aerial Vehicles (UAV

    Directory of Open Access Journals (Sweden)

    Ângela Maria Klein Hentz

    2018-05-01

    Full Text Available Physical Habitat Assessments (PHA are useful to characterize and monitor stream and river habitat conditions, but can be costly and time-consuming. Alternative methods for data collection are getting attention, such as Unmanned Aerial Vehicles (UAV. The objective of this work was to evaluate the accuracy of UAV-based remote sensing techniques relative to ground-based PHA measurements, and to determine the influence of flight altitude on those accuracies. A UAV quadcopter equipped with an RGB camera was flown at the altitudes of 30.5 m, 61.0 m, 91.5 m and 122.0 m, and the metrics wetted width (Ww, bankfull width (Wbf and distance to water (Dw were compared to field PHA. The UAV-PHA method generated similar values to observed PHA values, but underestimated distance to water, and overestimated wetted width. Bankfull width provided the largest RMSE (25–28%. No systematic error patterns were observed considering the different flight altitudes, and results indicated that all flight altitudes investigated can be reliably used for PHA measurements. However, UAV flight at 61 m provided the most accurate results (CI = 0.05 considering all metrics. All UAV parameters over all altitudes showed significant correlation with observed PHA data, validating the use of UAV-based remote sensing for PHA.

  8. Fast and efficient search for MPEG-4 video using adjacent pixel intensity difference quantization histogram feature

    Science.gov (United States)

    Lee, Feifei; Kotani, Koji; Chen, Qiu; Ohmi, Tadahiro

    2010-02-01

    In this paper, a fast search algorithm for MPEG-4 video clips from video database is proposed. An adjacent pixel intensity difference quantization (APIDQ) histogram is utilized as the feature vector of VOP (video object plane), which had been reliably applied to human face recognition previously. Instead of fully decompressed video sequence, partially decoded data, namely DC sequence of the video object are extracted from the video sequence. Combined with active search, a temporal pruning algorithm, fast and robust video search can be realized. The proposed search algorithm has been evaluated by total 15 hours of video contained of TV programs such as drama, talk, news, etc. to search for given 200 MPEG-4 video clips which each length is 15 seconds. Experimental results show the proposed algorithm can detect the similar video clip in merely 80ms, and Equal Error Rate (ERR) of 2 % in drama and news categories are achieved, which are more accurately and robust than conventional fast video search algorithm.

  9. Rapid mapping of landslide disaster using UAV- photogrammetry

    Science.gov (United States)

    Cahyono, A. B.; Zayd, R. A.

    2018-03-01

    Unmanned Aerial Vehicle (UAV) systems offered many advantages in several mapping applications such as slope mapping, geohazard studies, etc. This study utilizes UAV system for landslide disaster occurred in Jombang Regency, East Java. This study concentrates on type of rotor-wing UAV, that is because rotor wing units are stable and able to capture images easily. Aerial photograph were acquired in the form of strips which followed the procedure of acquiring aerial photograph where taken 60 photos. Secondary data of ground control points using GPS Geodetic and check points established using Total Station technique was used. The digital camera was calibrated using close range photogrammetric software and the recovered camera calibration parameters were then used in the processing of digital images. All the aerial photographs were processed using digital photogrammetric software and the output in the form of orthophoto was produced. The final result shows a 1: 1500 scale orthophoto map from the data processing with SfM algorithm with GSD accuracy of 3.45 cm. And the calculated volume of contour line delineation of 10527.03 m3. The result is significantly different from the result of terrestrial methode equal to 964.67 m3 or 8.4% of the difference of both.

  10. Dual-Layer Video Encryption using RSA Algorithm

    Science.gov (United States)

    Chadha, Aman; Mallik, Sushmit; Chadha, Ankit; Johar, Ravdeep; Mani Roja, M.

    2015-04-01

    This paper proposes a video encryption algorithm using RSA and Pseudo Noise (PN) sequence, aimed at applications requiring sensitive video information transfers. The system is primarily designed to work with files encoded using the Audio Video Interleaved (AVI) codec, although it can be easily ported for use with Moving Picture Experts Group (MPEG) encoded files. The audio and video components of the source separately undergo two layers of encryption to ensure a reasonable level of security. Encryption of the video component involves applying the RSA algorithm followed by the PN-based encryption. Similarly, the audio component is first encrypted using PN and further subjected to encryption using the Discrete Cosine Transform. Combining these techniques, an efficient system, invulnerable to security breaches and attacks with favorable values of parameters such as encryption/decryption speed, encryption/decryption ratio and visual degradation; has been put forth. For applications requiring encryption of sensitive data wherein stringent security requirements are of prime concern, the system is found to yield negligible similarities in visual perception between the original and the encrypted video sequence. For applications wherein visual similarity is not of major concern, we limit the encryption task to a single level of encryption which is accomplished by using RSA, thereby quickening the encryption process. Although some similarity between the original and encrypted video is observed in this case, it is not enough to comprehend the happenings in the video.

  11. Distortion correction algorithm for UAV remote sensing image based on CUDA

    International Nuclear Information System (INIS)

    Wenhao, Zhang; Yingcheng, Li; Delong, Li; Changsheng, Teng; Jin, Liu

    2014-01-01

    In China, natural disasters are characterized by wide distribution, severe destruction and high impact range, and they cause significant property damage and casualties every year. Following a disaster, timely and accurate acquisition of geospatial information can provide an important basis for disaster assessment, emergency relief, and reconstruction. In recent years, Unmanned Aerial Vehicle (UAV) remote sensing systems have played an important role in major natural disasters, with UAVs becoming an important technique of obtaining disaster information. UAV is equipped with a non-metric digital camera with lens distortion, resulting in larger geometric deformation for acquired images, and affecting the accuracy of subsequent processing. The slow speed of the traditional CPU-based distortion correction algorithm cannot meet the requirements of disaster emergencies. Therefore, we propose a Compute Unified Device Architecture (CUDA)-based image distortion correction algorithm for UAV remote sensing, which takes advantage of the powerful parallel processing capability of the GPU, greatly improving the efficiency of distortion correction. Our experiments show that, compared with traditional CPU algorithms and regardless of image loading and saving times, the maximum acceleration ratio using our proposed algorithm reaches 58 times that using the traditional algorithm. Thus, data processing time can be reduced by one to two hours, thereby considerably improving disaster emergency response capability

  12. Computer-Aided Video Differential Planimetry

    Science.gov (United States)

    Tobin, Michael; Djoleto, Ben D.

    1984-08-01

    THE VIDEO DIFFERENTIAL PLANIMETER (VDP)1 is a re-mote sensing instrument that can measure minute changes in the area of any object seen by an optical scanning system. The composite video waveforms obtained by scanning the object against a contrasting back-ground are amplified and shaped to yield a sequence of constant amplitude pulses whose polarity distinguishes the studied area from its background and whose varying widths reflect the dynamics of the viewed object. These pulses are passed through a relatively long time-constant capacitor-resistor circuit and are then fed into an integrator. The net integration voltage resulting from the most recent sequence of object-background time pulses is recorded and the integrator is returned to zero at the end of each video frame. If the object's area remains constant throughout the following frame, the integrator's summation will also remain constant. However, if the object's area varies, the positive and negative time pulses entering the integrator will change, and the integrator's summation will vary proportionately. The addition of a computer interface and a video recorder enhances the versatility and the resolving power of the VDP by permitting the repeated study and analysis of selected portions of the recorded data, thereby uncovering the major sources of the object's dynamics. Among the medical and biological procedures for which COMPUTER-AIDED VIDEO DIFFERENTIAL PLANIMETRY is suitable are Ophthalmoscopy, Endoscopy, Microscopy, Plethysmography, etc. A recent research study in Ophthalmoscopy2 will be cited to suggest a useful application of Video Differential Planimetry.

  13. Geometry correction Algorithm for UAV Remote Sensing Image Based on Improved Neural Network

    Science.gov (United States)

    Liu, Ruian; Liu, Nan; Zeng, Beibei; Chen, Tingting; Yin, Ninghao

    2018-03-01

    Aiming at the disadvantage of current geometry correction algorithm for UAV remote sensing image, a new algorithm is proposed. Adaptive genetic algorithm (AGA) and RBF neural network are introduced into this algorithm. And combined with the geometry correction principle for UAV remote sensing image, the algorithm and solving steps of AGA-RBF are presented in order to realize geometry correction for UAV remote sensing. The correction accuracy and operational efficiency is improved through optimizing the structure and connection weight of RBF neural network separately with AGA and LMS algorithm. Finally, experiments show that AGA-RBF algorithm has the advantages of high correction accuracy, high running rate and strong generalization ability.

  14. USING A MICRO-UAV FOR ULTRA-HIGH RESOLUTION MULTI-SENSOR OBSERVATIONS OF ANTARCTIC MOSS BEDS

    Directory of Open Access Journals (Sweden)

    A. Lucieer

    2012-07-01

    Full Text Available This study is the first to use an Unmanned Aerial Vehicle (UAV for mapping moss beds in Antarctica. Mosses can be used as indicators for the regional effects of climate change. Mapping and monitoring their extent and health is therefore important. UAV aerial photography provides ultra-high resolution spatial data for this purpose. We developed a technique to extract an extremely dense 3D point cloud from overlapping UAV aerial photography based on structure from motion (SfM algorithms. The combination of SfM and patch-based multi-view stereo image vision algorithms resulted in a 2 cm resolution digital terrain model (DTM. This detailed topographic information combined with vegetation indices derived from a 6-band multispectral sensor enabled the assessment of moss bed health. This novel UAV system has allowed us to map different environmental characteristics of the moss beds at ultra-high resolution providing us with a better understanding of these fragile Antarctic ecosystems. The paper provides details on the different UAV instruments and the image processing framework resulting in DEMs, vegetation indices, and terrain derivatives.

  15. The Way Ahead For Maritime UAVS

    Science.gov (United States)

    2006-10-23

    of possible contract winners including Scan Eagle, Silver Fox, Wasp, Coyote and the USMC Tier I winner Dragon Eye. Technical data for these UAVs are...Neptune’s engine and avionics are placed above the waterline and the airframe is sealed for flotation as well as providing corrosion/water intrusion

  16. Pigeon interaction mode switch-based UAV distributed flocking control under obstacle environments.

    Science.gov (United States)

    Qiu, Huaxin; Duan, Haibin

    2017-11-01

    Unmanned aerial vehicle (UAV) flocking control is a serious and challenging problem due to local interactions and changing environments. In this paper, a pigeon flocking model and a pigeon coordinated obstacle-avoiding model are proposed based on a behavior that pigeon flocks will switch between hierarchical and egalitarian interaction mode at different flight phases. Owning to the similarity between bird flocks and UAV swarms in essence, a distributed flocking control algorithm based on the proposed pigeon flocking and coordinated obstacle-avoiding models is designed to coordinate a heterogeneous UAV swarm to fly though obstacle environments with few informed individuals. The comparative simulation results are elaborated to show the feasibility, validity and superiority of our proposed algorithm. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

  17. A hybrid Radio-vision fault tolerant localization for mini UAV flying in swarm

    DEFF Research Database (Denmark)

    Latroch, Maamar; Abdelhafid, Omari; Koivo, Heikki N.

    2013-01-01

    This paper discuss the localization of one Unmanned Aerial Vehicle (UAV) when a failure of its GPS occurs and will propose a new solution based on the information collected by the swarm to localize it. we propose here an architecture for localization of a UAV with GPS signal failure in three...

  18. RECONNAISSANCE MICRO UAV SYSTEM

    Directory of Open Access Journals (Sweden)

    Petr Gabrlik

    2015-12-01

    Full Text Available This paper describes the design and implementation of the Uranus UAV. This quad-rotor flying robot was created to extend the abilities of the hitherto developed with airborne missions. The first part deals with the mathematical model of the robot. Next, the control system is designed, and the proposed hardware as well as the implemented software solution are presented. For integration into the robotic system, a new communication protocol was created and is described here too.

  19. Optimization of a Turboprop UAV for Maximum Loiter and Specific Power Using Genetic Algorithm

    Science.gov (United States)

    Dinc, Ali

    2016-09-01

    In this study, a genuine code was developed for optimization of selected parameters of a turboprop engine for an unmanned aerial vehicle (UAV) by employing elitist genetic algorithm. First, preliminary sizing of a UAV and its turboprop engine was done, by the code in a given mission profile. Secondly, single and multi-objective optimization were done for selected engine parameters to maximize loiter duration of UAV or specific power of engine or both. In single objective optimization, as first case, UAV loiter time was improved with an increase of 17.5% from baseline in given boundaries or constraints of compressor pressure ratio and burner exit temperature. In second case, specific power was enhanced by 12.3% from baseline. In multi-objective optimization case, where previous two objectives are considered together, loiter time and specific power were increased by 14.2% and 9.7% from baseline respectively, for the same constraints.

  20. Hierarchical heuristic search using a Gaussian mixture model for UAV coverage planning.

    Science.gov (United States)

    Lin, Lanny; Goodrich, Michael A

    2014-12-01

    During unmanned aerial vehicle (UAV) search missions, efficient use of UAV flight time requires flight paths that maximize the probability of finding the desired subject. The probability of detecting the desired subject based on UAV sensor information can vary in different search areas due to environment elements like varying vegetation density or lighting conditions, making it likely that the UAV can only partially detect the subject. This adds another dimension of complexity to the already difficult (NP-Hard) problem of finding an optimal search path. We present a new class of algorithms that account for partial detection in the form of a task difficulty map and produce paths that approximate the payoff of optimal solutions. The algorithms use the mode goodness ratio heuristic that uses a Gaussian mixture model to prioritize search subregions. The algorithms search for effective paths through the parameter space at different levels of resolution. We compare the performance of the new algorithms against two published algorithms (Bourgault's algorithm and LHC-GW-CONV algorithm) in simulated searches with three real search and rescue scenarios, and show that the new algorithms outperform existing algorithms significantly and can yield efficient paths that yield payoffs near the optimal.

  1. Embedded, real-time UAV control for improved, image-based 3D scene reconstruction

    Science.gov (United States)

    Jean Liénard; Andre Vogs; Demetrios Gatziolis; Nikolay Strigul

    2016-01-01

    Unmanned Aerial Vehicles (UAVs) are already broadly employed for 3D modeling of large objects such as trees and monuments via photogrammetry. The usual workflow includes two distinct steps: image acquisition with UAV and computationally demanding postflight image processing. Insufficient feature overlaps across images is a common shortcoming in post-flight image...

  2. UAV Mission Planning: From Robust to Agile

    NARCIS (Netherlands)

    Evers, L.; Barros, A.I.; Monsuur, H.; Wagelmans, A.

    2015-01-01

    Unmanned Aerial Vehicles (UAVs) are important assets for information gathering in Intelligence Surveillance and Reconnaissance (ISR) missions. Depending on the uncertainty in the planning parameters, the complexity of the mission and its constraints and requirements, different planning methods might

  3. Earthbound Unmanned Autonomous Vehicles (UAVS) As Planetary Science Testbeds

    Science.gov (United States)

    Pieri, D. C.; Bland, G.; Diaz, J. A.; Fladeland, M. M.

    2014-12-01

    Recent advances in the technology of unmanned vehicles have greatly expanded the range of contemplated terrestrial operational environments for their use, including aerial, surface, and submarine. The advances have been most pronounced in the areas of autonomy, miniaturization, durability, standardization, and ease of operation, most notably (especially in the popular press) for airborne vehicles. Of course, for a wide range of planetary venues, autonomy at high cost of both money and risk, has always been a requirement. Most recently, missions to Mars have also featured an unprecedented degree of mobility. Combining the traditional planetary surface deployment operational and science imperatives with emerging, very accessible, and relatively economical small UAV platforms on Earth can provide flexible, rugged, self-directed, test-bed platforms for landed instruments and strategies that will ultimately be directed elsewhere, and, in the process, provide valuable earth science data. While the most direct transfer of technology from terrestrial to planetary venues is perhaps for bodies with atmospheres (and oceans), with appropriate technology and strategy accommodations, single and networked UAVs can be designed to operate on even airless bodies, under a variety of gravities. In this presentation, we present and use results and lessons learned from our recent earth-bound UAV volcano deployments, as well as our future plans for such, to conceptualize a range of planetary and small-body missions. We gratefully acknowledge the assistance of students and colleagues at our home institutions, and the government of Costa Rica, without which our UAV deployments would not have been possible. This work was carried out, in part, at the Jet Propulsion Laboratory of the California Institute of Technology under contract to NASA.

  4. Experimental Study of Concealment Data in Video Sequences MPEG-2

    Directory of Open Access Journals (Sweden)

    A. A. Alimov

    2011-03-01

    Full Text Available MPEG-2 uses video compression with loses based on the use of discrete cosine transformation (DCT to small blocks of encoded image. As a result, there is range of factors, each of which corresponds to a frequency index of the encoded block. The human eye, due to natural approximation, does not perceive the difference when the high-frequency DCT coefficients change. The investigated algorithm uses this feature of the human vision to embed required data in video stream invisibly.

  5. Rapid melting dynamics of an alpine glacier with repeated UAV photogrammetry

    Science.gov (United States)

    Rossini, Micol; Di Mauro, Biagio; Garzonio, Roberto; Baccolo, Giovanni; Cavallini, Giuseppe; Mattavelli, Matteo; De Amicis, Mattia; Colombo, Roberto

    2018-03-01

    Glacial retreat is a major problem in the Alps, especially over the past 40 years. Unmanned aerial vehicles (UAVs) can provide an unparalleled opportunity to track the spatiotemporal variations in rapidly changing glacial morphological features related to glacial dynamics. The objective of this study is to evaluate the potential of commercial UAV platforms to detect the evolution of the surface topography and morphology of an alpine glacier over a short time scale through the repeated acquisition of high-resolution photogrammetric data. Two high-resolution UAV surveys were performed on the ablation region of the Morteratsch Glacier (Swiss Alps) in July and September 2016. First, structure-from-motion (SfM) techniques were applied to create orthophotos and digital surface models (DSMs) of the glacial surface from multi-view UAV acquisitions. The geometric accuracy of DSMs and orthophotos was checked using differential global navigation satellite system (dGNSS) ground measurements, and an accuracy of approximately 17 cm was achieved for both models. High-resolution orthophotos and DSMs made it possible to provide a detailed characterization of rapidly changing glacial environments. Comparing the data from the first and the second campaigns, the evolution of the lower part of the glacier in response to summer ablation was evaluated. Two distinct processes were revealed and accurately quantified: an average lowering of the surface, with a mean ice thinning of 4 m, and an average horizontal displacement of 3 m due to flowing ice. These data were validated through a comparison of different algorithms and approaches, which clearly showed the consistency of the results. The melt rate spatial patterns were then compared to the glacial brightness and roughness maps derived from the September UAV acquisition. The results showed that the DSM differences describing the glacial melt rates were inversely related to the glacial brightness. In contrast, a positive but weaker

  6. Human-Interaction Challenges in UAV-Based Autonomous Surveillance

    Science.gov (United States)

    Freed, Michael; Harris, Robert; Shafto, Michael G.

    2004-01-01

    Autonomous UAVs provide a platform for intelligent surveillance in application domains ranging from security and military operations to scientific information gathering and land management. Surveillance tasks are often long duration, requiring that any approach be adaptive to changes in the environment or user needs. We describe a decision- theoretic model of surveillance, appropriate for use on our autonomous helicopter, that provides a basis for optimizing the value of information returned by the UAV. From this approach arise a range of challenges in making this framework practical for use by human operators lacking specialized knowledge of autonomy and mathematics. This paper describes our platform and approach, then describes human-interaction challenges arising from this approach that we have identified and begun to address.

  7. Multimodel Predictive Control Approach for UAV Formation Flight

    Directory of Open Access Journals (Sweden)

    Chang-jian Ru

    2014-01-01

    Full Text Available Formation flight problem is the most important and interesting problem of multiple UAVs (unmanned aerial vehicles cooperative control. In this paper, a novel approach for UAV formation flight based on multimodel predictive control is designed. Firstly, the state equation of relative motion is obtained and then discretized. By the geometrical method, the characteristic points of state are determined. Afterwards, based on the linearization technique, the standard linear discrete model is obtained at each characteristic state point. Then, weighted model set is proposed using the idea of T-S (Takagi-Sugeno fuzzy control and the predictive control is carried out based on the multimodel method. Finally, to verify the performance of the proposed method, two different simulation scenarios are performed.

  8. Design and implementation of atmospheric multi-parameter sensor for UAVs

    Science.gov (United States)

    Yu, F.; Zhao, Y.; Chen, G.; Liu, Y.; Han, Y.

    2017-12-01

    With the rapid development of industry and the increase of cars in developing countries, air pollutants have caused a series of environmental issues such as haze and smog. However, air pollution is a process of surface-to-air mass exchange, and various kinds of atmospheric factors have close association with aerosol concentration, such as temperature, humidity, etc. Vertical distributions of aerosol in the region provide an important clue to reveal the exchange mechanism in the atmosphere between atmospheric boundary layer and troposphere. Among the various kinds of flying platforms, unmanned aerial vehicles (UAVs) shows more advantages in vertical measurement of aerosol owned to its flexibility and low cost. However, only few sensors could be mounted on the UAVs because of the limited size and power requirement. Here, a light-weight, low-power atmospheric multi-parameter sensor (AMPS) is proposed and could be mounted on several kinds of UAV platforms. The AMPS integrates multi-sensors, which are the laser aerosol particle sensor, the temperature probe, the humidity probe and the pressure probe, in order to simultaneously sample the vertical distribution characters of aerosol particle concentration, temperature, relative humidity and atmospheric pressure. The data from the sensors are synchronized by a proposed communication mechanism based on GPS. Several kinds of housing are designed to accommodate the different payload requirements of UAVs in size and weight. The experiments were carried out with AMPS mounted on three kinds of flying platforms. The results shows that the power consumption is less than 1.3 W, with relatively high accuracy in temperature (±0.1°C), relative humidity (±0.8%RH), PM2.5 (<20%) and PM10 (<20%). Vertical profiles of PM2.5 and PM10 concentrations were observed simultaneously by the AMPS three times every day in five days. The results revealed the significant correlation between the aerosol particle concentration and atmospheric

  9. Wetland Vegetation Integrity Assessment with Low Altitude Multispectral Uav Imagery

    Science.gov (United States)

    Boon, M. A.; Tesfamichael, S.

    2017-08-01

    The use of multispectral sensors on Unmanned Aerial Vehicles (UAVs) was until recently too heavy and bulky although this changed in recent times and they are now commercially available. The focus on the usage of these sensors is mostly directed towards the agricultural sector where the focus is on precision farming. Applications of these sensors for mapping of wetland ecosystems are rare. Here, we evaluate the performance of low altitude multispectral UAV imagery to determine the state of wetland vegetation in a localised spatial area. Specifically, NDVI derived from multispectral UAV imagery was used to inform the determination of the integrity of the wetland vegetation. Furthermore, we tested different software applications for the processing of the imagery. The advantages and disadvantages we experienced of these applications are also shortly presented in this paper. A JAG-M fixed-wing imaging system equipped with a MicaScene RedEdge multispectral camera were utilised for the survey. A single surveying campaign was undertaken in early autumn of a 17 ha study area at the Kameelzynkraal farm, Gauteng Province, South Africa. Structure-from-motion photogrammetry software was used to reconstruct the camera position's and terrain features to derive a high resolution orthoretified mosaic. MicaSense Atlas cloud-based data platform, Pix4D and PhotoScan were utilised for the processing. The WET-Health level one methodology was followed for the vegetation assessment, where wetland health is a measure of the deviation of a wetland's structure and function from its natural reference condition. An on-site evaluation of the vegetation integrity was first completed. Disturbance classes were then mapped using the high resolution multispectral orthoimages and NDVI. The WET-Health vegetation module completed with the aid of the multispectral UAV products indicated that the vegetation of the wetland is largely modified ("D" PES Category) and that the condition is expected to

  10. A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching.

    Science.gov (United States)

    Li, Ming; Chen, Ruizhi; Zhang, Weilong; Li, Deren; Liao, Xuan; Wang, Lei; Pan, Yuanjin; Zhang, Peng

    2017-09-08

    Dislocation is one of the major challenges in unmanned aerial vehicle (UAV) image stitching. In this paper, we propose a new algorithm for seamlessly stitching UAV images based on a dynamic programming approach. Our solution consists of two steps: Firstly, an image matching algorithm is used to correct the images so that they are in the same coordinate system. Secondly, a new dynamic programming algorithm is developed based on the concept of a stereo dual-channel energy accumulation. A new energy aggregation and traversal strategy is adopted in our solution, which can find a more optimal seam line for image stitching. Our algorithm overcomes the theoretical limitation of the classical Duplaquet algorithm. Experiments show that the algorithm can effectively solve the dislocation problem in UAV image stitching, especially for the cases in dense urban areas. Our solution is also direction-independent, which has better adaptability and robustness for stitching images.

  11. 3D MODELING WITH PHOTOGRAMMETRY BY UAVS AND MODEL QUALITY VERIFICATION

    Directory of Open Access Journals (Sweden)

    V. Barrile

    2017-11-01

    Full Text Available This paper deals with a test lead by Geomatics laboratory (DICEAM, Mediterranea University of Reggio Calabria, concerning the application of UAV photogrammetry for survey, monitoring and checking. The study case relies with the surroundings of the Department of Agriculture Sciences. In the last years, such area was interested by landslides and survey activities carried out to take the phenomenon under control. For this purpose, a set of digital images were acquired through a UAV equipped with a digital camera and GPS. Successively, the processing for the production of a 3D georeferenced model was performed by using the commercial software Agisoft PhotoScan. Similarly, the use of a terrestrial laser scanning technique allowed to product dense cloud and 3D models of the same area. To assess the accuracy of the UAV-derived 3D models, a comparison between image and range-based methods was performed.

  12. EVALUATION OF THE QUALITY OF ACTION CAMERAS WITH WIDE-ANGLE LENSES IN UAV PHOTOGRAMMETRY

    Directory of Open Access Journals (Sweden)

    H. Hastedt

    2016-06-01

    Full Text Available The application of light-weight cameras in UAV photogrammetry is required due to restrictions in payload. In general, consumer cameras with normal lens type are applied to a UAV system. The availability of action cameras, like the GoPro Hero4 Black, including a wide-angle lens (fish-eye lens offers new perspectives in UAV projects. With these investigations, different calibration procedures for fish-eye lenses are evaluated in order to quantify their accuracy potential in UAV photogrammetry. Herewith the GoPro Hero4 is evaluated using different acquisition modes. It is investigated to which extent the standard calibration approaches in OpenCV or Agisoft PhotoScan/Lens can be applied to the evaluation processes in UAV photogrammetry. Therefore different calibration setups and processing procedures are assessed and discussed. Additionally a pre-correction of the initial distortion by GoPro Studio and its application to the photogrammetric purposes will be evaluated. An experimental setup with a set of control points and a prospective flight scenario is chosen to evaluate the processing results using Agisoft PhotoScan. Herewith it is analysed to which extent a pre-calibration and pre-correction of a GoPro Hero4 will reinforce the reliability and accuracy of a flight scenario.

  13. Evaluation of the Quality of Action Cameras with Wide-Angle Lenses in Uav Photogrammetry

    Science.gov (United States)

    Hastedt, H.; Ekkel, T.; Luhmann, T.

    2016-06-01

    The application of light-weight cameras in UAV photogrammetry is required due to restrictions in payload. In general, consumer cameras with normal lens type are applied to a UAV system. The availability of action cameras, like the GoPro Hero4 Black, including a wide-angle lens (fish-eye lens) offers new perspectives in UAV projects. With these investigations, different calibration procedures for fish-eye lenses are evaluated in order to quantify their accuracy potential in UAV photogrammetry. Herewith the GoPro Hero4 is evaluated using different acquisition modes. It is investigated to which extent the standard calibration approaches in OpenCV or Agisoft PhotoScan/Lens can be applied to the evaluation processes in UAV photogrammetry. Therefore different calibration setups and processing procedures are assessed and discussed. Additionally a pre-correction of the initial distortion by GoPro Studio and its application to the photogrammetric purposes will be evaluated. An experimental setup with a set of control points and a prospective flight scenario is chosen to evaluate the processing results using Agisoft PhotoScan. Herewith it is analysed to which extent a pre-calibration and pre-correction of a GoPro Hero4 will reinforce the reliability and accuracy of a flight scenario.

  14. Detection, Location and Grasping Objects Using a Stereo Sensor on UAV in Outdoor Environments

    Directory of Open Access Journals (Sweden)

    Pablo Ramon Soria

    2017-01-01

    Full Text Available The article presents a vision system for the autonomous grasping of objects with Unmanned Aerial Vehicles (UAVs in real time. Giving UAVs the capability to manipulate objects vastly extends their applications, as they are capable of accessing places that are difficult to reach or even unreachable for human beings. This work is focused on the grasping of known objects based on feature models. The system runs in an on-board computer on a UAV equipped with a stereo camera and a robotic arm. The algorithm learns a feature-based model in an offline stage, then it is used online for detection of the targeted object and estimation of its position. This feature-based model was proved to be robust to both occlusions and the presence of outliers. The use of stereo cameras improves the learning stage, providing 3D information and helping to filter features in the online stage. An experimental system was derived using a rotary-wing UAV and a small manipulator for final proof of concept. The robotic arm is designed with three degrees of freedom and is lightweight due to payload limitations of the UAV. The system has been validated with different objects, both indoors and outdoors.

  15. The Quality of Quantity: Mini-UAVS As An Alternative UAV Acquisition Strategy at the Army Brigade Level

    Science.gov (United States)

    2002-05-24

    contrast to the Exdrone is the more conventional, and more Spartan, Pointer UAV. Designed by Paul McCready, PhD., the engineer who designed the “ Gossamer ... Albatross ”, the first human powered aircraft to cross the English Channel, the Pointer UAV’s design reflects an engineering philosophy predicated on

  16. Error Resilience in Current Distributed Video Coding Architectures

    Directory of Open Access Journals (Sweden)

    Tonoli Claudia

    2009-01-01

    Full Text Available In distributed video coding the signal prediction is shifted at the decoder side, giving therefore most of the computational complexity burden at the receiver. Moreover, since no prediction loop exists before transmission, an intrinsic robustness to transmission errors has been claimed. This work evaluates and compares the error resilience performance of two distributed video coding architectures. In particular, we have considered a video codec based on the Stanford architecture (DISCOVER codec and a video codec based on the PRISM architecture. Specifically, an accurate temporal and rate/distortion based evaluation of the effects of the transmission errors for both the considered DVC architectures has been performed and discussed. These approaches have been also compared with H.264/AVC, in both cases of no error protection, and simple FEC error protection. Our evaluations have highlighted in all cases a strong dependence of the behavior of the various codecs to the content of the considered video sequence. In particular, PRISM seems to be particularly well suited for low-motion sequences, whereas DISCOVER provides better performance in the other cases.

  17. Demo of Gaze Controlled Flying

    DEFF Research Database (Denmark)

    Alapetite, Alexandre; Hansen, John Paulin; Scott MacKenzie, I.

    2012-01-01

    Development of a control paradigm for unmanned aerial vehicles (UAV) is a new challenge to HCI. The demo explores how to use gaze as input for locomotion in 3D. A low-cost drone will be controlled by tracking user’s point of regard (gaze) on a live video stream from the UAV.......Development of a control paradigm for unmanned aerial vehicles (UAV) is a new challenge to HCI. The demo explores how to use gaze as input for locomotion in 3D. A low-cost drone will be controlled by tracking user’s point of regard (gaze) on a live video stream from the UAV....

  18. A meta-analysis of human-system interfaces in unmanned aerial vehicle (UAV) swarm management.

    Science.gov (United States)

    Hocraffer, Amy; Nam, Chang S

    2017-01-01

    A meta-analysis was conducted to systematically evaluate the current state of research on human-system interfaces for users controlling semi-autonomous swarms composed of groups of drones or unmanned aerial vehicles (UAVs). UAV swarms pose several human factors challenges, such as high cognitive demands, non-intuitive behavior, and serious consequences for errors. This article presents findings from a meta-analysis of 27 UAV swarm management papers focused on the human-system interface and human factors concerns, providing an overview of the advantages, challenges, and limitations of current UAV management interfaces, as well as information on how these interfaces are currently evaluated. In general allowing user and mission-specific customization to user interfaces and raising the swarm's level of autonomy to reduce operator cognitive workload are beneficial and improve situation awareness (SA). It is clear more research is needed in this rapidly evolving field. Copyright © 2016 Elsevier Ltd. All rights reserved.

  19. COMPARISON OF DIGITAL SURFACE MODELS FOR SNOW DEPTH MAPPING WITH UAV AND AERIAL CAMERAS

    Directory of Open Access Journals (Sweden)

    R. Boesch

    2016-06-01

    Full Text Available Photogrammetric workflows for aerial images have improved over the last years in a typically black-box fashion. Most parameters for building dense point cloud are either excessive or not explained and often the progress between software releases is poorly documented. On the other hand, development of better camera sensors and positional accuracy of image acquisition is significant by comparing product specifications. This study shows, that hardware evolutions over the last years have a much stronger impact on height measurements than photogrammetric software releases. Snow height measurements with airborne sensors like the ADS100 and UAV-based DSLR cameras can achieve accuracies close to GSD * 2 in comparison with ground-based GNSS reference measurements. Using a custom notch filter on the UAV camera sensor during image acquisition does not yield better height accuracies. UAV based digital surface models are very robust. Different workflow parameter variations for ADS100 and UAV camera workflows seem to have only random effects.

  20. The Use of Drones in Spain: Towards a Platform for Controlling UAVs in Urban Environments

    Science.gov (United States)

    Bueno De Mata, Federico

    2018-01-01

    Rapid advances in technology make it necessary to prepare our society in every aspect. Some of the most significant technological developments of the last decade are the UAVs (Unnamed Aerial Vehicles) or drones. UAVs provide a wide range of new possibilities and have become a tool that we now use on a daily basis. However, if their use is not controlled, it could entail several risks, which make it necessary to legislate and monitor UAV flights to ensure, inter alia, the security and privacy of all citizens. As a result of this problem, several laws have been passed which seek to regulate their use; however, no proposals have been made with regards to the control of airspace from a technological point of view. This is exactly what we propose in this article: a platform with different modes designed to control UAVs and monitor their status. The features of the proposed platform provide multiple advantages that make the use of UAVs more secure, such as prohibiting UAVs’ access to restricted areas or avoiding collisions between vehicles. The platform has been successfully tested in Salamanca, Spain. PMID:29751554

  1. The Use of Drones in Spain: Towards a Platform for Controlling UAVs in Urban Environments.

    Science.gov (United States)

    Chamoso, Pablo; González-Briones, Alfonso; Rivas, Alberto; Bueno De Mata, Federico; Corchado, Juan Manuel

    2018-05-03

    Rapid advances in technology make it necessary to prepare our society in every aspect. Some of the most significant technological developments of the last decade are the UAVs (Unnamed Aerial Vehicles) or drones. UAVs provide a wide range of new possibilities and have become a tool that we now use on a daily basis. However, if their use is not controlled, it could entail several risks, which make it necessary to legislate and monitor UAV flights to ensure, inter alia, the security and privacy of all citizens. As a result of this problem, several laws have been passed which seek to regulate their use; however, no proposals have been made with regards to the control of airspace from a technological point of view. This is exactly what we propose in this article: a platform with different modes designed to control UAVs and monitor their status. The features of the proposed platform provide multiple advantages that make the use of UAVs more secure, such as prohibiting UAVs’ access to restricted areas or avoiding collisions between vehicles. The platform has been successfully tested in Salamanca, Spain.

  2. The Use of Drones in Spain: Towards a Platform for Controlling UAVs in Urban Environments

    Directory of Open Access Journals (Sweden)

    Pablo Chamoso

    2018-05-01

    Full Text Available Rapid advances in technology make it necessary to prepare our society in every aspect. Some of the most significant technological developments of the last decade are the UAVs (Unnamed Aerial Vehicles or drones. UAVs provide a wide range of new possibilities and have become a tool that we now use on a daily basis. However, if their use is not controlled, it could entail several risks, which make it necessary to legislate and monitor UAV flights to ensure, inter alia, the security and privacy of all citizens. As a result of this problem, several laws have been passed which seek to regulate their use; however, no proposals have been made with regards to the control of airspace from a technological point of view. This is exactly what we propose in this article: a platform with different modes designed to control UAVs and monitor their status. The features of the proposed platform provide multiple advantages that make the use of UAVs more secure, such as prohibiting UAVs’ access to restricted areas or avoiding collisions between vehicles. The platform has been successfully tested in Salamanca, Spain.

  3. Building Damage Extraction Triggered by Earthquake Using the Uav Imagery

    Science.gov (United States)

    Li, S.; Tang, H.

    2018-04-01

    When extracting building damage information, we can only determine whether the building is collapsed using the post-earthquake satellite images. Even the satellite images have the sub-meter resolution, the identification of slightly damaged buildings is still a challenge. As the complementary data to satellite images, the UAV images have unique advantages, such as stronger flexibility and higher resolution. In this paper, according to the spectral feature of UAV images and the morphological feature of the reconstructed point clouds, the building damage was classified into four levels: basically intact buildings, slightly damaged buildings, partially collapsed buildings and totally collapsed buildings, and give the rules of damage grades. In particular, the slightly damaged buildings are determined using the detected roof-holes. In order to verify the approach, we conduct experimental simulations in the cases of Wenchuan and Ya'an earthquakes. By analyzing the post-earthquake UAV images of the two earthquakes, the building damage was classified into four levels, and the quantitative statistics of the damaged buildings is given in the experiments.

  4. Multi-UAV joint target recognizing based on binocular vision theory

    Directory of Open Access Journals (Sweden)

    Yuan Zhang

    2017-01-01

    Full Text Available Target recognizing of unmanned aerial vehicle (UAV based on image processing take the advantage of 2D information containing in the image for identifying the target. Compare to single UAV with electrical optical tracking system (EOTS, multi-UAV with EOTS is able to take a group of image focused on the suspected target from multiple view point. Benefit from matching each couple of image in this group, points set constituted by matched feature points implicates the depth of each point. Coordinate of target feature points could be computing from depth of feature points. This depth information makes up a cloud of points and reconstructed an exclusive 3D model to recognizing system. Considering the target recognizing do not require precise target model, the cloud of feature points was regrouped into n subsets and reconstructed to a semi-3D model. Casting these subsets in a Cartesian coordinate and applying these projections in convolutional neural networks (CNN respectively, the integrated output of networks is the improved result of recognizing.

  5. Cooperative Search by UAV Teams: A Model Predictive Approach Using Dynamic Graphs

    Science.gov (United States)

    2011-10-01

    Consequently , target estimation is a challenging problem and a rich field of study in itself. We refer the reader to [1] and [11] for a deeper analysis of...decentralized processing and control architecture. SLAMEM asset models accurately represent the Unicorn UAV platforms and other standard military platforms in...IMPLEMENTATION The CGBMPS algorithm has been successfully field-tested using both Unicorn [27] and Raven [20] UAV platforms. This section describes

  6. High-Fidelity Solar Power Income Modeling for Solar-Electric UAVs: Development and Flight Test Based Verification

    OpenAIRE

    Oettershagen, Philipp

    2017-01-01

    Solar power models are a crucial element of solar-powered UAV design and performance analysis. During the conceptual design phase, their accuracy directly relates to the accuracy of the predicted performance metrics and thus the final design characteristics of the solar-powered UAV. Likewise, during the operations phase of a solar-powered UAV accurate solar power income models are required to predict and assess the solar power system performance. However, the existing literature on solar-powe...

  7. Assessing the consistency of UAV-derived point clouds and images acquired at different altitudes

    Science.gov (United States)

    Ozcan, O.

    2016-12-01

    Unmanned Aerial Vehicles (UAVs) offer several advantages in terms of cost and image resolution compared to terrestrial photogrammetry and satellite remote sensing system. Nowadays, UAVs that bridge the gap between the satellite scale and field scale applications were initiated to be used in various application areas to acquire hyperspatial and high temporal resolution imageries due to working capacity and acquiring in a short span of time with regard to conventional photogrammetry methods. UAVs have been used for various fields such as for the creation of 3-D earth models, production of high resolution orthophotos, network planning, field monitoring and agricultural lands as well. Thus, geometric accuracy of orthophotos and volumetric accuracy of point clouds are of capital importance for land surveying applications. Correspondingly, Structure from Motion (SfM) photogrammetry, which is frequently used in conjunction with UAV, recently appeared in environmental sciences as an impressive tool allowing for the creation of 3-D models from unstructured imagery. In this study, it was aimed to reveal the spatial accuracy of the images acquired from integrated digital camera and the volumetric accuracy of Digital Surface Models (DSMs) which were derived from UAV flight plans at different altitudes using SfM methodology. Low-altitude multispectral overlapping aerial photography was collected at the altitudes of 30 to 100 meters and georeferenced with RTK-GPS ground control points. These altitudes allow hyperspatial imagery with the resolutions of 1-5 cm depending upon the sensor being used. Preliminary results revealed that the vertical comparison of UAV-derived point clouds with respect to GPS measurements pointed out an average distance at cm-level. Larger values are found in areas where instantaneous changes in surface are present.

  8. Temporal Segmentation of MPEG Video Streams

    Directory of Open Access Journals (Sweden)

    Janko Calic

    2002-06-01

    Full Text Available Many algorithms for temporal video partitioning rely on the analysis of uncompressed video features. Since the information relevant to the partitioning process can be extracted directly from the MPEG compressed stream, higher efficiency can be achieved utilizing information from the MPEG compressed domain. This paper introduces a real-time algorithm for scene change detection that analyses the statistics of the macroblock features extracted directly from the MPEG stream. A method for extraction of the continuous frame difference that transforms the 3D video stream into a 1D curve is presented. This transform is then further employed to extract temporal units within the analysed video sequence. Results of computer simulations are reported.

  9. Distributed Cooperative Search Control Method of Multiple UAVs for Moving Target

    Directory of Open Access Journals (Sweden)

    Chang-jian Ru

    2015-01-01

    Full Text Available To reduce the impact of uncertainties caused by unknown motion parameters on searching plan of moving targets and improve the efficiency of UAV’s searching, a novel distributed Multi-UAVs cooperative search control method for moving target is proposed in this paper. Based on detection results of onboard sensors, target probability map is updated using Bayesian theory. A Gaussian distribution of target transition probability density function is introduced to calculate prediction probability of moving target existence, and then target probability map can be further updated in real-time. A performance index function combining with target cost, environment cost, and cooperative cost is constructed, and the cooperative searching problem can be transformed into a central optimization problem. To improve computational efficiency, the distributed model predictive control method is presented, and thus the control command of each UAV can be obtained. The simulation results have verified that the proposed method can avoid the blindness of UAV searching better and improve overall efficiency of the team effectively.

  10. The Combination of Spherical Photogrammetry and UAV for 3D Modeling

    Science.gov (United States)

    Ihsanudin, T.; Affriani, A. R.

    2017-12-01

    The complete of 3D models required the object that was recorded from both side and top. If the object recorded from above, then the object from the side can not be covered, and if the objects recorded from the side, it can not be covered from the top. Recording of objects from the side using spherical photogrammetry method and from the top using UAV method. The merge of both models using a conform transformation, by bringing the spherical photogrammetry coordinates system to the UAV model. The object of this research is Ratu Boko temple, Sleman, Yogyakarta. The spherical photogrammetry recording was performed by rotating the camera in 360° angle on the entire area of the temple. The area consists of 12 stations. The UAV method uses a drone with flight attitude of 20 meters. The merge of the both models produced the completeness of the temple model from the top and side.

  11. Photovoltaic electric power applied to Unmanned Aerial Vehicles (UAV)

    Science.gov (United States)

    Geis, Jack; Arnold, Jack H.

    1994-09-01

    Photovoltaic electric-powered flight is receiving a great deal of attention in the context of the United States' Unmanned Aerial Vehicle (UAV) program. This paper addresses some of the enabling technical areas and their potential solutions. Of particular interest are the long-duration, high-altitude class of UAV's whose mission it is to achieve altitudes between 60,000 and 100,000 feet, and to remain at those altitudes for prolonged periods performing various mapping and surveillance activities. Addressed herein are studies which reveal the need for extremely light-weight and efficient solar cells, high-efficiency electric motor-driven propeller modules, and power management and distribution control elements. Since the potential payloads vary dramatically in their power consumption and duty cycles, a typical load profile has been selected to provide commonality for the propulsion power comparisons. Since missions vary widely with respect to ground coverage requirements, from repeated orbiting over a localized target to long-distance routes over irregular terrain, we have also averaged the power requirements for on-board guidance and control power, as well as ground control and communication link utilization. In the context of the national technology reinvestment program, wherever possible we modeled components and materials which have been qualified for space and defense applications, yet are compatible with civilian UAV activities. These include, but are not limited to, solar cell developments, electric storage technology for diurnal operation, local and ground communications, power management and distribution, and control servo design. And finally, the results of tests conducted by Wright Laboratory on ultralight, highly efficient MOCVD GaAs solar cells purchased from EPI Materials Ltd. (EML) of the UK are presented. These cells were also used for modeling the flight characteristics of UAV aircraft.

  12. Beach Volume Change Using Uav Photogrammetry Songjung Beach, Korea

    Science.gov (United States)

    Yoo, C. I.; Oh, T. S.

    2016-06-01

    Natural beach is controlled by many factors related to wave and tidal forces, wind, sediment, and initial topography. For this reason, if numerous topographic data of beach is accurately collected, coastal erosion/acceleration is able to be assessed and clarified. Generally, however, many studies on coastal erosion have limitation to analyse the whole beach, carried out of partial area as like shoreline (horizontal 2D) and beach profile (vertical 2D) on account of limitation of numerical simulation. This is an important application for prevention of coastal erosion, and UAV photogrammetry is also used to 3D topographic data. This paper analyses the use of unmanned aerial vehicles (UAV) to 3D map and beach volume change. UAV (Quadcopter) equipped with a non-metric camera was used to acquire images in Songjung beach which is located south-east Korea peninsula. The dynamics of beach topography, its geometric properties and estimates of eroded and deposited sand volumes were determined by combining elevation data with quarterly RTK-VRS measurements. To explore the new possibilities for assessment of coastal change we have developed a methodology for 3D analysis of coastal topography evolution based on existing high resolution elevation data combined with low coast, UAV and on-ground RTK-VRS surveys. DSMs were obtained by stereo-matching using Agisoft Photoscan. Using GCPs the vertical accuracy of the DSMs was found to be 10 cm or better. The resulting datasets were integrated in a local coordinates and the method proved to be a very useful fool for the detection of areas where coastal erosion occurs and for the quantification of beach change. The value of such analysis is illustrated by applications to coastal of South Korea sites that face significant management challenges.

  13. BEACH VOLUME CHANGE USING UAV PHOTOGRAMMETRY SONGJUNG BEACH, KOREA

    Directory of Open Access Journals (Sweden)

    C. I. Yoo

    2016-06-01

    Full Text Available Natural beach is controlled by many factors related to wave and tidal forces, wind, sediment, and initial topography. For this reason, if numerous topographic data of beach is accurately collected, coastal erosion/acceleration is able to be assessed and clarified. Generally, however, many studies on coastal erosion have limitation to analyse the whole beach, carried out of partial area as like shoreline (horizontal 2D and beach profile (vertical 2D on account of limitation of numerical simulation. This is an important application for prevention of coastal erosion, and UAV photogrammetry is also used to 3D topographic data. This paper analyses the use of unmanned aerial vehicles (UAV to 3D map and beach volume change. UAV (Quadcopter equipped with a non-metric camera was used to acquire images in Songjung beach which is located south-east Korea peninsula. The dynamics of beach topography, its geometric properties and estimates of eroded and deposited sand volumes were determined by combining elevation data with quarterly RTK-VRS measurements. To explore the new possibilities for assessment of coastal change we have developed a methodology for 3D analysis of coastal topography evolution based on existing high resolution elevation data combined with low coast, UAV and on-ground RTK-VRS surveys. DSMs were obtained by stereo-matching using Agisoft Photoscan. Using GCPs the vertical accuracy of the DSMs was found to be 10 cm or better. The resulting datasets were integrated in a local coordinates and the method proved to be a very useful fool for the detection of areas where coastal erosion occurs and for the quantification of beach change. The value of such analysis is illustrated by applications to coastal of South Korea sites that face significant management challenges.

  14. Photovoltaic electric power applied to Unmanned Aerial Vehicles (UAV)

    Science.gov (United States)

    Geis, Jack; Arnold, Jack H.

    1994-01-01

    Photovoltaic electric-powered flight is receiving a great deal of attention in the context of the United States' Unmanned Aerial Vehicle (UAV) program. This paper addresses some of the enabling technical areas and their potential solutions. Of particular interest are the long-duration, high-altitude class of UAV's whose mission it is to achieve altitudes between 60,000 and 100,000 feet, and to remain at those altitudes for prolonged periods performing various mapping and surveillance activities. Addressed herein are studies which reveal the need for extremely light-weight and efficient solar cells, high-efficiency electric motor-driven propeller modules, and power management and distribution control elements. Since the potential payloads vary dramatically in their power consumption and duty cycles, a typical load profile has been selected to provide commonality for the propulsion power comparisons. Since missions vary widely with respect to ground coverage requirements, from repeated orbiting over a localized target to long-distance routes over irregular terrain, we have also averaged the power requirements for on-board guidance and control power, as well as ground control and communication link utilization. In the context of the national technology reinvestment program, wherever possible we modeled components and materials which have been qualified for space and defense applications, yet are compatible with civilian UAV activities. These include, but are not limited to, solar cell developments, electric storage technology for diurnal operation, local and ground communications, power management and distribution, and control servo design. And finally, the results of tests conducted by Wright Laboratory on ultralight, highly efficient MOCVD GaAs solar cells purchased from EPI Materials Ltd. (EML) of the UK are presented. These cells were also used for modeling the flight characteristics of UAV aircraft.

  15. Baseline and Multimodal UAV GCS Interface Design

    Science.gov (United States)

    2013-07-01

    complete a computerized version of the NASA - TLX assessment of perceived mental workload. 2.3 Results The baseline condition ran smoothly and with...System MALE Medium-altitude, Long-endurance NASA - TLX NASA Task Load Index SA Situation Awareness TDT Tucker Davis Technologies UAV Uninhabited Aerial

  16. Multi-Model Estimation Based Moving Object Detection for Aerial Video

    Directory of Open Access Journals (Sweden)

    Yanning Zhang

    2015-04-01

    Full Text Available With the wide development of UAV (Unmanned Aerial Vehicle technology, moving target detection for aerial video has become a popular research topic in the computer field. Most of the existing methods are under the registration-detection framework and can only deal with simple background scenes. They tend to go wrong in the complex multi background scenarios, such as viaducts, buildings and trees. In this paper, we break through the single background constraint and perceive the complex scene accurately by automatic estimation of multiple background models. First, we segment the scene into several color blocks and estimate the dense optical flow. Then, we calculate an affine transformation model for each block with large area and merge the consistent models. Finally, we calculate subordinate degree to multi-background models pixel to pixel for all small area blocks. Moving objects are segmented by means of energy optimization method solved via Graph Cuts. The extensive experimental results on public aerial videos show that, due to multi background models estimation, analyzing each pixel’s subordinate relationship to multi models by energy minimization, our method can effectively remove buildings, trees and other false alarms and detect moving objects correctly.

  17. Uav Onboard Photogrammetry and GPS Positionning for Earthworks

    Science.gov (United States)

    Daakir, M.; Pierrot-Deseilligny, M.; Bosser, P.; Pichard, F.; Thom, C.

    2015-08-01

    Over the last decade, Unmanned Airbone Vehicles (UAVs) have been largely used for civil applications. Airborne photogrammetry has found place in these applications not only for 3D modeling but also as a measurement tool. Vinci-Construction-Terrassement is a private company specialized in public works sector and uses airborn photogrammetry as a mapping solution and metrology investigation tool on its sites. This technology is very efficient for the calculation of stock volumes for instance, or for time tracking of specific areas with risk of landslides. The aim of the present work is to perform a direct georeferencing of images acquired by the camera leaning on an embedded GPS receiver. UAV, GPS receiver and camera used are low-cost models and therefore data processing is adapted to this particular constraint.

  18. Cloud Water Content Sensor for Sounding Balloons and Small UAVs

    Science.gov (United States)

    Bognar, John A.

    2009-01-01

    A lightweight, battery-powered sensor was developed for measuring cloud water content, which is the amount of liquid or solid water present in a cloud, generally expressed as grams of water per cubic meter. This sensor has near-zero power consumption and can be flown on standard sounding balloons and small, unmanned aerial vehicles (UAVs). The amount of solid or liquid water is important to the study of atmospheric processes and behavior. Previous sensing techniques relied on strongly heating the incoming air, which requires a major energy input that cannot be achieved on sounding balloons or small UAVs.

  19. High-Fidelity Computational Aerodynamics of the Elytron 4S UAV

    Science.gov (United States)

    Ventura Diaz, Patricia; Yoon, Seokkwan; Theodore, Colin R.

    2018-01-01

    High-fidelity Computational Fluid Dynamics (CFD) have been carried out for the Elytron 4S Unmanned Aerial Vehicle (UAV), also known as the converticopter "proto12". It is the scaled wind tunnel model of the Elytron 4S, an Urban Air Mobility (UAM) concept, a tilt-wing, box-wing rotorcraft capable of Vertical Take-Off and Landing (VTOL). The three-dimensional unsteady Navier-Stokes equations are solved on overset grids employing high-order accurate schemes, dual-time stepping, and a hybrid turbulence model using NASA's CFD code OVERFLOW. The Elytron 4S UAV has been simulated in airplane mode and in helicopter mode.

  20. Dragon Drone UAV System

    Science.gov (United States)

    2003-09-02

    TYPE N/A 3. DATES COVERED - 4. TITLE AND SUBTITLE Dragon Drone UAV System 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER...ABSTRACT unclassified c. THIS PAGE unclassified Standard Form 298 (Rev. 8-98) Prescribed by ANSI Std Z39-18 A E R O S Y S T E M S BAI’s Dragon Drone ...the hundreds. BAI’s Dragon Drone system is the result of combining new ideas and emerging technologies with the in-depth knowl- edge gained from real

  1. Design of UAVs-Based 3D Antenna Arrays for a Maximum Performance in Terms of Directivity and SLL

    Directory of Open Access Journals (Sweden)

    Jesus Garza

    2016-01-01

    Full Text Available This paper presents a design of UAVs-based 3D antenna arrays for a maximum performance in terms of directivity and side lobe level (SLL. This paper illustrates how to model the UAVs formation flight using 3D nonuniform antenna arrays. This design of 3D antenna arrays considers the optimization of the positions of the antenna elements to model the UAVs formation flight. In this case, a disk patch antenna is chosen to be used as element in each UAV. The disk patch antenna is formulated by the well-known cavity model. The synthesis process is carried out by the method of Differential Evolution for Multiobjective Optimization (DEMO. Furthermore, a comparison of the performance of 3D nonuniform antenna arrays is provided with respect to the most conventional arrays (circular, planar, linear, and the cubic for UAVs formation flight.

  2. Towards Autonomous Modular UAV Missions: The Detection, Geo-Location and Landing Paradigm

    Science.gov (United States)

    Kyristsis, Sarantis; Antonopoulos, Angelos; Chanialakis, Theofilos; Stefanakis, Emmanouel; Linardos, Christos; Tripolitsiotis, Achilles; Partsinevelos, Panagiotis

    2016-01-01

    Nowadays, various unmanned aerial vehicle (UAV) applications become increasingly demanding since they require real-time, autonomous and intelligent functions. Towards this end, in the present study, a fully autonomous UAV scenario is implemented, including the tasks of area scanning, target recognition, geo-location, monitoring, following and finally landing on a high speed moving platform. The underlying methodology includes AprilTag target identification through Graphics Processing Unit (GPU) parallelized processing, image processing and several optimized locations and approach algorithms employing gimbal movement, Global Navigation Satellite System (GNSS) readings and UAV navigation. For the experimentation, a commercial and a custom made quad-copter prototype were used, portraying a high and a low-computational embedded platform alternative. Among the successful targeting and follow procedures, it is shown that the landing approach can be successfully performed even under high platform speeds. PMID:27827883

  3. Modelling and Analysis of Vibrations in a UAV Helicopter with a Vision System

    Directory of Open Access Journals (Sweden)

    G. Nicolás Marichal Plasencia

    2012-11-01

    Full Text Available The analysis of the nature and damping of unwanted vibrations on Unmanned Aerial Vehicle (UAV helicopters are important tasks when images from on-board vision systems are to be obtained. In this article, the authors model a UAV system, generate a range of vibrations originating in the main rotor and design a control methodology in order to damp these vibrations. The UAV is modelled using VehicleSim, the vibrations that appear on the fuselage are analysed to study their effects on the on-board vision system by using Simmechanics software. Following this, the authors present a control method based on an Adaptive Neuro-Fuzzy Inference System (ANFIS to achieve satisfactory damping results over the vision system on board.

  4. Motion Vector Sharing and Bitrate Allocation for 3D Video-Plus-Depth Coding

    Directory of Open Access Journals (Sweden)

    Béatrice Pesquet-Popescu

    2008-08-01

    Full Text Available The video-plus-depth data representation uses a regular texture video enriched with the so-called depth map, providing the depth distance for each pixel. The compression efficiency is usually higher for smooth, gray level data representing the depth map than for classical video texture. However, improvements of the coding efficiency are still possible, taking into account the fact that the video and the depth map sequences are strongly correlated. Classically, the correlation between the texture motion vectors and the depth map motion vectors is not exploited in the coding process. The aim of this paper is to reduce the amount of information for describing the motion of the texture video and of the depth map sequences by sharing one common motion vector field. Furthermore, in the literature, the bitrate control scheme generally fixes for the depth map sequence a percentage of 20% of the texture stream bitrate. However, this fixed percentage can affect the depth coding efficiency, and it should also depend on the content of each sequence. We propose a new bitrate allocation strategy between the texture and its associated per-pixel depth information. We provide comparative analysis to measure the quality of the resulting 3D+t sequences.

  5. Adaptive Levels of Autonomy (ALOA) for UAV Supervisory Control

    National Research Council Canada - National Science Library

    Johnson, Rubin; Leen, Michael; Goldberg, Dan; Chiu, Michael

    2005-01-01

    .... To demonstrate the architecture and LOA implementation, we designed a prototype Multi-UAV Control Station Emulator research test bed, by building on existing ORCA-developed software components...

  6. APPLICATION OF SENSOR FUSION TO IMPROVE UAV IMAGE CLASSIFICATION

    Directory of Open Access Journals (Sweden)

    S. Jabari

    2017-08-01

    Full Text Available Image classification is one of the most important tasks of remote sensing projects including the ones that are based on using UAV images. Improving the quality of UAV images directly affects the classification results and can save a huge amount of time and effort in this area. In this study, we show that sensor fusion can improve image quality which results in increasing the accuracy of image classification. Here, we tested two sensor fusion configurations by using a Panchromatic (Pan camera along with either a colour camera or a four-band multi-spectral (MS camera. We use the Pan camera to benefit from its higher sensitivity and the colour or MS camera to benefit from its spectral properties. The resulting images are then compared to the ones acquired by a high resolution single Bayer-pattern colour camera (here referred to as HRC. We assessed the quality of the output images by performing image classification tests. The outputs prove that the proposed sensor fusion configurations can achieve higher accuracies compared to the images of the single Bayer-pattern colour camera. Therefore, incorporating a Pan camera on-board in the UAV missions and performing image fusion can help achieving higher quality images and accordingly higher accuracy classification results.

  7. Application of Sensor Fusion to Improve Uav Image Classification

    Science.gov (United States)

    Jabari, S.; Fathollahi, F.; Zhang, Y.

    2017-08-01

    Image classification is one of the most important tasks of remote sensing projects including the ones that are based on using UAV images. Improving the quality of UAV images directly affects the classification results and can save a huge amount of time and effort in this area. In this study, we show that sensor fusion can improve image quality which results in increasing the accuracy of image classification. Here, we tested two sensor fusion configurations by using a Panchromatic (Pan) camera along with either a colour camera or a four-band multi-spectral (MS) camera. We use the Pan camera to benefit from its higher sensitivity and the colour or MS camera to benefit from its spectral properties. The resulting images are then compared to the ones acquired by a high resolution single Bayer-pattern colour camera (here referred to as HRC). We assessed the quality of the output images by performing image classification tests. The outputs prove that the proposed sensor fusion configurations can achieve higher accuracies compared to the images of the single Bayer-pattern colour camera. Therefore, incorporating a Pan camera on-board in the UAV missions and performing image fusion can help achieving higher quality images and accordingly higher accuracy classification results.

  8. Acquisition and Processing Protocols for Uav Images: 3d Modeling of Historical Buildings Using Photogrammetry

    Science.gov (United States)

    Murtiyoso, A.; Koehl, M.; Grussenmeyer, P.; Freville, T.

    2017-08-01

    Photogrammetry has seen an increase in the use of UAVs (Unmanned Aerial Vehicles) for both large and smaller scale cartography. The use of UAVs is also advantageous because it may be used for tasks requiring quick response, including in the case of the inspection and monitoring of buildings. The objective of the project is to study the acquisition and processing protocols which exist in the literature and to adapt them for UAV projects. This implies a study on the calibration of the sensors, flight planning, comparison of software solutions, data management, and analysis on the different products of a UAV project. Two historical buildings of the city of Strasbourg were used as case studies: a part of the Rohan Palace façade and the St-Pierre-le-Jeune Catholic church. In addition, a preliminary test was performed on the Josephine Pavilion. Two UAVs were used in this research; namely the Sensefly Albris and the DJI Phantom 3 Professional. The experiments have shown that the calibration parameters tend to be unstable for small sensors. Furthermore, the dense matching of images remains a particular problem to address in a close range photogrammetry project, more so in the presence of noise on the images. Data management in cases where the number of images is high is also very important. The UAV is nevertheless a suitable solution for the surveying and recording of historical buildings because it is able to take images from points of view which are normally inaccessible to classical terrestrial techniques.

  9. BP Network Control for Resource Allocation and QoS Ensurance in UAV Cloud

    Directory of Open Access Journals (Sweden)

    Ang Gao

    2018-01-01

    Full Text Available Unmanned aerial vehicle (UAV cloud can greatly enhance the intelligence of unmanned systems by dynamically unloading the compute-intensive applications to cloud. For the uncertain nature of UAV missions and fast-changing environment, different UAV applications may have different quality of service (QoS requirements. This paper proposes a mixed QoS ensurance and energy-balanced (MQEB architecture for UAV cloud from a view of control theory, which can support both hard and soft QoS ensurance with the consideration of energy saving. The hard and soft QoS requirements are decoupled by being normalized into a two-level cascaded feedback loop. The former is time slot loop (TS-Loop to enforce the absolute QoS ensurance for real-time applications, and the latter is contention window loop (CW-Loop to enforce the plastic QoS ensurance for non-real-time applications. Finally, the back propagating (BP neuron network is used for parameters’ self-tuning and controller design. The hardware experiments demonstrate the feasibility of MQEB. In heavy load, MQEB has greater throughput and better energy efficiency, and in light load, MQBE has lower total power consumption.

  10. Target Tracking in 3-D Using Estimation Based Nonlinear Control Laws for UAVs

    Directory of Open Access Journals (Sweden)

    Mousumi Ahmed

    2016-02-01

    Full Text Available This paper presents an estimation based backstepping like control law design for an Unmanned Aerial Vehicle (UAV to track a moving target in 3-D space. A ground-based sensor or an onboard seeker antenna provides range, azimuth angle, and elevation angle measurements to a chaser UAV that implements an extended Kalman filter (EKF to estimate the full state of the target. A nonlinear controller then utilizes this estimated target state and the chaser’s state to provide speed, flight path, and course/heading angle commands to the chaser UAV. Tracking performance with respect to measurement uncertainty is evaluated for three cases: (1 stationary white noise; (2 stationary colored noise and (3 non-stationary (range correlated white noise. Furthermore, in an effort to improve tracking performance, the measurement model is made more realistic by taking into consideration range-dependent uncertainties in the measurements, i.e., as the chaser closes in on the target, measurement uncertainties are reduced in the EKF, thus providing the UAV with more accurate control commands. Simulation results for these cases are shown to illustrate target state estimation and trajectory tracking performance.

  11. Next Generation UAV Based Spectral Systems for Environmental Monitoring

    Data.gov (United States)

    National Aeronautics and Space Administration — At present, UAVs used in environmental monitoring mostly collect low spectral resolution imagery, capable of retrieving canopy greenness or properties related water...

  12. Real-time Collision Avoidance and Path Optimizer for Semi-autonomous UAVs.

    Science.gov (United States)

    Hawary, A. F.; Razak, N. A.

    2018-05-01

    Whilst UAV offers a potentially cheaper and more localized observation platform than current satellite or land-based approaches, it requires an advance path planner to reveal its true potential, particularly in real-time missions. Manual control by human will have limited line-of-sights and prone to errors due to careless and fatigue. A good alternative solution is to equip the UAV with semi-autonomous capabilities that able to navigate via a pre-planned route in real-time fashion. In this paper, we propose an easy-and-practical path optimizer based on the classical Travelling Salesman Problem and adopts a brute force search method to re-optimize the route in the event of collisions using range finder sensor. The former utilizes a Simple Genetic Algorithm and the latter uses Nearest Neighbour algorithm. Both algorithms are combined to optimize the route and avoid collision at once. Although many researchers proposed various path planning algorithms, we find that it is difficult to integrate on a basic UAV model and often lacks of real-time collision detection optimizer. Therefore, we explore a practical benefit from this approach using on-board Arduino and Ardupilot controllers by manually emulating the motion of an actual UAV model prior to test on the flying site. The result showed that the range finder sensor provides a real-time data to the algorithm to find a collision-free path and eventually optimized the route successfully.

  13. Dual-Stack Single-Radio Communication Architecture for UAV Acting As a Mobile Node to Collect Data in WSNs.

    Science.gov (United States)

    Sayyed, Ali; de Araújo, Gustavo Medeiros; Bodanese, João Paulo; Becker, Leandro Buss

    2015-09-16

    The use of mobile nodes to collect data in a Wireless Sensor Network (WSN) has gained special attention over the last years. Some researchers explore the use of Unmanned Aerial Vehicles (UAVs) as mobile node for such data-collection purposes. Analyzing these works, it is apparent that mobile nodes used in such scenarios are typically equipped with at least two different radio interfaces. The present work presents a Dual-Stack Single-Radio Communication Architecture (DSSRCA), which allows a UAV to communicate in a bidirectional manner with a WSN and a Sink node. The proposed architecture was specifically designed to support different network QoS requirements, such as best-effort and more reliable communications, attending both UAV-to-WSN and UAV-to-Sink communications needs. DSSRCA was implemented and tested on a real UAV, as detailed in this paper. This paper also includes a simulation analysis that addresses bandwidth consumption in an environmental monitoring application scenario. It includes an analysis of the data gathering rate that can be achieved considering different UAV flight speeds. Obtained results show the viability of using a single radio transmitter for collecting data from the WSN and forwarding such data to the Sink node.

  14. Analysis of Landslide Kinematics using Multi-temporal UAV Imagery, La Honda, California

    Science.gov (United States)

    Carey, J.; Pickering, A.; Prentice, C. S.; Pinter, N.; DeLong, S.

    2017-12-01

    High-resolution topographic data are vital to studies of earth-surface processes. The combination of unmanned aerial vehicle (UAV) photography and structure-from-motion (SfM) digital photogrammetry provide a quickly deployable and cost-effective method for monitoring geomorphic change and landscape evolution. We acquired imagery of an active landslide in La Honda, California using a GPS-enabled quadcopter UAV with a 12.4 megapixel camera. Deep-seated landslides were previously documented in this region during the winter of 1997-98, with movement recurring and the landslide expanding during the winters of 2004-05 and 2005-06. This study documents the kinematics of a new and separate landslide immediately adjacent to the previous ones, throughout the winter of 2016-17. The roughly triangular-shaped, deep-seated landslide covers an area of approximately 10,000 m2. The area is underlain by SW dipping late Miocene to Pliocene sandstones and mudstones. A 3 m high head scarp stretches along the northeast portion of the slide for approximately 100 m. Internally, the direction of movement is towards the southwest, with two prominent NW-SE striking extensional grabens and numerous tension cracks across the landslide body. Here we calculate displaced landslide volumes and surface displacements from multi-temporal UAV surveys. Photogrammetric reconstruction of UAV/SfM-derived point clouds allowed creation of six digital elevation models (DEMs) with spatial resolutions ranging from 3 to 15 cm per pixel. We derived displacement magnitude, direction and rate by comparing multiple generations of DEMs and orthophotos, and estimated displaced volumes by differencing subsequent DEMs. We then correlated displacements with total rainfall and rainfall intensity measurements. Detailed geomorphic maps identify major landslide features, documenting dominant surface processes. Additionally, we compare the accuracy of the UAV/SfM-derived DEM with a DEM sourced from a synchronous terrestrial

  15. A guidance law for UAV autonomous aerial refueling based on the iterative computation method

    Directory of Open Access Journals (Sweden)

    Luo Delin

    2014-08-01

    Full Text Available The rendezvous and formation problem is a significant part for the unmanned aerial vehicle (UAV autonomous aerial refueling (AAR technique. It can be divided into two major phases: the long-range guidance phase and the formation phase. In this paper, an iterative computation guidance law (ICGL is proposed to compute a series of state variables to get the solution of a control variable for a UAV conducting rendezvous with a tanker in AAR. The proposed method can make the control variable converge to zero when the tanker and the UAV receiver come to a formation flight eventually. For the long-range guidance phase, the ICGL divides it into two sub-phases: the correction sub-phase and the guidance sub-phase. The two sub-phases share the same iterative process. As for the formation phase, a velocity coordinate system is created by which control accelerations are designed to make the speed of the UAV consistent with that of the tanker. The simulation results demonstrate that the proposed ICGL is effective and robust against wind disturbance.

  16. Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface.

    Science.gov (United States)

    Aleotti, Jacopo; Micconi, Giorgio; Caselli, Stefano; Benassi, Giacomo; Zambelli, Nicola; Bettelli, Manuele; Zappettini, Andrea

    2017-09-29

    A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source.

  17. Detection of the power lines in UAV remote sensed images using spectral-spatial methods.

    Science.gov (United States)

    Bhola, Rishav; Krishna, Nandigam Hari; Ramesh, K N; Senthilnath, J; Anand, Gautham

    2018-01-15

    In this paper, detection of the power lines on images acquired by Unmanned Aerial Vehicle (UAV) based remote sensing is carried out using spectral-spatial methods. Spectral clustering was performed using Kmeans and Expectation Maximization (EM) algorithm to classify the pixels into the power lines and non-power lines. The spectral clustering methods used in this study are parametric in nature, to automate the number of clusters Davies-Bouldin index (DBI) is used. The UAV remote sensed image is clustered into the number of clusters determined by DBI. The k clustered image is merged into 2 clusters (power lines and non-power lines). Further, spatial segmentation was performed using morphological and geometric operations, to eliminate the non-power line regions. In this study, UAV images acquired at different altitudes and angles were analyzed to validate the robustness of the proposed method. It was observed that the EM with spatial segmentation (EM-Seg) performed better than the Kmeans with spatial segmentation (Kmeans-Seg) on most of the UAV images. Copyright © 2017 Elsevier Ltd. All rights reserved.

  18. Active landslide monitoring using remote sensing data, GPS measurements and cameras on board UAV

    Science.gov (United States)

    Nikolakopoulos, Konstantinos G.; Kavoura, Katerina; Depountis, Nikolaos; Argyropoulos, Nikolaos; Koukouvelas, Ioannis; Sabatakakis, Nikolaos

    2015-10-01

    An active landslide can be monitored using many different methods: Classical geotechnical measurements like inclinometer, topographical survey measurements with total stations or GPS and photogrammetric techniques using airphotos or high resolution satellite images. As the cost of the aerial photo campaign and the acquisition of very high resolution satellite data is quite expensive the use of cameras on board UAV could be an identical solution. Small UAVs (Unmanned Aerial Vehicles) have started their development as expensive toys but they currently became a very valuable tool in remote sensing monitoring of small areas. The purpose of this work is to demonstrate a cheap but effective solution for an active landslide monitoring. We present the first experimental results of the synergistic use of UAV, GPS measurements and remote sensing data. A six-rotor aircraft with a total weight of 6 kg carrying two small cameras has been used. Very accurate digital airphotos, high accuracy DSM, DGPS measurements and the data captured from the UAV are combined and the results are presented in the current study.

  19. Bio-inspired UAV routing, source localization, and acoustic signature classification for persistent surveillance

    Science.gov (United States)

    Burman, Jerry; Hespanha, Joao; Madhow, Upamanyu; Pham, Tien

    2011-06-01

    A team consisting of Teledyne Scientific Company, the University of California at Santa Barbara and the Army Research Laboratory* is developing technologies in support of automated data exfiltration from heterogeneous battlefield sensor networks to enhance situational awareness for dismounts and command echelons. Unmanned aerial vehicles (UAV) provide an effective means to autonomously collect data from a sparse network of unattended ground sensors (UGSs) that cannot communicate with each other. UAVs are used to reduce the system reaction time by generating autonomous collection routes that are data-driven. Bio-inspired techniques for search provide a novel strategy to detect, capture and fuse data. A fast and accurate method has been developed to localize an event by fusing data from a sparse number of UGSs. This technique uses a bio-inspired algorithm based on chemotaxis or the motion of bacteria seeking nutrients in their environment. A unique acoustic event classification algorithm was also developed based on using swarm optimization. Additional studies addressed the problem of routing multiple UAVs, optimally placing sensors in the field and locating the source of gunfire at helicopters. A field test was conducted in November of 2009 at Camp Roberts, CA. The field test results showed that a system controlled by bio-inspired software algorithms can autonomously detect and locate the source of an acoustic event with very high accuracy and visually verify the event. In nine independent test runs of a UAV, the system autonomously located the position of an explosion nine times with an average accuracy of 3 meters. The time required to perform source localization using the UAV was on the order of a few minutes based on UAV flight times. In June 2011, additional field tests of the system will be performed and will include multiple acoustic events, optimal sensor placement based on acoustic phenomenology and the use of the International Technology Alliance (ITA

  20. Evaluating the accuracy of low cost UAV generated topography and its effectiveness for geomorphic change detection

    Science.gov (United States)

    Cook, Kristen

    2015-04-01

    With the recent explosion in the use and availability of unmanned aerial vehicle platforms and development of easy to use structure from motion (SfM) software, UAV based photogrammetry is increasingly being adopted to produce high resolution topography for the study of surface processes. UAV systems can vary substantially in price and complexity, but the tradeoffs between these and the quality of the resulting data are not well constrained. We look at one end of this spectrum and evaluate the effectiveness of a simple low cost UAV setup for obtaining high resolution topography in a challenging field setting. Our study site is the Daan River gorge in western Taiwan, a rapidly eroding bedrock gorge that we have monitored with terrestrial Lidar since 2009. The site presents challenges for the generation and analysis of high resolution topography, including vertical gorge walls, vegetation, wide variation in surface roughness, and a complicated 3D morphology. In order to evaluate the accuracy of the UAV-derived topography, we compare it with terrestrial Lidar data collected during the same survey period. Our UAV setup combines a DJI Phantom 2 quadcopter with a 16 megapixel Canon Powershot camera for a total platform cost of less than 850. The quadcopter is flown manually, and the camera is programmed to take a photograph every 4 seconds, yielding 200-250 pictures per flight. We measured ground control points and targets for both the Lidar scans and the aerial surveys using a Leica RTK GPS with 1-2 cm accuracy. UAV derived point clouds were obtained using Agisoft Photoscan software. We conducted both Lidar and UAV surveys before and after the 2014 typhoon season, allowing us to evaluate the reliability of the UAV survey to detect geomorphic changes in the range of one to several meters. The accuracy of the SfM point clouds depends strongly on the characteristics of the surface being considered, with vegetation and small scale texture causing inaccuracies. However, we

  1. Research on the attitude of small UAV based on MEMS devices

    Science.gov (United States)

    Shi, Xiaojie; Lu, Libin; Jin, Guodong; Tan, Lining

    2017-05-01

    This paper mainly introduces the research principle and implementation method of the small UAV navigation attitude system based on MEMS devices. The Gauss - Newton method based on least squares is used to calibrate the MEMS accelerometer and gyroscope for calibration. Improve the accuracy of the attitude by using the modified complementary filtering to correct the attitude angle error. The experimental data show that the design of the attitude and attitude system in this paper to meet the requirements of small UAV attitude accuracy to achieve a small, low cost.

  2. A Survey of Open-Source UAV Flight Controllers and Flight Simulators

    DEFF Research Database (Denmark)

    Ebeid, Emad Samuel Malki; Skriver, Martin; Terkildsen, Kristian Husum

    2018-01-01

    , which are all tightly linked to the UAV flight controller hardware and software. The lack of standardization of flight controller architectures and the use of proprietary closed-source flight controllers on many UAV platforms, however, complicates this work: solutions developed for one flight controller...... may be difficult to port to another without substantial extra development and testing. Using open-source flight controllers mitigates some of these challenges and enables other researchers to validate and build upon existing research. This paper presents a survey of the publicly available open...

  3. A Synthetic Teammate for UAV Applications: A Prospective Look

    National Research Council Canada - National Science Library

    Gluck, Kevin A; Ball, Jerry T; Gunzelmann, Glenn; Krusmark, Michael A; Lyon, Don R; Cooke, Nancy J

    2006-01-01

    This report describes current progress and future plans for research and development in synthetic teammates for applications in training, analysis, and system design for Uninhabited Aerial Vehicle (UAV) operations...

  4. COMPARISON OF UNCALIBRATED RGBVI WITH SPECTROMETER-BASED NDVI DERIVED FROM UAV SENSING SYSTEMS ON FIELD SCALE

    Directory of Open Access Journals (Sweden)

    G. Bareth

    2016-06-01

    Full Text Available The development of UAV-based sensing systems for agronomic applications serves the improvement of crop management. The latter is in the focus of precision agriculture which intends to optimize yield, fertilizer input, and crop protection. Besides, in some cropping systems vehicle-based sensing devices are less suitable because fields cannot be entered from certain growing stages onwards. This is true for rice, maize, sorghum, and many more crops. Consequently, UAV-based sensing approaches fill a niche of very high resolution data acquisition on the field scale in space and time. While mounting RGB digital compact cameras to low-weight UAVs (< 5 kg is well established, the miniaturization of sensors in the last years also enables hyperspectral data acquisition from those platforms. From both, RGB and hyperspectral data, vegetation indices (VIs are computed to estimate crop growth parameters. In this contribution, we compare two different sensing approaches from a low-weight UAV platform (< 5 kg for monitoring a nitrogen field experiment of winter wheat and a corresponding farmers’ field in Western Germany. (i A standard digital compact camera was flown to acquire RGB images which are used to compute the RGBVI and (ii NDVI is computed from a newly modified version of the Yara N-Sensor. The latter is a well-established tractor-based hyperspectral sensor for crop management and is available on the market since a decade. It was modified for this study to fit the requirements of UAV-based data acquisition. Consequently, we focus on three objectives in this contribution: (1 to evaluate the potential of the uncalibrated RGBVI for monitoring nitrogen status in winter wheat, (2 investigate the UAV-based performance of the modified Yara N-Sensor, and (3 compare the results of the two different UAV-based sensing approaches for winter wheat.

  5. A NEW APPROACH TO FAST MOSAIC UAV IMAGES

    Directory of Open Access Journals (Sweden)

    Q. Liu

    2012-09-01

    Full Text Available Unmanned Aerial Vehicles (UAVs have been widely used to acquire high quality terrain images of the areas of interest, particularly when such a task could potentially risk human life or even impossible as the areas cannot be accessed easily by surveyors. Once the images have been obtained, traditional photogrammetric processing process can be used to establish a relative orientation model and then, absolute orientation model with the procedures of space resection and intersection. In many such applications, the geo- referenced images which are stitched together to represent the geospatial relationships for the feature objects are sufficient. A fast or near real-time processing approach for UAV images using GPS/INS data has being investigated for years. One beneficial application of such approach is the capability of quick production of geo-referenced images for various engineering or business activities, such as urban and road planning, the site selection of factories and bridges, etc. In this paper, we have proposed a new fast processing approach for the UAV images collected with an integrated GPS/INS/Vision system. The approach features that the corresponding points between images have been determined, and then coordinate transformation is carried out to implement image stitching. The accuracy of corresponding points normally affects the quality of stitched images, but the results of our experiments revealed that the image stitching errors were obvious even the accuracy of corresponding points was high. The stitching errors could be caused by the changes of surface elevation.

  6. Solid images generated from UAVs to analyze areas affected by rock falls

    Science.gov (United States)

    Giordan, Daniele; Manconi, Andrea; Allasia, Paolo; Baldo, Marco

    2015-04-01

    The study of rock fall affected areas is usually based on the recognition of principal joints families and the localization of potential instable sectors. This requires the acquisition of field data, although as the areas are barely accessible and field inspections are often very dangerous. For this reason, remote sensing systems can be considered as suitable alternative. Recently, Unmanned Aerial Vehicles (UAVs) have been proposed as platform to acquire the necessary information. Indeed, mini UAVs (in particular in the multi-rotors configuration) provide versatility for the acquisition from different points of view a large number of high resolution optical images, which can be used to generate high resolution digital models relevant to the study area. By considering the recent development of powerful user-friendly software and algorithms to process images acquired from UAVs, there is now a need to establish robust methodologies and best-practice guidelines for correct use of 3D models generated in the context of rock fall scenarios. In this work, we show how multi-rotor UAVs can be used to survey areas by rock fall during real emergency contexts. We present two examples of application located in northwestern Italy: the San Germano rock fall (Piemonte region) and the Moneglia rock fall (Liguria region). We acquired data from both terrestrial LiDAR and UAV, in order to compare digital elevation models generated with different remote sensing approaches. We evaluate the volume of the rock falls, identify the areas potentially unstable, and recognize the main joints families. The use on is not so developed but probably this approach can be considered the better solution for a structural investigation of large rock walls. We propose a methodology that jointly considers the Structure from Motion (SfM) approach for the generation of 3D solid images, and a geotechnical analysis for the identification of joint families and potential failure planes.

  7. Stereo Vision Guiding for the Autonomous Landing of Fixed-Wing UAVs: A Saliency-Inspired Approach

    Directory of Open Access Journals (Sweden)

    Zhaowei Ma

    2016-03-01

    Full Text Available It is an important criterion for unmanned aerial vehicles (UAVs to land on the runway safely. This paper concentrates on stereo vision localization of a fixed-wing UAV's autonomous landing within global navigation satellite system (GNSS denied environments. A ground stereo vision guidance system imitating the human visual system (HVS is presented for the autonomous landing of fixed-wing UAVs. A saliency-inspired algorithm is presented and developed to detect flying UAV targets in captured sequential images. Furthermore, an extended Kalman filter (EKF based state estimation is employed to reduce localization errors caused by measurement errors of object detection and pan-tilt unit (PTU attitudes. Finally, stereo-vision-dataset-based experiments are conducted to verify the effectiveness of the proposed visual detection method and error correction algorithm. The compared results between the visual guidance approach and differential GPS-based approach indicate that the stereo vision system and detection method can achieve the better guiding effect.

  8. An efficient approach for video action classification based on 3d Zernike moments

    OpenAIRE

    Lassoued , Imen; Zagrouba , Ezzedine; Chahir , Youssef

    2011-01-01

    International audience; Action recognition in video and still image is one of the most challenging research topics in pattern recognition and computer vision. This paper proposes a new method for video action classification based on 3D Zernike moments. These last ones aim to capturing both structural and temporal information of a time varying sequence. The originality of this approach consists to represent actions in video sequences by a three-dimension shape obtained from different silhouett...

  9. Volcanic Plume Measurements with UAV (Invited)

    Science.gov (United States)

    Shinohara, H.; Kaneko, T.; Ohminato, T.

    2013-12-01

    Volatiles in magmas are the driving force of volcanic eruptions and quantification of volcanic gas flux and composition is important for the volcano monitoring. Recently we developed a portable gas sensor system (Multi-GAS) to quantify the volcanic gas composition by measuring volcanic plumes and obtained volcanic gas compositions of actively degassing volcanoes. As the Multi-GAS measures variation of volcanic gas component concentrations in the pumped air (volcanic plume), we need to bring the apparatus into the volcanic plume. Commonly the observer brings the apparatus to the summit crater by himself but such measurements are not possible under conditions of high risk of volcanic eruption or difficulty to approach the summit due to topography etc. In order to overcome these difficulties, volcanic plume measurements were performed by using manned and unmanned aerial vehicles. The volcanic plume measurements by manned aerial vehicles, however, are also not possible under high risk of eruption. The strict regulation against the modification of the aircraft, such as installing sampling pipes, also causes difficulty due to the high cost. Application of the UAVs for the volcanic plume measurements has a big advantage to avoid these problems. The Multi-GAS consists of IR-CO2 and H2O gas analyzer, SO2-H2O chemical sensors and H2 semiconductor sensor and the total weight ranges 3-6 kg including batteries. The necessary conditions of the UAV for the volcanic plumes measurements with the Multi-GAS are the payloads larger than 3 kg, maximum altitude larger than the plume height and installation of the sampling pipe without contamination of the exhaust gases, as the exhaust gases contain high concentrations of H2, SO2 and CO2. Up to now, three different types of UAVs were applied for the measurements; Kite-plane (Sky Remote) at Miyakejima operated by JMA, Unmanned airplane (Air Photo Service) at Shinomoedake, Kirishima volcano, and Unmanned helicopter (Yamaha) at Sakurajima

  10. Achievable Rates of UAV-Relayed Cooperative Cognitive Radio MIMO Systems

    KAUST Repository

    Sboui, Lokman; Ghazzai, Hakim; Rezki, Zouheir; Alouini, Mohamed-Slim

    2017-01-01

    We study the achievable rate of an uplink MIMO cognitive radio system where the primary user (PU) and the secondary user (SU) aim to communicate to the closest primary base station (BS) via a multi-access channel through the same unmanned aerial vehicle (UAV) relay. The SU message is then forwarded from the primary BS to the secondary network with a certain incentive reward as a part of the cooperation protocol between both networks. A special linear precoding scheme is proposed to enable the SU to exploit the PU free eigenmodes. We analyze two scenarios in which the UAV relay gain matrix is either fixed or optimized. We derive the optimal power allocation that maximizes the achievable rate of the SU respecting power budget, interference, and relay power constraints. Numerical results highlight the cognitive rate gain of our proposed scheme with respect to various problem parameters. We also highlight the effect of UAV altitude on the SU and PU rates. Finally, when the relay matrix is optimized, we show that the PU rate is remarkably enhanced and that the SU rate is only improved at high power regime.

  11. Achievable Rates of UAV-Relayed Cooperative Cognitive Radio MIMO Systems

    KAUST Repository

    Sboui, Lokman

    2017-04-19

    We study the achievable rate of an uplink MIMO cognitive radio system where the primary user (PU) and the secondary user (SU) aim to communicate to the closest primary base station (BS) via a multi-access channel through the same unmanned aerial vehicle (UAV) relay. The SU message is then forwarded from the primary BS to the secondary network with a certain incentive reward as a part of the cooperation protocol between both networks. A special linear precoding scheme is proposed to enable the SU to exploit the PU free eigenmodes. We analyze two scenarios in which the UAV relay gain matrix is either fixed or optimized. We derive the optimal power allocation that maximizes the achievable rate of the SU respecting power budget, interference, and relay power constraints. Numerical results highlight the cognitive rate gain of our proposed scheme with respect to various problem parameters. We also highlight the effect of UAV altitude on the SU and PU rates. Finally, when the relay matrix is optimized, we show that the PU rate is remarkably enhanced and that the SU rate is only improved at high power regime.

  12. UAV-Based Hyperspectral Remote Sensing for Precision Agriculture: Challenges and Opportunities

    Science.gov (United States)

    Angel, Y.; Parkes, S. D.; Turner, D.; Houborg, R.; Lucieer, A.; McCabe, M.

    2017-12-01

    Modern agricultural production relies on monitoring crop status by observing and measuring variables such as soil condition, plant health, fertilizer and pesticide effect, irrigation and crop yield. Managing all of these factors is a considerable challenge for crop producers. As such, providing integrated technological solutions that enable improved diagnostics of field condition to maximize profits, while minimizing environmental impacts, would be of much interest. Such challenges can be addressed by implementing remote sensing systems such as hyperspectral imaging to produce precise biophysical indicator maps across the various cycles of crop development. Recent progress in unmanned aerial vehicles (UAVs) have advanced traditional satellite-based capabilities, providing a capacity for high-spatial, spectral and temporal response. However, while some hyperspectral sensors have been developed for use onboard UAVs, significant investment is required to develop a system and data processing workflow that retrieves accurately georeferenced mosaics. Here we explore the use of a pushbroom hyperspectral camera that is integrated on-board a multi-rotor UAV system to measure the surface reflectance in 272 distinct spectral bands across a wavelengths range spanning 400-1000 nm, and outline the requirement for sensor calibration, integration onto a stable UAV platform enabling accurate positional data, flight planning, and development of data post-processing workflows for georeferenced mosaics. The provision of high-quality and geo-corrected imagery facilitates the development of metrics of vegetation health that can be used to identify potential problems such as production inefficiencies, diseases and nutrient deficiencies and other data-streams to enable improved crop management. Immense opportunities remain to be exploited in the implementation of UAV-based hyperspectral sensing (and its combination with other imaging systems) to provide a transferable and scalable

  13. Applications of UAV Photogrammetric Surveys to Natural Hazard Detection and Cultural Heritage Documentation

    Science.gov (United States)

    Trizzino, Rosamaria; Caprioli, Mauro; Mazzone, Francesco; Scarano, Mario

    2017-04-01

    Unmanned Aerial Vehicle (UAV) systems are increasingly seen as an attractive low-cost alternative or supplement to aerial and terrestrial photogrammetry due to their low cost, flexibility, availability and readiness for duty. In addition, UAVs can be operated in hazardous or temporarily inaccessible locations. The combination of photogrammetric aerial and terrestrial recording methods using a mini UAV (also known as "drone") opens a broad range of applications, such as surveillance and monitoring of the environment and infrastructural assets. In particular, these methods and techniques are of paramount interest for the documentation of cultural heritage sites and areas of natural importance, facing threats from natural deterioration and hazards. In order to verify the reliability of these technologies an UAV survey and a LIDAR survey have been carried out along about 1 km of coast in the Salento peninsula, near the towns of San Foca, Torre dell' Orso and SantAndrea ( Lecce, Southern Italy). This area is affected by serious environmental hazards due to the presence of dangerous rocky cliffs named "falesie". The UAV platform was equipped with a photogrammetric measurement system that allowed us to obtain a mobile mapping of the fractured fronts of dangerous rocky cliffs. UAV-images data have been processed using dedicated software (Agisoft Photoscan). The point clouds obtained from both the UAV and LIDAR surveys have been processed using Cloud Compare software, with the aim of testing the UAV results with respect to the LIDAR ones. The analysis were done using the C2C algorithm which provides good results in terms of Euclidian distances, highlighting differences between the 3D models obtained from both the survey techiques. The total error obtained was of centimeter-order that is a very satisfactory result. In the the 2nd study area, the opportunities of obtaining more detailed documentation of cultural goods throughout UAV survey have been investigated. The study

  14. Defect detection on videos using neural network

    Directory of Open Access Journals (Sweden)

    Sizyakin Roman

    2017-01-01

    Full Text Available In this paper, we consider a method for defects detection in a video sequence, which consists of three main steps; frame compensation, preprocessing by a detector, which is base on the ranking of pixel values, and the classification of all pixels having anomalous values using convolutional neural networks. The effectiveness of the proposed method shown in comparison with the known techniques on several frames of the video sequence with damaged in natural conditions. The analysis of the obtained results indicates the high efficiency of the proposed method. The additional use of machine learning as postprocessing significantly reduce the likelihood of false alarm.

  15. Development of a compact light weight DELRAD probe and its integration with UAV NETRA for aerial radiation surveillance

    International Nuclear Information System (INIS)

    Prasad, Mahaveer; Yadav, Ashok Kumar; Gupta, D.K.; Bhatnagar, Vivek; Singh, Chiman; Mishrilal

    2018-01-01

    The DEfence Laboratory RAdiation Detector - 'DELRAD' is an indigenously developed Hybrid Micro Circuit Module employing Si PIN diodes for detection of gamma radiation. Using this as a detector, the 'DELRAD Probe' has been designed and developed specifically for the UAV, NETRA for aerial surveillance of the nuclear affected areas. The critical requirement of very light weight radiation sensor as payload (<50gm) for the UAV NETRA is met by designing this Probe weighing approx. 40gm. The sensor is capable of measuring gamma radiation levels from 1mR/h to 1000R/h. The Probe has been tested, calibrated and integrated with the UAV NETRA. In addition to this, the radiation testing during flight of UAV NETRA integrated with DELRAD probe has also been carried out and results have been recorded. The work carried out proves the capability of Defence Laboratory, Jodhpur, (DRDO) in the area of 'Aerial Surveillance of Nuclear Radiation Affected Area' using Unmanned Aerial Vehicles (UAVs)

  16. Adaptation of Dubins Paths for UAV Ground Obstacle Avoidance When Using a Low Cost On-Board GNSS Sensor

    Directory of Open Access Journals (Sweden)

    Ramūnas Kikutis

    2017-09-01

    Full Text Available Current research on Unmanned Aerial Vehicles (UAVs shows a lot of interest in autonomous UAV navigation. This interest is mainly driven by the necessity to meet the rules and restrictions for small UAV flights that are issued by various international and national legal organizations. In order to lower these restrictions, new levels of automation and flight safety must be reached. In this paper, a new method for ground obstacle avoidance derived by using UAV navigation based on the Dubins paths algorithm is presented. The accuracy of the proposed method has been tested, and research results have been obtained by using Software-in-the-Loop (SITL simulation and real UAV flights, with the measurements done with a low cost Global Navigation Satellite System (GNSS sensor. All tests were carried out in a three-dimensional space, but the height accuracy was not assessed. The GNSS navigation data for the ground obstacle avoidance algorithm is evaluated statistically.

  17. Adaptation of Dubins Paths for UAV Ground Obstacle Avoidance When Using a Low Cost On-Board GNSS Sensor.

    Science.gov (United States)

    Kikutis, Ramūnas; Stankūnas, Jonas; Rudinskas, Darius; Masiulionis, Tadas

    2017-09-28

    Current research on Unmanned Aerial Vehicles (UAVs) shows a lot of interest in autonomous UAV navigation. This interest is mainly driven by the necessity to meet the rules and restrictions for small UAV flights that are issued by various international and national legal organizations. In order to lower these restrictions, new levels of automation and flight safety must be reached. In this paper, a new method for ground obstacle avoidance derived by using UAV navigation based on the Dubins paths algorithm is presented. The accuracy of the proposed method has been tested, and research results have been obtained by using Software-in-the-Loop (SITL) simulation and real UAV flights, with the measurements done with a low cost Global Navigation Satellite System (GNSS) sensor. All tests were carried out in a three-dimensional space, but the height accuracy was not assessed. The GNSS navigation data for the ground obstacle avoidance algorithm is evaluated statistically.

  18. Perancangan dan Implementasi Kontroler PID untuk Pengaturan Heading dan Pengaturan Arah pada Fixed-Wing Unmanned Aerial Vehicle (UAV

    Directory of Open Access Journals (Sweden)

    Hery setyo widodo

    2012-09-01

    Full Text Available UAV (Unmanned Aerial Vehicle merupakan kendaraan udara tanpa awak yang dikendalikan dari jarak jauh oleh atau tanpa seorang pilot (Autopilot. Kontrol pesawat UAV ada dua variasi utama, variasi pertama yaitu dikontrol melalui pengendali jarak jauh dan variasi kedua adalah pesawat yang terbang secara mandiri berdasarkan program yang dimasukan. Sebuah fixed-winng UAV harus mampu mempertahankan posisinya pada lintasan yang sudah ditentukan selama melakukan tracking lintasan. Keakuratan dalam tracking arah dan heading pesawat sangat berpengaruh terhadap keberhasilan misi penerbangan pesawat UAV dalam memperthankan lintasannya untuk mencapai target. Oleh karena itu pada Tugas Akhir ini dirancang sistem pengaturan dengan menggunakan metode kontrol PID untuk mengatasi kesalahan dalam menjaga lintasan pesawat. Pengaturan arah dan heading pesawat UAV dilakukan dengan memanfaatkan dinamika gerak lateral yang meliputi gerak roll dan yaw dan input dari GPS (Global Positioning System. Dari simulasi diperoleh proses tracking dapat mengikuti rancangan gerak yang diinginkan Pergeseran lintasan pesawat pada saat implementasi kontroler PID disebabkan akurasi GPS yang masih rendah yaitu 3 meter.

  19. Small VTOL UAV Acoustics Measurement and Prediction, Phase I

    Data.gov (United States)

    National Aeronautics and Space Administration — Interest in civilian use of small Unmanned Aerial Vehicles (UAVs) with Vertical Takeoff and Landing (VTOL) capability has increased greatly in recent years, and is...

  20. A Stepped Frequency CW SAR for Lightweight UAV Operation

    National Research Council Canada - National Science Library

    Morrison, Keith

    2005-01-01

    A stepped-frequency continuous wave (SF-CW) synthetic aperture radar (SAR), with frequency-agile waveforms and real-time intelligent signal processing algorithms, is proposed for operation from a lightweight UAV platform...

  1. Moving object detection using dynamic motion modelling from UAV aerial images.

    Science.gov (United States)

    Saif, A F M Saifuddin; Prabuwono, Anton Satria; Mahayuddin, Zainal Rasyid

    2014-01-01

    Motion analysis based moving object detection from UAV aerial image is still an unsolved issue due to inconsideration of proper motion estimation. Existing moving object detection approaches from UAV aerial images did not deal with motion based pixel intensity measurement to detect moving object robustly. Besides current research on moving object detection from UAV aerial images mostly depends on either frame difference or segmentation approach separately. There are two main purposes for this research: firstly to develop a new motion model called DMM (dynamic motion model) and secondly to apply the proposed segmentation approach SUED (segmentation using edge based dilation) using frame difference embedded together with DMM model. The proposed DMM model provides effective search windows based on the highest pixel intensity to segment only specific area for moving object rather than searching the whole area of the frame using SUED. At each stage of the proposed scheme, experimental fusion of the DMM and SUED produces extracted moving objects faithfully. Experimental result reveals that the proposed DMM and SUED have successfully demonstrated the validity of the proposed methodology.

  2. Video quality pooling adaptive to perceptual distortion severity.

    Science.gov (United States)

    Park, Jincheol; Seshadrinathan, Kalpana; Lee, Sanghoon; Bovik, Alan Conrad

    2013-02-01

    It is generally recognized that severe video distortions that are transient in space and/or time have a large effect on overall perceived video quality. In order to understand this phenomena, we study the distribution of spatio-temporally local quality scores obtained from several video quality assessment (VQA) algorithms on videos suffering from compression and lossy transmission over communication channels. We propose a content adaptive spatial and temporal pooling strategy based on the observed distribution. Our method adaptively emphasizes "worst" scores along both the spatial and temporal dimensions of a video sequence and also considers the perceptual effect of large-area cohesive motion flow such as egomotion. We demonstrate the efficacy of the method by testing it using three different VQA algorithms on the LIVE Video Quality database and the EPFL-PoliMI video quality database.

  3. SKYLARK - A crossbow-launched micro scale cheap UAV for close aerial surveillance

    OpenAIRE

    Alexandru-Marius PANAIT

    2012-01-01

    Close air support of ground troops especially in densely populated, urban environments has an ever increasing prevalence in the modern warfare. Counter-terrorism activities as well as land-based “surgical strikes” impose a set of special requirements on all the used weapons and equipment so as to minimize weight, cost and complexity and maximize efficiency. Small scale UAVs are in service with all the armed forces around the globe; micro UAVs are emerging as the ground troop close support pre...

  4. Omnidirectional vision applied to Unmanned Aerial Vehicles (UAVs) attitude and heading estimation

    OpenAIRE

    Mondragon, Ivan F.; Campoy, Pascual; Martinez, Carol; Olivares Mendez, Miguel Angel

    2010-01-01

    This paper presents an aircraft attitude and heading estimator using catadioptric images as a principal sensor for UAV or as a redundant system for IMU (Inertial Measure Unit) and gyro sensors. First, we explain how the unified theory for central catadioptric cameras is used for attitude and heading estimation, explaining how the skyline is projected on the catadioptric image and how it is segmented and used to calculate the UAV's attitude. Then, we use appearance images to obtain a visual co...

  5. DETERMINING OPTIMAL CUBE FOR 3D-DCT BASED VIDEO COMPRESSION FOR DIFFERENT MOTION LEVELS

    Directory of Open Access Journals (Sweden)

    J. Augustin Jacob

    2012-11-01

    Full Text Available This paper proposes new three dimensional discrete cosine transform (3D-DCT based video compression algorithm that will select the optimal cube size based on the motion content of the video sequence. It is determined by finding normalized pixel difference (NPD values, and by categorizing the cubes as “low” or “high” motion cube suitable cube size of dimension either [16×16×8] or[8×8×8] is chosen instead of fixed cube algorithm. To evaluate the performance of the proposed algorithm test sequence with different motion levels are chosen. By doing rate vs. distortion analysis the level of compression that can be achieved and the quality of reconstructed video sequence are determined and compared against fixed cube size algorithm. Peak signal to noise ratio (PSNR is taken to measure the video quality. Experimental result shows that varying the cube size with reference to the motion content of video frames gives better performance in terms of compression ratio and video quality.

  6. Low-Complexity Multiple Description Coding of Video Based on 3D Block Transforms

    Directory of Open Access Journals (Sweden)

    Andrey Norkin

    2007-02-01

    Full Text Available The paper presents a multiple description (MD video coder based on three-dimensional (3D transforms. Two balanced descriptions are created from a video sequence. In the encoder, video sequence is represented in a form of coarse sequence approximation (shaper included in both descriptions and residual sequence (details which is split between two descriptions. The shaper is obtained by block-wise pruned 3D-DCT. The residual sequence is coded by 3D-DCT or hybrid, LOT+DCT, 3D-transform. The coding scheme is targeted to mobile devices. It has low computational complexity and improved robustness of transmission over unreliable networks. The coder is able to work at very low redundancies. The coding scheme is simple, yet it outperforms some MD coders based on motion-compensated prediction, especially in the low-redundancy region. The margin is up to 3 dB for reconstruction from one description.

  7. Direct Georeferencing of Uav Data Based on Simple Building Structures

    Science.gov (United States)

    Tampubolon, W.; Reinhardt, W.

    2016-06-01

    Unmanned Aerial Vehicle (UAV) data acquisition is more flexible compared with the more complex traditional airborne data acquisition. This advantage puts UAV platforms in a position as an alternative acquisition method in many applications including Large Scale Topographical Mapping (LSTM). LSTM, i.e. larger or equal than 1:10.000 map scale, is one of a number of prominent priority tasks to be solved in an accelerated way especially in third world developing countries such as Indonesia. As one component of fundamental geospatial data sets, large scale topographical maps are mandatory in order to enable detailed spatial planning. However, the accuracy of the products derived from the UAV data are normally not sufficient for LSTM as it needs robust georeferencing, which requires additional costly efforts such as the incorporation of sophisticated GPS Inertial Navigation System (INS) or Inertial Measurement Unit (IMU) on the platform and/or Ground Control Point (GCP) data on the ground. To reduce the costs and the weight on the UAV alternative solutions have to be found. This paper outlines a direct georeferencing method of UAV data by providing image orientation parameters derived from simple building structures and presents results of an investigation on the achievable results in a LSTM application. In this case, the image orientation determination has been performed through sequential images without any input from INS/IMU equipment. The simple building structures play a significant role in such a way that geometrical characteristics have been considered. Some instances are the orthogonality of the building's wall/rooftop and the local knowledge of the building orientation in the field. In addition, we want to include the Structure from Motion (SfM) approach in order to reduce the number of required GCPs especially for the absolute orientation purpose. The SfM technique applied to the UAV data and simple building structures additionally presents an effective tool

  8. DIRECT GEOREFERENCING OF UAV DATA BASED ON SIMPLE BUILDING STRUCTURES

    Directory of Open Access Journals (Sweden)

    W. Tampubolon

    2016-06-01

    Full Text Available Unmanned Aerial Vehicle (UAV data acquisition is more flexible compared with the more complex traditional airborne data acquisition. This advantage puts UAV platforms in a position as an alternative acquisition method in many applications including Large Scale Topographical Mapping (LSTM. LSTM, i.e. larger or equal than 1:10.000 map scale, is one of a number of prominent priority tasks to be solved in an accelerated way especially in third world developing countries such as Indonesia. As one component of fundamental geospatial data sets, large scale topographical maps are mandatory in order to enable detailed spatial planning. However, the accuracy of the products derived from the UAV data are normally not sufficient for LSTM as it needs robust georeferencing, which requires additional costly efforts such as the incorporation of sophisticated GPS Inertial Navigation System (INS or Inertial Measurement Unit (IMU on the platform and/or Ground Control Point (GCP data on the ground. To reduce the costs and the weight on the UAV alternative solutions have to be found. This paper outlines a direct georeferencing method of UAV data by providing image orientation parameters derived from simple building structures and presents results of an investigation on the achievable results in a LSTM application. In this case, the image orientation determination has been performed through sequential images without any input from INS/IMU equipment. The simple building structures play a significant role in such a way that geometrical characteristics have been considered. Some instances are the orthogonality of the building’s wall/rooftop and the local knowledge of the building orientation in the field. In addition, we want to include the Structure from Motion (SfM approach in order to reduce the number of required GCPs especially for the absolute orientation purpose. The SfM technique applied to the UAV data and simple building structures additionally presents an

  9. Dynamic Textures Modeling via Joint Video Dictionary Learning.

    Science.gov (United States)

    Wei, Xian; Li, Yuanxiang; Shen, Hao; Chen, Fang; Kleinsteuber, Martin; Wang, Zhongfeng

    2017-04-06

    Video representation is an important and challenging task in the computer vision community. In this paper, we consider the problem of modeling and classifying video sequences of dynamic scenes which could be modeled in a dynamic textures (DT) framework. At first, we assume that image frames of a moving scene can be modeled as a Markov random process. We propose a sparse coding framework, named joint video dictionary learning (JVDL), to model a video adaptively. By treating the sparse coefficients of image frames over a learned dictionary as the underlying "states", we learn an efficient and robust linear transition matrix between two adjacent frames of sparse events in time series. Hence, a dynamic scene sequence is represented by an appropriate transition matrix associated with a dictionary. In order to ensure the stability of JVDL, we impose several constraints on such transition matrix and dictionary. The developed framework is able to capture the dynamics of a moving scene by exploring both sparse properties and the temporal correlations of consecutive video frames. Moreover, such learned JVDL parameters can be used for various DT applications, such as DT synthesis and recognition. Experimental results demonstrate the strong competitiveness of the proposed JVDL approach in comparison with state-of-the-art video representation methods. Especially, it performs significantly better in dealing with DT synthesis and recognition on heavily corrupted data.

  10. Fleet Protection Using a Small UAV Based IR Sensor

    National Research Council Canada - National Science Library

    Buss, James R; Ax, Jr, George R

    2005-01-01

    A study was performed to define candidate electro-optical and infrared (EO/IR) sensor configurations and assess their potential utility as small UAV-based sensors surveilling a perimeter around surface fleet assets...

  11. Dual-Stack Single-Radio Communication Architecture for UAV Acting As a Mobile Node to Collect Data in WSNs

    Directory of Open Access Journals (Sweden)

    Ali Sayyed

    2015-09-01

    Full Text Available The use of mobile nodes to collect data in a Wireless Sensor Network (WSN has gained special attention over the last years. Some researchers explore the use of Unmanned Aerial Vehicles (UAVs as mobile node for such data-collection purposes. Analyzing these works, it is apparent that mobile nodes used in such scenarios are typically equipped with at least two different radio interfaces. The present work presents a Dual-Stack Single-Radio Communication Architecture (DSSRCA, which allows a UAV to communicate in a bidirectional manner with a WSN and a Sink node. The proposed architecture was specifically designed to support different network QoS requirements, such as best-effort and more reliable communications, attending both UAV-to-WSN and UAV-to-Sink communications needs. DSSRCA was implemented and tested on a real UAV, as detailed in this paper. This paper also includes a simulation analysis that addresses bandwidth consumption in an environmental monitoring application scenario. It includes an analysis of the data gathering rate that can be achieved considering different UAV flight speeds. Obtained results show the viability of using a single radio transmitter for collecting data from the WSN and forwarding such data to the Sink node.

  12. Learning from Narrated Instruction Videos.

    Science.gov (United States)

    Alayrac, Jean-Baptiste; Bojanowski, Piotr; Agrawal, Nishant; Sivic, Josef; Laptev, Ivan; Lacoste-Julien, Simon

    2017-09-05

    Automatic assistants could guide a person or a robot in performing new tasks, such as changing a car tire or repotting a plant. Creating such assistants, however, is non-trivial and requires understanding of visual and verbal content of a video. Towards this goal, we here address the problem of automatically learning the main steps of a task from a set of narrated instruction videos. We develop a new unsupervised learning approach that takes advantage of the complementary nature of the input video and the associated narration. The method sequentially clusters textual and visual representations of a task, where the two clustering problems are linked by joint constraints to obtain a single coherent sequence of steps in both modalities. To evaluate our method, we collect and annotate a new challenging dataset of real-world instruction videos from the Internet. The dataset contains videos for five different tasks with complex interactions between people and objects, captured in a variety of indoor and outdoor settings. We experimentally demonstrate that the proposed method can automatically discover, learn and localize the main steps of a task input videos.

  13. Moving object detection in top-view aerial videos improved by image stacking

    Science.gov (United States)

    Teutsch, Michael; Krüger, Wolfgang; Beyerer, Jürgen

    2017-08-01

    Image stacking is a well-known method that is used to improve the quality of images in video data. A set of consecutive images is aligned by applying image registration and warping. In the resulting image stack, each pixel has redundant information about its intensity value. This redundant information can be used to suppress image noise, resharpen blurry images, or even enhance the spatial image resolution as done in super-resolution. Small moving objects in the videos usually get blurred or distorted by image stacking and thus need to be handled explicitly. We use image stacking in an innovative way: image registration is applied to small moving objects only, and image warping blurs the stationary background that surrounds the moving objects. Our video data are coming from a small fixed-wing unmanned aerial vehicle (UAV) that acquires top-view gray-value images of urban scenes. Moving objects are mainly cars but also other vehicles such as motorcycles. The resulting images, after applying our proposed image stacking approach, are used to improve baseline algorithms for vehicle detection and segmentation. We improve precision and recall by up to 0.011, which corresponds to a reduction of the number of false positive and false negative detections by more than 3 per second. Furthermore, we show how our proposed image stacking approach can be implemented efficiently.

  14. Neural network-based optimal adaptive output feedback control of a helicopter UAV.

    Science.gov (United States)

    Nodland, David; Zargarzadeh, Hassan; Jagannathan, Sarangapani

    2013-07-01

    Helicopter unmanned aerial vehicles (UAVs) are widely used for both military and civilian operations. Because the helicopter UAVs are underactuated nonlinear mechanical systems, high-performance controller design for them presents a challenge. This paper introduces an optimal controller design via an output feedback for trajectory tracking of a helicopter UAV, using a neural network (NN). The output-feedback control system utilizes the backstepping methodology, employing kinematic and dynamic controllers and an NN observer. The online approximator-based dynamic controller learns the infinite-horizon Hamilton-Jacobi-Bellman equation in continuous time and calculates the corresponding optimal control input by minimizing a cost function, forward-in-time, without using the value and policy iterations. Optimal tracking is accomplished by using a single NN utilized for the cost function approximation. The overall closed-loop system stability is demonstrated using Lyapunov analysis. Finally, simulation results are provided to demonstrate the effectiveness of the proposed control design for trajectory tracking.

  15. Using Natural Language to Enable Mission Managers to Control Multiple Heterogeneous UAVs

    Science.gov (United States)

    Trujillo, Anna C.; Puig-Navarro, Javier; Mehdi, S. Bilal; Mcquarry, A. Kyle

    2016-01-01

    The availability of highly capable, yet relatively cheap, unmanned aerial vehicles (UAVs) is opening up new areas of use for hobbyists and for commercial activities. This research is developing methods beyond classical control-stick pilot inputs, to allow operators to manage complex missions without in-depth vehicle expertise. These missions may entail several heterogeneous UAVs flying coordinated patterns or flying multiple trajectories deconflicted in time or space to predefined locations. This paper describes the functionality and preliminary usability measures of an interface that allows an operator to define a mission using speech inputs. With a defined and simple vocabulary, operators can input the vast majority of mission parameters using simple, intuitive voice commands. Although the operator interface is simple, it is based upon autonomous algorithms that allow the mission to proceed with minimal input from the operator. This paper also describes these underlying algorithms that allow an operator to manage several UAVs.

  16. SKYLARK - A crossbow-launched micro scale cheap UAV for close aerial surveillance

    Directory of Open Access Journals (Sweden)

    Alexandru-Marius PANAIT

    2012-03-01

    Full Text Available Close air support of ground troops especially in densely populated, urban environments has an ever increasing prevalence in the modern warfare. Counter-terrorism activities as well as land-based “surgical strikes” impose a set of special requirements on all the used weapons and equipment so as to minimize weight, cost and complexity and maximize efficiency. Small scale UAVs are in service with all the armed forces around the globe; micro UAVs are emerging as the ground troop close support preferred solution. Endurance and range of these devices is regularly small to very small, and their speed is low. Their small size makes them virtually un-targetable if somewhat still detectable. A new generation of micro-drones is proposed, with a higher speed (up to 350 km/h ground speed averaged and automatic recovery system. Project SKYLARK consists of a reusable minimal micro-UAV featuring a portable micro-USB camera and an aerodynamically assisted timer-based recovery system.

  17. Camera network video summarization

    Science.gov (United States)

    Panda, Rameswar; Roy-Chowdhury, Amit K.

    2017-05-01

    Networks of vision sensors are deployed in many settings, ranging from security needs to disaster response to environmental monitoring. Many of these setups have hundreds of cameras and tens of thousands of hours of video. The difficulty of analyzing such a massive volume of video data is apparent whenever there is an incident that requires foraging through vast video archives to identify events of interest. As a result, video summarization, that automatically extract a brief yet informative summary of these videos, has attracted intense attention in the recent years. Much progress has been made in developing a variety of ways to summarize a single video in form of a key sequence or video skim. However, generating a summary from a set of videos captured in a multi-camera network still remains as a novel and largely under-addressed problem. In this paper, with the aim of summarizing videos in a camera network, we introduce a novel representative selection approach via joint embedding and capped l21-norm minimization. The objective function is two-fold. The first is to capture the structural relationships of data points in a camera network via an embedding, which helps in characterizing the outliers and also in extracting a diverse set of representatives. The second is to use a capped l21-norm to model the sparsity and to suppress the influence of data outliers in representative selection. We propose to jointly optimize both of the objectives, such that embedding can not only characterize the structure, but also indicate the requirements of sparse representative selection. Extensive experiments on standard multi-camera datasets well demonstrate the efficacy of our method over state-of-the-art methods.

  18. A fully convolutional network for weed mapping of unmanned aerial vehicle (UAV) imagery.

    Science.gov (United States)

    Huang, Huasheng; Deng, Jizhong; Lan, Yubin; Yang, Aqing; Deng, Xiaoling; Zhang, Lei

    2018-01-01

    Appropriate Site Specific Weed Management (SSWM) is crucial to ensure the crop yields. Within SSWM of large-scale area, remote sensing is a key technology to provide accurate weed distribution information. Compared with satellite and piloted aircraft remote sensing, unmanned aerial vehicle (UAV) is capable of capturing high spatial resolution imagery, which will provide more detailed information for weed mapping. The objective of this paper is to generate an accurate weed cover map based on UAV imagery. The UAV RGB imagery was collected in 2017 October over the rice field located in South China. The Fully Convolutional Network (FCN) method was proposed for weed mapping of the collected imagery. Transfer learning was used to improve generalization capability, and skip architecture was applied to increase the prediction accuracy. After that, the performance of FCN architecture was compared with Patch_based CNN algorithm and Pixel_based CNN method. Experimental results showed that our FCN method outperformed others, both in terms of accuracy and efficiency. The overall accuracy of the FCN approach was up to 0.935 and the accuracy for weed recognition was 0.883, which means that this algorithm is capable of generating accurate weed cover maps for the evaluated UAV imagery.

  19. Compression evaluation of surgery video recordings retaining diagnostic credibility (compression evaluation of surgery video)

    Science.gov (United States)

    Duplaga, M.; Leszczuk, M. I.; Papir, Z.; Przelaskowski, A.

    2008-12-01

    Wider dissemination of medical digital video libraries is affected by two correlated factors, resource effective content compression that directly influences its diagnostic credibility. It has been proved that it is possible to meet these contradictory requirements halfway for long-lasting and low motion surgery recordings at compression ratios close to 100 (bronchoscopic procedures were a case study investigated). As the main supporting assumption, it has been accepted that the content can be compressed as far as clinicians are not able to sense a loss of video diagnostic fidelity (a visually lossless compression). Different market codecs were inspected by means of the combined subjective and objective tests toward their usability in medical video libraries. Subjective tests involved a panel of clinicians who had to classify compressed bronchoscopic video content according to its quality under the bubble sort algorithm. For objective tests, two metrics (hybrid vector measure and hosaka Plots) were calculated frame by frame and averaged over a whole sequence.

  20. Interference analysis for UAV connectivity over LTE using aerial radio measurements

    DEFF Research Database (Denmark)

    Kovacs, Istvan; Amorim, Rafhael Medeiros de; Nguyen, Huan Cong

    2017-01-01

    . In this paper, we use empirical measurements in live rural LTE networks to assess the impact of uplink and downlink radio interference on the UAV radio connectivity performance. Further, we provide a baseline analysis on the potential of interference mitigation schemes, needed to provide a reliable radio...... for these services is that the radio communication link must reliably cover a wide(er) area, when compared to the visual-line-of-sight range radio links currently used. Standardized cellular systems such as Long Term Evolution UMTS (LTE), are an obvious candidate to provide the radio communication link to UAVs...