Nijholt, Antinus; Dijk, Esko O.; Lemmens, Paul M.C.; Luitjens, S.B.
The intention of the symposium on Haptic and Audio-visual stimuli at the EuroHaptics 2010 conference is to deepen the understanding of the effect of combined Haptic and Audio-visual stimuli. The knowledge gained will be used to enhance experiences and interactions in daily life. To this end, a
The sensory channel of presentation alters subjective ratings and autonomic responses towards disgusting stimuli -Blood pressure, heart rate and skin conductance in response to visual, auditory, haptic and olfactory presented disgusting stimuli-
Full Text Available Disgust causes specific reaction patterns, observable in mimic responses and body reactions. Most research on disgust deals with visual stimuli. However, pictures may cause another disgust experience than sounds, odors or tactile stimuli. Therefore disgust experience evoked by four different sensory channels was compared.A total of 119 participants received 3 different disgusting and one control stimulus, each presented through the visual, auditory, tactile and olfactory channel. Ratings of evoked disgust as well as responses of the autonomic nervous system (heart rate, skin conductance level, systolic blood pressure were recorded and the effect of stimulus labeling and of repeated presentation was analyzed. Ratings suggested that disgust could be evoked through all senses; they were highest for visual stimuli. However, autonomic reaction towards disgusting stimuli differed according to the channel of presentation. In contrast to the other, olfactory disgust stimuli provoked a strong decrease of systolic blood pressure. Additionally, labeling enhanced disgust ratings and autonomic reaction for olfactory and tactile, but not for visual and auditory stimuli. Repeated presentation indicated that participant’s disgust rating diminishes to all but olfactory disgust stimuli. Taken together we argue that the sensory channel through which a disgust reaction is evoked matters.
Zhang, Shusheng; Wang, Dangxiao; Afzal, Naqash; Zhang, Yuru; Wu, Ruilin
Brainwave entrainment using rhythmic visual and/or auditory stimulation has shown its efficacy in modulating neural activities and cognitive ability. In the presented study, we aim to investigate whether rhythmic haptic stimulation could enhance short-term attention. An experiment with sensorimotor rhythm (SMR) increasing protocol was performed in which participants were presented sinusoidal vibrotactile stimulus of 15 Hz on their palm. Test of Variables of Attention (T.O.V.A.) was performed before and after the stimulating session. Electroencephalograph (EEG) was recorded across the stimulating session and the two attention test sessions. SMR band power manifested a significant increase after stimulation. Results of T.O.V.A. tests indicated an improvement in the attention of participants who had received the stimulation compared to the control group who had not received the stimulation. The D prime score of T.O.V.A. reveals that participants performed better in perceptual sensitivity and sustaining attention level compared to their baseline performance before the stimulating session. These findings highlight the potential value of using haptics-based brainwave entrainment for cognitive training.
Bouwer, A.; Holland, S.; Dalgleish, M.; Holland, S.; Wilkie, K.; Mulholland, P.; Seago, A.
The Haptic Bracelets are a system designed to help people learn multi-limbed rhythms (which involve multiple simultaneous rhythmic patterns) while they carry out other tasks. The Haptic Bracelets consist of vibrotactiles attached to each wrist and ankle, together with a computer system to control
Full Text Available BACKGROUND: It is well-known that human beings are able to associate stimuli (novel or not perceived in their environment. For example, this ability is used by children in reading acquisition when arbitrary associations between visual and auditory stimuli must be learned. The studies tend to consider it as an "implicit" process triggered by the learning of letter/sound correspondences. The study described in this paper examined whether the addition of the visuo-haptic exploration would help adults to learn more effectively the arbitrary association between visual and auditory novel stimuli. METHODOLOGY/PRINCIPAL FINDINGS: Adults were asked to learn 15 new arbitrary associations between visual stimuli and their corresponding sounds using two learning methods which differed according to the perceptual modalities involved in the exploration of the visual stimuli. Adults used their visual modality in the "classic" learning method and both their visual and haptic modalities in the "multisensory" learning one. After both learning methods, participants showed a similar above-chance ability to recognize the visual and auditory stimuli and the audio-visual associations. However, the ability to recognize the visual-auditory associations was better after the multisensory method than after the classic one. CONCLUSION/SIGNIFICANCE: This study revealed that adults learned more efficiently the arbitrary association between visual and auditory novel stimuli when the visual stimuli were explored with both vision and touch. The results are discussed from the perspective of how they relate to the functional differences of the manual haptic modality and the hypothesis of a "haptic bond" between visual and auditory stimuli.
Vallgårda, Anna; Boer, Laurens; Cahill, Ben
In this design case we present the Hedonic Haptic Player—a wearable device that plays different patterns of vibrations on the body as a form of music for the skin. With this we begin to explore the enjoyability of vibrations in a wearable set-up. Instead of implementing vibrations as a haptic...... output for some form of communication we want to explore their hedonistic value. The process leading up to the Hedonic Haptic player served as a first step in getting a grasp of the design space of vibrotactile stimuli in a broader sense. This is reported as seven episodes of explorations. The Hedonic...
Dykes, Robert W; Miqueé, Aline; Xerri, Christian; Zennou-Azogui, Yoh'i; Rainville, Constant; Dumoulin, André; Marineau, Daniel
We describe a novel stimulus delivery system designed to present tactile stimuli to a subject in the tunnel of a magnetic resonance imaging (MRI) system. Using energy from an air-driven piston to turn a wheel, the device advances a conveyor belt with a pre-determined sequence of stimuli that differ in their spatial features into the tunnel of the MRI. The positioning of one or several stimulus objects in a window near the subject's hand is controlled by a photoelectric device that detects periodic openings in the conveyor belt. Using this electric signal to position each presentation avoids cumulative positioning errors and provides a signal related to the progression of the experiment. We used a series of shapes that differed in their spatial features but the device could carry stimuli with a diversity of shapes and textures. This flexibility allows the experimenter to design a wide variety of psychophysical experiments in the haptic world and possibly to compare and contrast these stimuli with the cognitive treatment of similar stimuli delivered to the other senses. Appropriate experimental design allows separation of motor, sensory and memory storage phases of mental processes.
van Beek, Femke E.; Bergmann Tiest, Wouter M.; Kappers, Astrid M. L.
While quite some research has focussed on the accuracy of haptic perception of distance, information on the precision of haptic perception of distance is still scarce, particularly regarding distances perceived by making arm movements. In this study, eight conditions were measured to answer four main questions, which are: what is the influence of reference distance, movement axis, perceptual mode (active or passive) and stimulus type on the precision of this kind of distance perception? A discrimination experiment was performed with twelve participants. The participants were presented with two distances, using either a haptic device or a real stimulus. Participants compared the distances by moving their hand from a start to an end position. They were then asked to judge which of the distances was the longer, from which the discrimination threshold was determined for each participant and condition. The precision was influenced by reference distance. No effect of movement axis was found. The precision was higher for active than for passive movements and it was a bit lower for real stimuli than for rendered stimuli, but it was not affected by adding cutaneous information. Overall, the Weber fraction for the active perception of a distance of 25 or 35 cm was about 11% for all cardinal axes. The recorded position data suggest that participants, in order to be able to judge which distance was the longer, tried to produce similar speed profiles in both movements. This knowledge could be useful in the design of haptic devices. PMID:25116638
Femke E van Beek
Full Text Available While quite some research has focussed on the accuracy of haptic perception of distance, information on the precision of haptic perception of distance is still scarce, particularly regarding distances perceived by making arm movements. In this study, eight conditions were measured to answer four main questions, which are: what is the influence of reference distance, movement axis, perceptual mode (active or passive and stimulus type on the precision of this kind of distance perception? A discrimination experiment was performed with twelve participants. The participants were presented with two distances, using either a haptic device or a real stimulus. Participants compared the distances by moving their hand from a start to an end position. They were then asked to judge which of the distances was the longer, from which the discrimination threshold was determined for each participant and condition. The precision was influenced by reference distance. No effect of movement axis was found. The precision was higher for active than for passive movements and it was a bit lower for real stimuli than for rendered stimuli, but it was not affected by adding cutaneous information. Overall, the Weber fraction for the active perception of a distance of 25 or 35 cm was about 11% for all cardinal axes. The recorded position data suggest that participants, in order to be able to judge which distance was the longer, tried to produce similar speed profiles in both movements. This knowledge could be useful in the design of haptic devices.
Dijk, E.O.; Weffers, A.
In this paper we present the “Breathe with the Ocean” system concept, which is a breathing guidance system that aims to help a user relax. It provides an immersive experience where the user is virtually present at an ocean shore. We describe the design and implementation of three embodiments of this
Nordahl, Rolf; Nilsson, Niels Christian; Turchet, Luca
Circular and linear self-motion illusions induced through visual and auditory stimuli have been studied rather extensively. While the ability of haptic stimuli to augment such illusions has been investigated, the self-motion illusions which primarily are induced by stimulation of the haptic...... to generate the haptic feedback while the final condition included no haptic feedback. Analysis of self-reports were used to assess the participants' experience of illusory self-motion. The results indicate that such illusions are indeed possible. Significant differences were found between the condition...... modality remain relatively unexplored. In this paper, we present an experiment performed with the intention of investigating whether it is possible to use haptic stimulation of the main supporting areas of the feet to induce vertical illusory self-motion on behalf of unrestrained participants during...
Turchet, Luca; Burelli, Paolo; Serafin, Stefania
system. While during the use of the interactive system subjects physically walked, during the use of the non-interactive system the locomotion was simulated while subjects were sitting on a chair. In both the configurations subjects were exposed to auditory and audio-visual stimuli presented...... with and without the haptic feedback. Results of the experiments provide a clear preference towards the simulations enhanced with haptic feedback showing that the haptic channel can lead to more realistic experiences in both interactive and non-interactive configurations. The majority of subjects clearly...... appreciated the added feedback. However, some subjects found the added feedback disturbing and annoying. This might be due on one hand to the limits of the haptic simulation and on the other hand to the different individual desire to be involved in the simulations. Our findings can be applied to the context...
Wang, Liping; Li, Xianchun; Hsiao, Steven S.; Bodner, Mark; Lenz, Fred; Zhou, Yong-Di
Previous studies suggested that primary somatosensory (SI) neurons in well-trained monkeys participated in the haptic-haptic unimodal delayed matching-to-sample (DMS) task. In this study, 585 SI neurons were recorded in monkeys performing a task that was identical to that in the previous studies but without requiring discrimination and active…
This book examines the signal processing perspective in haptic teleoperation systems. This text covers the topics of prediction, estimation, architecture, data compression, and error correction that can be applied to haptic teleoperation systems. The authors begin with an overview of haptic teleoperation systems, then look at a Bayesian approach to haptic teleoperation systems. They move onto a discussion of haptic data compression, haptic data digitization and forward error correction. · Presents haptic data prediction/estimation methods that compensate for unreliable networks · Discusses haptic data compression that reduces haptic data size over limited network bandwidth and haptic data error correction that compensate for packet loss problem · Provides signal processing techniques used with existing control architectures.
Vuong, Nguyen Huu Lam; Kwon, Hyeok Yong; Chuc, Nguyen Huu; Kim, Duksang; An, Kuangjun; Phuc, Vuong Hong; Moon, Hyungpil; Koo, Jachoon; Lee, Youngkwan; Nam, Jae-Do; Choi, Hyouk Ryeol
In this paper, we present a new haptic interface, called "active skin", which is configured with a tactile sensor and a tactile stimulator in single haptic cell, and multiple haptic cells are embedded in a dielectric elastomer. The active skin generates a wide variety of haptic feel in response to the touch by synchronizing the sensor and the stimulator. In this paper, the design of the haptic cell is derived via iterative analysis and design procedures. A fabrication method dedicated to the proposed device is investigated and a controller to drive multiple haptic cells is developed. In addition, several experiments are performed to evaluate the performance of the active skin.
Orquin, Jacob Lund; Mueller Loose, Simone
This study analyses visual attention and part-worth utilities in choice experiments across three different choice stimuli presentation formats. Visual attention and choice behaviour in discrete choice experiments are found to be strongly affected by stimuli presentation format. These results...
Kappers, A.M.L.; Bergmann Tiest, W.M.
Fueled by novel applications, interest in haptic perception is growing. This paper provides an overview of the state of the art of a number of important aspects of haptic perception. By means of touch we can not only perceive quite different material properties, such as roughness, compliance,
The purpose of this study was twofold: (a) to examine extant research in the field of music with premature and full term infants in order to identify protocols being used in the presentation of musical stimuli to neonates and (b) to use knowledge gleaned from audiology as a basis for suggesting a standardized protocol for use of musical stimuli with infants. Articles considered appropriate for inclusion in the analysis met the following criteria: (a) presented data for the effects of music on a dependent measure, (b) had subjects who were identified as either premature or term newborns receiving treatment after birth and prior to discharge from the hospital, and (c) used music for some or all of the aural stimuli. Articles (N = 20) were categorized by demographic information, types of aural stimuli, independent variables, dependent measures, and protocol used to present the musical stimuli. Of primary importance to this study was the protocol used in each study to present musical stimuli. Data regarding total duration of stimuli per day, longest duration of stimuli per day, method of stimuli presentation, placement of speakers, decibel level of stimuli, and where;he decibel level was measured reveal that there is no standard protocol being followed with regard to the presentation of aural stimuli. Recommendations include future research on (a) determining a minimum gestational age where music therapy may be appropriate, (b) determining the frequency spectrum perceived by a premature infant, (c) determining the decibel levels reaching the ear drum and assessing appropriate levels for minimum stimulation with maximum results, and (d) carefully considering the method of stimulus presentation as it will have an impact on the decibel level reaching the ear drum of these infants.
Cuartielles, David; Göransson, Andreas; Olsson, Tony
This paper investigates how artistic explorations can be useful for the development of mobile haptic technology. It presents an alternative framework of design for wearable haptics that contributes to the building of haptic communities outside specialized research contexts. The paper also present...
Ballesteros, Soledad; Reales, José M; Mayas, Julia; Heller, Morton A
In two experiments, we examined the effect of selective attention at encoding on repetition priming in normal aging and Alzheimer's disease (AD) patients for objects presented visually (experiment 1) or haptically (experiment 2). We used a repetition priming paradigm combined with a selective attention procedure at encoding. Reliable priming was found for both young adults and healthy older participants for visually presented pictures (experiment 1) as well as for haptically presented objects (experiment 2). However, this was only found for attended and not for unattended stimuli. The results suggest that independently of the perceptual modality, repetition priming requires attention at encoding and that perceptual facilitation is maintained in normal aging. However, AD patients did not show priming for attended stimuli, or for unattended visual or haptic objects. These findings suggest an early deficit of selective attention in AD. Results are discussed from a cognitive neuroscience approach.
Mazerolle, Erin L.; Marchand, Yannick
Research into typing patterns has broad applications in both psycholinguistics and biometrics (i.e., improving security of computer access via each user's unique typing patterns). We present a new software package, TypingSuite, which can be used for presenting visual and auditory stimuli, collecting typing data, and summarizing and analyzing the…
Roberts, William A.
Much of Stewart Hulse's career was spent analyzing how animals can extract patterned information from sequences of stimuli. Yet an additional form of information contained in a sequence may be the number of times different elements occurred. Experiments that required numerical discrimination between different stimulus items presented in sequence…
Nagao, Ryohei; Matsumoto, Keigo; Narumi, Takuji; Tanikawa, Tomohiro; Hirose, Michitaka
This paper presents a novel interactive system that provides users with virtual reality (VR) experiences, wherein users feel as if they are ascending/descending stairs through passive haptic feedback. The passive haptic stimuli are provided by small bumps under the feet of users; these stimuli are provided to represent the edges of the stairs in the virtual environment. The visual stimuli of the stairs and shoes, provided by head-mounted displays, evoke a visuo-haptic interaction that modifies a user's perception of the floor shape. Our system enables users to experience all types of stairs, such as half-turn and spiral stairs, in a VR setting. We conducted a preliminary user study and two experiments to evaluate the proposed technique. The preliminary user study investigated the effectiveness of the basic idea associated with the proposed technique for the case of a user ascending stairs. The results demonstrated that the passive haptic feedback produced by the small bumps enhanced the user's feeling of presence and sense of ascending. We subsequently performed an experiment to investigate an improved viewpoint manipulation method and the interaction of the manipulation and haptics for both the ascending and descending cases. The experimental results demonstrated that the participants had a feeling of presence and felt a steep stair gradient under the condition of haptic feedback and viewpoint manipulation based on the characteristics of actual stair walking data. However, these results also indicated that the proposed system may not be as effective in providing a sense of descending stairs without an optimization of the haptic stimuli. We then redesigned the shape of the small bumps, and evaluated the design in a second experiment. The results indicated that the best shape to present haptic stimuli is a right triangle cross section in both the ascending and descending cases. Although it is necessary to install small protrusions in the determined direction, by
Turchet, Luca; Burelli, Paolo; Serafin, Stefania
In this paper, we describe several experiments whose goal is to evaluate the role of plantar vibrotactile feedback in enhancing the realism of walking experiences in multimodal virtual environments. To achieve this goal we built an interactive and a noninteractive multimodal feedback system. While during the use of the interactive system subjects physically walked, during the use of the noninteractive system the locomotion was simulated while subjects were sitting on a chair. In both the configurations subjects were exposed to auditory and audio-visual stimuli presented with and without the haptic feedback. Results of the experiments provide a clear preference toward the simulations enhanced with haptic feedback showing that the haptic channel can lead to more realistic experiences in both interactive and noninteractive configurations. The majority of subjects clearly appreciated the added feedback. However, some subjects found the added feedback unpleasant. This might be due, on one hand, to the limits of the haptic simulation and, on the other hand, to the different individual desire to be involved in the simulations. Our findings can be applied to the context of physical navigation in multimodal virtual environments as well as to enhance the user experience of watching a movie or playing a video game.
Full Text Available Introduction: The explorative scanning movements of the hands have been compared to those of the eyes. The visual process is known to be composed of alternating phases of saccadic eye movements and fixation pauses. Descriptive results suggest that during the haptic exploration of objects short movement pauses occur as well. The goal of the present study was to detect these explorative stops (ES during one-handed and two-handed haptic explorations of various objects and patterns, and to measure their duration. Additionally, the associations between the following variables were analyzed: a between mean exploration time and duration of ES, b between certain stimulus features and ES frequency, and c the duration of ES during the course of exploration. Methods: Five different experiments were used. The first two experiments were classical recognition tasks of unknown haptic stimuli (A and of common objects (B. In experiment C space-position information of angle legs had to be perceived and reproduced. For experiments D and E the PHANToM haptic device was used for the exploration of virtual (D and real (E sunken reliefs. Results: In each experiment we observed explorative stops of different average durations. For experiment A: 329.50 ms, experiment B: 67.47 ms, experiment C: 189.92 ms, experiment D: 186.17 ms and experiment E: 140.02 ms. Significant correlations were observed between exploration time and the duration of the ES. Also, ES occurred more frequently, but not exclusively, at defined stimulus features like corners, curves and the endpoints of lines. However, explorative stops do not occur every time a stimulus feature is explored. Conclusions: We assume that ES are a general aspect of human haptic exploration processes. We have tried to interpret the occurrence and duration of ES with respect to the Hypotheses-Rebuild-Model and the Limited Capacity Control System theory.
Perna, Judith Camats; Wotjak, Carsten T; Stork, Oliver; Engelmann, Mario
The present study was designed to further investigate the nature of stimuli and the timing of their presentation, which can induce retroactive interference with social recognition memory in mice. In accordance with our previous observations, confrontation with an unfamiliar conspecific juvenile 3h and 6h, but not 22 h, after the initial learning session resulted in retroactive interference. The same effect was observed with the exposure to both enantiomers of the monomolecular odour carvone, and with a novel object. Exposure to a loud tone (12 KHz, 90 dB) caused retroactive interference at 6h, but not 3h and 22 h, after sampling. Our data show that retroactive interference of social recognition memory can be induced by exposing the experimental subjects to the defined stimuli presented <22 h after learning in their home cage. The distinct interference triggered by the tone presentation at 6h after sampling may be linked to the intrinsic aversiveness of the loud tone and suggests that at this time point memory consolidation is particularly sensitive to stress. Copyright © 2015 Elsevier Inc. All rights reserved.
Corrie I. Nichol; Milos Manic
Recent advances in technology for video games have made a broad array of haptic feedback devices available at low cost. This paper presents a bi-manual haptic system to enable an operator to weld remotely using the a commercially available haptic feedback video game device for the user interface. The system showed good performance in initial tests, demonstrating the utility of low cost input devices for remote haptic operations.
Ganin, I P; Kaplan, A Ia
The P300 based brain-computer interface requires the detection of P300 wave of brain event-related potentials. Most of its users learn the BCI control in several minutes and after the short classifier training they can type a text on the computer screen or assemble an image of separate fragments in simple BCI-based video games. Nevertheless, insufficient attractiveness for users and conservative stimuli organization in this BCI may restrict its integration into real information processes control. At the same time initial movement of object (motion-onset stimuli) may be an independent factor that induces P300 wave. In current work we checked the hypothesis that complex "flash + movement" stimuli together with drastic and compact stimuli organization on the computer screen may be much more attractive for user while operating in P300 BCI. In 20 subjects research we showed the effectiveness of our interface. Both accuracy and P300 amplitude were higher for flashing stimuli and complex "flash + movement" stimuli compared to motion-onset stimuli. N200 amplitude was maximal for flashing stimuli, while for "flash + movement" stimuli and motion-onset stimuli it was only a half of it. Similar BCI with complex stimuli may be embedded into compact control systems requiring high level of user attention under impact of negative external effects obstructing the BCI control.
Ryge, Andreas Nicolaj; Thomsen, Lui Albæk; Berthelsen, Theis
In this paper we present a within-subjects study (n=26) comparing participants' experience of three kinds of haptic feedback (no haptic feedback, low fidelity haptic feedback and high fidelity haptic feedback) simulating the impact between a virtual baseball bat and ball. We noticed some minor ef...
Era, Vanessa; Candidi, Matteo; Aglioti, Salvatore Maria
Emotions have a profound influence on aesthetic experiences. Studies using affective priming procedures demonstrate, for example, that inducing a conscious negative emotional state biases the perception of abstract stimuli towards the sublime (Eskine et al. Emotion 12:1071-1074, 2012. doi: 10.1037/a0027200). Moreover, subliminal happy facial expressions have a positive impact on the aesthetic evaluation of abstract art (Flexas et al. PLoS ONE 8:e80154, 2013). Little is known about how emotion influences aesthetic perception of non-abstract, representational stimuli, especially those that are particularly relevant for social behaviour, like human bodies. Here, we explore whether the subliminal presentation of emotionally charged visual primes modulates the explicit subjective aesthetic judgment of body images. Using a forward/backward masking procedure, we presented subliminally positive and negative, arousal-matched, emotional or neutral primes and measured their effect on the explicit evaluation of perceived beauty (high vs low) and emotion (positive vs negative) evoked by abstract and body images. We found that negative primes increased subjective aesthetic evaluations of target bodies or abstract images in comparison with positive primes. No influence of primes on the emotional dimension of the targets was found, thus ruling out an unspecific arousal effect and strengthening the link between emotional valence and aesthetic appreciation. More specifically, that subliminal negative primes increase beauty ratings compared to subliminal positive primes indicates a clear link between negative emotions and positive aesthetic evaluations and vice versa, suggesting a possible link between negative emotion and the experience of sublime in art. The study expands previous research by showing the effect of subliminal negative emotions on the subjective aesthetic evaluation not only of abstract but also of body images.
Pérez Arias, Antonia; Hanebeck, Uwe D.
In this paper, we present a novel use of haptic information in extended range telepresence, the wide-area haptic guidance. It consists of force and position signals applied to the user's hand in order to improve safety, accuracy, and speed in some telepresent tasks. Wide-area haptic guidance assists the user in reaching a desired position in a remote environment of arbitrary size without degrading the feeling of presence. Several methods for haptic guidance are analyzed. With active haptic gu...
Turchet, Luca; Serafin, Stefania; Dimitrov, Smilen
We describe an audio-haptic experiment conducted using a system which simulates in real-time the auditory and haptic sensation of walking on different surfaces. The system is based on physical models, that drive both the haptic and audio synthesizers, and a pair of shoes enhanced with sensors...... and actuators. Such experiment was run to examine the ability of subjects to recognize the different surfaces with both coherent and incoherent audio-haptic stimuli. Results show that in this kind of tasks the auditory modality is dominant on the haptic one....
Paneels, Sabrina; Roberts, Jonathan C
There are many different uses for haptics, such as training medical practitioners, teleoperation, or navigation of virtual environments. This review focuses on haptic methods that display data. The hypothesis is that haptic devices can be used to present information, and consequently, the user gains quantitative, qualitative, or holistic knowledge about the presented data. Not only is this useful for users who are blind or partially sighted (who can feel line graphs, for instance), but also the haptic modality can be used alongside other modalities, to increase the amount of variables being presented, or to duplicate some variables to reinforce the presentation. Over the last 20 years, a significant amount of research has been done in haptic data presentation; e.g., researchers have developed force feedback line graphs, bar charts, and other forms of haptic representations. However, previous research is published in different conferences and journals, with different application emphases. This paper gathers and collates these various designs to provide a comprehensive review of designs for haptic data visualization. The designs are classified by their representation: Charts, Maps, Signs, Networks, Diagrams, Images, and Tables. This review provides a comprehensive reference for researchers and learners, and highlights areas for further research.
Andrew, Benjamin J; Harris, Justin A
Three experiments used delay conditioning of magazine approach in rats to examine the summation of responding when two conditioned stimuli (CSs) are presented together as a compound. The duration of each CS varied randomly from trial-to-trial around a mean that differed between the CSs. This meant that the rats' response rate to each CS was systematically related to the reinforcement rate of that CS, but remained steady as time elapsed during the CS (Harris & Carpenter, 2011; Harris, Gharaei, & Pincham, 2011). When the rats were presented with a compound of two CSs that had been conditioned separately, they responded more during the compound than during either of the CSs individually. More significantly, however, in all three experiments, the rats responded to the compound at the same rate as they responded to a third CS that had been reinforced at a rate equal to the sum of the reinforcement rates of the two CSs in compound. We discuss the implications of this finding for associative models (e.g., Rescorla & Wagner, 1972) and rate-based models (Gallistel & Gibbon, 2000) of conditioning.
An, Xingwei; Tang, Jiabei; Liu, Shuang; He, Feng; Qi, Hongzhi; Wan, Baikun; Ming, Dong
Combining visual and auditory stimuli in event-related potential (ERP)-based spellers gained more attention in recent years. Few of these studies notice the difference of ERP components and system efficiency caused by the shifting of visual and auditory onset. Here, we aim to study the effect of temporal congruity of auditory and visual stimuli onset on bimodal brain-computer interface (BCI) speller. We designed five visual and auditory combined paradigms with different visual-to-auditory delays (-33 to +100 ms). Eleven participants attended in this study. ERPs were acquired and aligned according to visual and auditory stimuli onset, respectively. ERPs of Fz, Cz, and PO7 channels were studied through the statistical analysis of different conditions both from visual-aligned ERPs and audio-aligned ERPs. Based on the visual-aligned ERPs, classification accuracy was also analyzed to seek the effects of visual-to-auditory delays. The latencies of ERP components depended mainly on the visual stimuli onset. Auditory stimuli onsets influenced mainly on early component accuracies, whereas visual stimuli onset determined later component accuracies. The latter, however, played a dominate role in overall classification. This study is important for further studies to achieve better explanations and ultimately determine the way to optimize the bimodal BCI application.
This book constitutes the refereed proceedings of the 5th International Workshop on Haptic and Audio Interaction Design, HAID 2010 held in Copenhagen, Denmark, in September 2010. The 21 revised full papers presented were carefully reviewed and selected for inclusion in the book. The papers are or...
Full Text Available In this paper, a novel haptic feedback scheme, used for accurately positioning a 1DOF virtual wrist prosthesis through sensory substitution, is presented. The scheme employs a three-node tactor array and discretely and selectively modulates the stimulation frequency of each tactor to relay 11 discrete haptic stimuli to the user. Able-bodied participants were able to move the virtual wrist prosthesis via a surface electromyography based controller. The participants evaluated the feedback scheme without visual or audio feedback and relied solely on the haptic feedback alone to correctly position the hand. The scheme was evaluated through both normal (perpendicular and shear (lateral stimulations applied on the forearm. Normal stimulations were applied through a prototype device previously developed by the authors while shear stimulations were generated using an ubiquitous coin motor vibrotactor. Trials with no feedback served as a baseline to compare results within the study and to the literature. The results indicated that using normal and shear stimulations resulted in accurately positioning the virtual wrist, but were not significantly different. Using haptic feedback was substantially better than no feedback. The results found in this study are significant since the feedback scheme allows for using relatively few tactors to relay rich haptic information to the user and can be learned easily despite a relatively short amount of training. Additionally, the results are important for the haptic community since they contradict the common conception in the literature that normal stimulation is inferior to shear. From an ergonomic perspective normal stimulation has the potential to benefit upper limb amputees since it can operate at lower frequencies than shear-based vibrotactors while also generating less noise. Through further tuning of the novel haptic feedback scheme and normal stimulation device, a compact and comfortable sensory substitution
Hugdahl, K; Brønnick, K; Kyllingsbaek, S; Law, I; Gade, A; Paulson, O B
Dichotic listening means that two different stimuli are presented at the same time, one in each ear. This technique is frequently used in experimental and clinical studies as a measure of hemispheric specialization. The primary aim of the present study was to record regional changes in the distribution of cerebral blood flow (CBF) with the 15O-PET technique to dichotically presented consonant-vowel (CV) and musical instrument stimuli, in order to test the basic assumption of differential hemispheric involvement when stimuli presented to one ear dominate over stimuli presented in the other ear. All stimuli were 380 ms in duration with a 1000 ms interstimulus interval, and were presented in blocks of either CV-syllable or musical instrument pairs. Twelve normal healthy subjects had to press a button whenever they detected a CV-syllable or a musical instrument target in a stream of CV- and musical instrument distractor stimuli. The targets appeared equally often in the right and left ear channel. The CV-syllable and musical instrument targets activated bilateral areas in the superior temporal gyri. However, there were significant interactions with regard to asymmetry of the magnitude of peak activation in the significant activation clusters. The CV-syllables resulted in greater neural activation in the left temporal lobe while the musical instruments resulted in greater neural activation in the right temporal lobe. Within-subjects correlations between magnitude of dichotic listening and CBF asymmetry were, however, non-significant. The changes in neural activation were closely mimicked by the performance data which showed a right ear superiority in response accuracy for the CV-syllables, and a left ear superiority for the musical instruments. In addition to the temporal lobe activations, there were activation tendencies in the left inferior frontal lobe, right dorsolateral prefrontal cortex, left occipital lobe, and cerebellum.
Full Text Available Event-related potentials (ERPs provide an exquisite means to measure the extent of processing of external stimuli during the sleep period. This study examines ERPs elicited by stimuli with physical characteristics akin to environmental noise encountered during sleep. Brief duration 40, 60 or 80 dB sound pressure level (SPL tones were presented either rapidly (on average every two seconds or slowly (on average every 10 seconds. The rates of presentation and intensity of the stimuli were similar to those observed in environmental studies of noise. ERPs were recorded from nine young adults during sleep and wakefulness. During wakefulness, the amplitude of an early negative ERP, N1, systematically increased as intensity level increased. A later positivity, the P3a, was apparent following the loudest 80 dB stimulus regardless of the rate of stimulus presentation; it was also apparent following the 60 dB stimulus, when stimuli were presented slowly. The appearance of the N1-P3a deflections suggests that operations of the central executive controlling ongoing cognitive activity was interrupted, forcing subjects to become aware of the obtrusive task-irrelevant stimuli. The auditory stimuli elicited very different ERP patterns during sleep. During non-rapid eye movement (NREM sleep, the ERP was characterized by an enhanced (relative to wakefulness early positivity, P2, followed by a very prominent negativity, the N350. Both deflections systematically varied in amplitude with stimulus intensity level; in addition, N350 was much larger when stimuli were presented at slow rates. The N350, a sleep-specific ERP, is thought to reflect the inhibition of processing of potentially sleep-disrupting stimulus input. During rapid eye movement (REM sleep, a small amplitude N1 was apparent in the ERP, but only for the loudest, 80 dB stimulus. A small (nonsignificant P3a-like deflection was also visible following the 80 dB stimulus, but only when stimuli were presented
Yalachkov, Yavor; Kaiser, Jochen; Doehrmann, Oliver; Naumer, Marcus J
Visuo-haptic integration contributes essentially to object shape recognition. Although there has been a considerable advance in elucidating the neural underpinnings of multisensory perception, it is still unclear whether seeing an object and exploring it with the dominant hand elicits the same brain response as compared to the non-dominant hand. Using fMRI to measure brain activation in right-handed participants, we found that for both left- and right-hand stimulation the left lateral occipital complex (LOC) and anterior cerebellum (aCER) were involved in visuo-haptic integration of familiar objects. These two brain regions were then further investigated in another study, where unfamiliar, novel objects were presented to a different group of right-handers. Here the left LOC and aCER were more strongly activated by bimodal than unimodal stimuli only when the left but not the right hand was used. A direct comparison indicated that the multisensory gain of the fMRI activation was significantly higher for the left than the right hand. These findings are in line with the principle of "inverse effectiveness", implying that processing of bimodally presented stimuli is particularly enhanced when the unimodal stimuli are weak. This applies also when right-handed subjects see and simultaneously touch unfamiliar objects with their non-dominant left hand. Thus, the fMRI signal in the left LOC and aCER induced by visuo-haptic stimulation is dependent on which hand was employed for haptic exploration. Copyright © 2015 Elsevier B.V. All rights reserved.
Jakesch, Martina; Carbon, Claus-Christian
Zajonc showed that the attitude towards stimuli that one had been previously exposed to is more positive than towards novel stimuli. This mere exposure effect (MEE) has been tested extensively using various visual stimuli. Research on the MEE is sparse, however, for other sensory modalities. We used objects of two material categories (stone and wood) and two complexity levels (simple and complex) to test the influence of exposure frequency (F0 = novel stimuli, F2 = stimuli exposed twice, F10 = stimuli exposed ten times) under two sensory modalities (haptics only and haptics & vision). Effects of exposure frequency were found for high complex stimuli with significantly increasing liking from F0 to F2 and F10, but only for the stone category. Analysis of "Need for Touch" data showed the MEE in participants with high need for touch, which suggests different sensitivity or saturation levels of MEE. This different sensitivity or saturation levels might also reflect the effects of expertise on the haptic evaluation of objects. It seems that haptic and cross-modal MEEs are influenced by factors similar to those in the visual domain indicating a common cognitive basis.
Full Text Available Zajonc showed that the attitude towards stimuli that one had been previously exposed to is more positive than towards novel stimuli. This mere exposure effect (MEE has been tested extensively using various visual stimuli. Research on the MEE is sparse, however, for other sensory modalities.We used objects of two material categories (stone and wood and two complexity levels (simple and complex to test the influence of exposure frequency (F0 = novel stimuli, F2 = stimuli exposed twice, F10 = stimuli exposed ten times under two sensory modalities (haptics only and haptics & vision. Effects of exposure frequency were found for high complex stimuli with significantly increasing liking from F0 to F2 and F10, but only for the stone category. Analysis of "Need for Touch" data showed the MEE in participants with high need for touch, which suggests different sensitivity or saturation levels of MEE.This different sensitivity or saturation levels might also reflect the effects of expertise on the haptic evaluation of objects. It seems that haptic and cross-modal MEEs are influenced by factors similar to those in the visual domain indicating a common cognitive basis.
Kyllingsbaek, Soren; Markussen, Bo; Bundesen, Claus
The authors propose and test a simple model of the time course of visual identification of briefly presented, mutually confusable single stimuli in pure accuracy tasks. The model implies that during stimulus analysis, tentative categorizations that stimulus i belongs to category j are made at a constant Poisson rate, v(i, j). The analysis is…
Alió, Jorge L; Plaza-Puche, Ana B; Javaloy, Jaime; Ayala, María José; Vega-Estrada, Alfredo
To compare the visual and intraocular optical quality outcomes with different designs of the refractive rotationally asymmetric multifocal intraocular lens (MFIOL) (Lentis Mplus; Oculentis GmbH, Berlin, Germany) with or without capsular tension ring (CTR) implantation. One hundred thirty-five consecutive eyes of 78 patients with cataract (ages 36 to 82 years) were divided into three groups: 43 eyes implanted with the C-Loop haptic design without CTR (C-Loop haptic only group); 47 eyes implanted with the C-Loop haptic design with CTR (C-Loop haptic with CTR group); and 45 eyes implanted with the plate-haptic design (plate-haptic group). Visual acuity, contrast sensitivity, defocus curve, and ocular and intraocular optical quality were evaluated at 3 months postoperatively. Significant differences in the postoperative sphere were found (P = .01), with a more myopic postoperative refraction for the C-Loop haptic only group. No significant differences were detected in photopic and scotopic contrast sensitivity among groups (P ⩾ .05). Significantly better visual acuities were present in the C-Loop haptic with CTR group for the defocus levels of -2.0, -1.5, -1.0, and -0.50 D (P ⩽.03). Statistically significant differences among groups were found in total intraocular root mean square (RMS), high-order intraocular RMS, and intraocular coma-like RMS aberrations (P ⩽.04), with lower values from the plate-haptic group. The plate-haptic design and the C-Loop haptic design with CTR implantation both allow good visual rehabilitation. However, better refractive predictability and intraocular optical quality was obtained with the plate-haptic design without CTR implantation. The plate-haptic design seems to be a better design to support rotational asymmetric MFIOL optics. Copyright 2013, SLACK Incorporated.
Eck, Ulrich; Pankratz, Frieder; Sandor, Christian; Klinker, Gudrun; Laga, Hamid
Visuo-haptic augmented reality systems enable users to see and touch digital information that is embedded in the real world. PHANToM haptic devices are often employed to provide haptic feedback. Precise co-location of computer-generated graphics and the haptic stylus is necessary to provide a realistic user experience. Previous work has focused on calibration procedures that compensate the non-linear position error caused by inaccuracies in the joint angle sensors. In this article we present a more complete procedure that additionally compensates for errors in the gimbal sensors and improves position calibration. The proposed procedure further includes software-based temporal alignment of sensor data and a method for the estimation of a reference for position calibration, resulting in increased robustness against haptic device initialization and external tracker noise. We designed our procedure to require minimal user input to maximize usability. We conducted an extensive evaluation with two different PHANToMs, two different optical trackers, and a mechanical tracker. Compared to state-of-the-art calibration procedures, our approach significantly improves the co-location of the haptic stylus. This results in higher fidelity visual and haptic augmentations, which are crucial for fine-motor tasks in areas such as medical training simulators, assembly planning tools, or rapid prototyping applications.
Full Text Available A new method for the assessment of the upper limb (UL functional state, using a haptic interface is presented. A haptic interface is used as a measuring device, capable of providing objective, repeatable and quantitative data of the UL motion. A patient is presented with a virtual environment, both graphically via a computer screen and haptically via the Phantom Premium 1.5 haptic interface. The setup allows the patient to explore and feel the virtual environment with three of his/her senses; sight, hearing, and most important, touch. Specially designed virtual environments are used to assess the patient’s UL movement capabilities. The tests range from tracking tasks – to assess the accuracy of movement – tracking tasks with added disturbances in a form of random forces – to assess the patient’s control abilities, a labyrinth test – to assess both speed and accuracy, to the last test for measuring the maximal force capacity of the UL.A new method for the assessment of the upper limb (UL functional state, using a haptic interface is presented. A haptic interface is used as a measuring device, capable of providing objective, repeatable and quantitative data of the UL motion. A patient is presented with a virtual environment, both graphically via a computer screen and haptically via the Phantom Premium 1.5 haptic interface. The setup allows the patient to explore and feel the virtual environment with three of his/her senses; sight, hearing, and most important, touch. Specially designed virtual environments are used to assess the patient’s UL movement capabilities. The tests range from tracking tasks–to assess the accuracy of movement-tracking tasks with added disturbances in a form of random forces-to assess the patient’s control abilities, a labyrinth test-to assess both speed and accuracy, to the last test for measuring the maximal force capacity of the UL.A comprehensive study, using the developed measurement setup within the
Shirin eDavarpanah Jazi
Full Text Available An emerging issue in movement neurosciences is whether haptic feedback influences the nature of the information supporting a simulated grasping response (i.e., pantomime-grasping. In particular, recent work by our group contrasted pantomime-grasping responses performed with (i.e., PH+ trials and without (i.e., PH- trials terminal haptic feedback in separate blocks of trials. Results showed that PH- trials were mediated via relative visual information. In contrast, PH+ trials showed evidence of an absolute visuo-haptic calibration – a finding attributed to an error signal derived from a comparison between expected and actual haptic feedback (i.e., an internal forward model. The present study examined whether advanced knowledge of haptic feedback availability influences the aforementioned calibration process. To that end, PH- and PH+ trials were completed in separate blocks (i.e., the feedback schedule used in our group’s previous study and a block wherein PH- and PH+ trials were randomly interleaved on a trial-by-trial basis (i.e., random feedback schedule. In other words, the random feedback schedule precluded participants from predicting whether haptic feedback would be available at the movement goal location. We computed just-noticeable-difference (JND values to determine whether responses adhered to, or violated, the relative psychophysical principles of Weber’s law. Results for the blocked feedback schedule replicated our group’s previous work, whereas in the random feedback schedule PH- and PH+ trials were supported via relative visual information. Accordingly, we propose that a priori knowledge of haptic feedback is necessary to support an absolute visuo-haptic calibration. Moreover, our results demonstrate that the presence and expectancy of haptic feedback is an important consideration in contrasting the behavioral and neural properties of natural and stimulated (i.e., pantomime-grasping grasping.
Neri, Luis; Noguez, Julieta; Robledo-Rella, Victor; Escobar-Castillejos, David; Gonzalez-Nucamendi, Andres
In this work, the design and implementation of several physics scenarios using haptic devices are presented and discussed. Four visuo-haptic applications were developed for an undergraduate engineering physics course. Experiments with experimental and control groups were designed and implemented. Activities and exercises related to classical…
Reilink, Rob; Stramigioli, Stefano; Kappers, Astrid M L; Misra, Sarthak
Background: Steering the tip of a flexible endoscope relies on the physician's dexterity and experience. For complex flexible endoscopes, conventional controls may be inadequate. Methods: A steering method based on a multi-degree-of-freedom haptic device is presented. Haptic cues are generated based
Reilink, Rob; Stramigioli, Stefano; Kappers, Astrid M.L.; Misra, Sarthak
Background - Steering the tip of a flexible endoscope relies on the physician’s dexterity and experience. For complex flexible endoscopes, conventional controls may be inadequate. Methods - A steering method based on a multi-degree-of-freedom haptic device is presented. Haptic cues are generated
Danieau, F; Lecuyer, A; Guillotel, P; Fleureau, J; Mollet, N; Christie, M
Haptic technology has been widely employed in applications ranging from teleoperation and medical simulation to art and design, including entertainment, flight simulation, and virtual reality. Today there is a growing interest among researchers in integrating haptic feedback into audiovisual systems. A new medium emerges from this effort: haptic-audiovisual (HAV) content. This paper presents the techniques, formalisms, and key results pertinent to this medium. We first review the three main stages of the HAV workflow: the production, distribution, and rendering of haptic effects. We then highlight the pressing necessity for evaluation techniques in this context and discuss the key challenges in the field. By building on existing technologies and tackling the specific challenges of the enhancement of audiovisual experience with haptics, we believe the field presents exciting research perspectives whose financial and societal stakes are significant.
Hummel, T.; Mojet, J.; Kobal, G.
After chemical stimulation of the human olfactory epithelium it is possible to record a negative response (electro-olfactogram, EOG) which is interpreted as the summated generator potential of olfactory neurons. The aim of the present investigation was to test whether the EOG is present when
Kassuba, Tanja; Menz, Mareike M; R�der, Brigitte
and haptic object features activate cortical regions that host unified conceptual object representations. The left fusiform gyrus (FG) and posterior superior temporal sulcus (pSTS) showed increased activation during crossmodal matching of semantically congruent but not incongruent object stimuli. In the FG...
Jung, Hwee-Kwon; Park, Gyuhae; Todd, Michael D.
This paper presents a new sensing paradigm for structural impact detection using vibro-haptic interfaces. The goal of this study is to allow humans to ‘feel’ structural responses (impact, shape changes, and damage) and eventually determine health conditions of a structure. The target applications for this study are aerospace structures, in particular, airplane wings. Both hardware and software components are developed to realize the vibro-haptic-based impact detection system. First, L-shape piezoelectric sensor arrays are deployed to measure the acoustic emission data generated by impacts on a wing. Unique haptic signals are then generated by processing the measured acoustic emission data. These haptic signals are wirelessly transmitted to human arms, and with vibro-haptic interface, human pilots could identify impact location, intensity and possibility of subsequent damage initiation. With the haptic interface, the experimental results demonstrate that human could correctly identify such events, while reducing false indications on structural conditions by capitalizing on human’s classification capability. Several important aspects of this study, including development of haptic interfaces, design of optimal human training strategies, and extension of the haptic capability into structural impact detection are summarized in this paper.
Han, Young-Min; Noh, Kyung-Wook; Choi, Seung-Bok; Lee, Yang-Sub
This paper proposes a new haptic cue function for manual transmission vehicles to achieve optimal gear shifting. This function is implemented on the accelerator pedal by utilizing a magnetorheological (MR) brake mechanism. By combining the haptic cue function with the accelerator pedal, the proposed haptic cue device can transmit the optimal moment of gear shifting for manual transmission to a driver without requiring the driver's visual attention. As a first step to achieve this goal, a MR fluid-based haptic device is devised to enable rotary motion of the accelerator pedal. Taking into account spatial limitations, the design parameters are optimally determined using finite element analysis to maximize the relative control torque. The proposed haptic cue device is then manufactured and its field-dependent torque and time response are experimentally evaluated. Then the manufactured MR haptic cue device is integrated with the accelerator pedal. A simple virtual vehicle emulating the operation of the engine of a passenger vehicle is constructed and put into communication with the haptic cue device. A feed-forward torque control algorithm for the haptic cue is formulated and control performances are experimentally evaluated and presented in the time domain
Takada, Katsuko; Ishii, Akira; Matsuo, Takashi; Nakamura, Chika; Uji, Masato; Yoshikawa, Takahiro
Obesity is a major public health problem in modern society. Appetitive behavior has been proposed to be partially driven by unconscious decision-making processes and thus, targeting the unconscious cognitive processes related to eating behavior is essential to develop strategies for overweight individuals and obese patients. Here, we presented food pictures below the threshold of awareness to healthy male volunteers and examined neural activity related to appetitive behavior using magnetoencephalography. We found that, among participants who did not recognize food pictures during the experiment, an index of heart rate variability assessed by electrocardiography (low-frequency component power/high-frequency component power ratio, LF/HF) just after picture presentation was increased compared with that just before presentation, and the increase in LF/HF was negatively associated with the score for cognitive restraint of food intake. In addition, increased LF/HF was negatively associated with increased alpha band power in Brodmann area (BA) 47 caused by food pictures presented below the threshold of awareness, and level of cognitive restraint was positively associated with increased alpha band power in BA13. Our findings may provide valuable clues to the development of methods assessing unconscious regulation of appetite and offer avenues for further study of the neural mechanisms related to eating behavior.
Woo, Hyun Soo; Kim, Woo Seok; Ahn, Woojin; Lee, Doo Yong; Yi, Sun Young
This paper presents an improved haptic interface of the KAIST-Ewha colonoscopy simulator II. The haptic interface enables the distal portion of the colonoscope to be freely bent while guaranteeing enough workspace and reflective forces for colonoscopy simulation. Its force-torque sensor measures profiles of the user. Manipulation of the colonoscope tip is monitored by four deflection sensors, and triggers computation to render accurate graphic images corresponding to the angle knob rotation. Tack switches are attached on the valve-actuation buttons of the colonoscope to simulate air-injection or suction, and the corresponding deformation of the colon.
Wang, Dangxiao; Zhang, Yuru
This book introduces the latest progress in six degrees of freedom (6-DoF) haptic rendering with the focus on a new approach for simulating force/torque feedback in performing tasks that require dexterous manipulation skills. One of the major challenges in 6-DoF haptic rendering is to resolve the conflict between high speed and high fidelity requirements, especially in simulating a tool interacting with both rigid and deformable objects in a narrow space and with fine features. The book presents a configuration-based optimization approach to tackle this challenge. Addressing a key issue in man
Otaduy, Miguel A
The human haptic system, among all senses, provides unique and bidirectional communication between humans and their physical environment. Yet, to date, most human-computer interactive systems have focused primarily on the graphical rendering of visual information and, to a lesser extent, on the display of auditory information. Extending the frontier of visual computing, haptic interfaces, or force feedback devices, have the potential to increase the quality of human-computer interaction by accommodating the sense of touch. They provide an attractive augmentation to visual display and enhance t
Kaas, Amanda L; Mier, Hanneke I van
Research has shown that haptic spatial matching at intermanual distances over 60 cm is prone to large systematic errors. The error pattern has been explained by the use of reference frames intermediate between egocentric and allocentric coding. This study investigated haptic performance in near peripersonal space, i.e. at intermanual distances of 60 cm and less. Twelve blindfolded participants (six males and six females) were presented with two turn bars at equal distances from the midsagittal plane, 30 or 60 cm apart. Different orientations (vertical/horizontal or oblique) of the left bar had to be matched by adjusting the right bar to either a mirror symmetric (/ \\) or parallel (/ /) position. The mirror symmetry task can in principle be performed accurately in both an egocentric and an allocentric reference frame, whereas the parallel task requires an allocentric representation. Results showed that parallel matching induced large systematic errors which increased with distance. Overall error was significantly smaller in the mirror task. The task difference also held for the vertical orientation at 60 cm distance, even though this orientation required the same response in both tasks, showing a marked effect of task instruction. In addition, men outperformed women on the parallel task. Finally, contrary to our expectations, systematic errors were found in the mirror task, predominantly at 30 cm distance. Based on these findings, we suggest that haptic performance in near peripersonal space might be dominated by different mechanisms than those which come into play at distances over 60 cm. Moreover, our results indicate that both inter-individual differences and task demands affect task performance in haptic spatial matching. Therefore, we conclude that the study of haptic spatial matching in near peripersonal space might reveal important additional constraints for the specification of adequate models of haptic spatial performance.
Full Text Available We have been engaged in the development of a brain-computer interface (BCI based on the cognitive P300 event-related potentials (ERPs evoked by simultaneous presentation of visual and auditory stimuli in order to assist with the communication in severe physical limitation persons. The purpose of the simultaneous presentation of these stimuli is to give the user more choices as commands. First, we extracted P300 ERPs by either visual oddball paradigm or auditory oddball paradigm. Then amplitude and latency of the P300 ERPs were measured. Second, visual and auditory stimuli were presented simultaneously, we measured the P300 ERPs varying the condition of combinations of these stimuli. In this report, we used 3 colors as visual stimuli and 3 types of MIDI sounds as auditory stimuli. Two types of simultaneous presentations were examined. The one was conducted with random combination. The other was called group stimulation, combining one color, such as red, and one MIDI sound, such as piano, in order to make a group; three groups were made. Each group was presented to users randomly. We evaluated the possibility of BCI using these stimuli from the amplitudes and the latencies of P300 ERPs.
Kyllingsbæk, Søren; Markussen, Bo; Bundesen, Claus
The authors propose and test a simple model of the time course of visual identification of briefly presented, mutually confusable single stimuli in pure accuracy tasks. The model implies that during stimulus analysis, tentative categorizations that stimulus i belongs to category j are made at a constant Poisson rate, v(i, j). The analysis is continued until the stimulus disappears, and the overt response is based on the categorization made the greatest number of times. The model was evaluated by Monte Carlo tests of goodness of fit against observed probability distributions of responses in two extensive experiments and also by quantifications of the information loss of the model compared with the observed data by use of information theoretic measures. The model provided a close fit to individual data on identification of digits and an apparently perfect fit to data on identification of Landolt rings.
Bergmann Tiest, W.M.; Kosters, N.D.; Daanen, H.A.M.; Kappers, A.M.L.
The sensation of wetness is well-known but barely investigated. There are no specific wetness receptors in the skin, but the sensation is mediated by temperature and pressure perception. In our study, we have measured discrimination thresholds for the haptic perception of wetness of three di erent
Bergmann Tiest, W.M.; Dolfine Kosters, N.; Daanen, h.a.m.; Kappers, A.M.L.
In daily life, people interact with textiles of different degrees of wetness, but little is known about the me-chanics of wetness perception. This paper describes an experiment with six conditions regarding haptic dis-crimination of the wetness of fabrics. Three materials were used: cotton wool,
Bergmann Tiest, W.M.; Kosters, N.D.; Kappers, Astrid M.L.; Daanen, H.A.M.
In daily life, people interact with textiles of different degrees of wetness, but little is known about the mechanics of wetness perception. This paper describes an experiment with six conditions regarding haptic discrimination of the wetness of fabrics. Three materials were used: cotton wool,
Kirstein Høgel, Arine
This vignette arose in the course of a practice-led research project using “haptic interventions” to investigate contemporary consumption of cultural pasts and cultural difference. The vignette presents reworkings of unused and newly digitised archival material shot in the Persian Gulf in the 1950s...
The present thesis focused on the representations of grasping space based on haptic input. We aimed at identifying their characteristics, and the underlying neurocognitive processes and mechanisms. To this end, we studied the systematic distortions in performance on several orientation perception
Full Text Available When we hold an object while looking at it, estimates from visual and haptic cues to size are combined in a statistically optimal fashion, whereby the ‘weight’ given to each signal reflects their relative reliabilities. This allows object properties to be estimated more precisely than would otherwise be possible. Tools such as pliers and tongs systematically perturb the mapping between object size and the hand opening. This could complicate visual-haptic integration because it may alter the reliability of the haptic signal, thereby disrupting the determination of appropriate signal weights. To investigate this we first measured the reliability of haptic size estimates made with virtual pliers-like tools (created using a stereoscopic display and force-feedback robots with different ‘gains’ between hand opening and object size. Haptic reliability in tool use was straightforwardly determined by a combination of sensitivity to changes in hand opening and the effects of tool geometry. The precise pattern of sensitivity to hand opening, which violated Weber’s law, meant that haptic reliability changed with tool gain. We then examined whether the visuo-motor system accounts for these reliability changes. We measured the weight given to visual and haptic stimuli when both were available, again with different tool gains, by measuring the perceived size of stimuli in which visual and haptic sizes were varied independently. The weight given to each sensory cue changed with tool gain in a manner that closely resembled the predictions of optimal sensory integration. The results are consistent with the idea that different tool geometries are modelled by the brain, allowing it to calculate not only the distal properties of objects felt with tools, but also the certainty with which those properties are known. These findings highlight the flexibility of human sensory integration and tool-use, and potentially provide an approach for optimising the
Ittyerah, Miriam; Marks, Lawrence E
The present study examined the role of vision and haptics in memory for stimulus objects that vary along the dimension of curvature. Experiment 1 measured haptic-haptic (T-T) and haptic-visual (T-V) discrimination of curvature in a short-term memory paradigm, using 30-second retention intervals containing five different interpolated tasks. Results showed poorest performance when the interpolated tasks required spatial processing or movement, thereby suggesting that haptic information about shape is encoded in a spatial-motor representation. Experiment 2 compared visual-visual (V-V) and visual-haptic (V-T) short-term memory, again using 30-second delay intervals. The results of the ANOVA failed to show a significant effect of intervening activity. Intra-modal visual performance and cross-modal performance were similar. Comparing the four modality conditions (inter-modal V-T, T-V; intra-modal V-V, T-T, by combining the data of Experiments 1 and 2), in a global analysis, showed a reliable interaction between intervening activity and experiment (modality). Although there appears to be a general tendency for spatial and movement activities to exert the most deleterious effects overall, the patterns are not identical when the initial stimulus is encoded haptically (Experiment 1) and visually (Experiment 2).
Full Text Available Information about the identity and the location of perceptual objects can be automatically integrated in perception and working memory (WM. Contrasting results in visual and auditory WM studies indicate that the characteristics of feature-to-location binding can vary according to the sensory modality of the input. The present study provides first evidence of binding between "what" and "where" information in WM for haptic stimuli. In an old-new recognition task, blindfolded participants were presented in their peripersonal space with sequences of three haptic stimuli varying in texture and location. They were then required to judge if a single probe stimulus was previously included in the sequence. Recall was measured both in a condition in which both texture and location were relevant for the task (Experiment 1 and in two conditions where only one feature had to be recalled (Experiment 2. Results showed that when both features were task-relevant, even if the association of location and texture was neither necessary nor required to perform the task, participants exhibited a recall advantage in conditions in which the location and the texture of the target probe was kept unaltered between encoding and recall. By contrast, when only one feature was task-relevant, the concurrent feature did not influence the recall of the target feature. We conclude that attention to feature binding is not necessary for the emergence of feature integration in haptic WM. For binding to take place, however, it is necessary to encode and maintain in memory both the identity and the location of items.
reach satisfactory technical performance like latency and frame rate, while generating the sensory stimuli needed for this type of training —visual...release. Distribution is unlimited. USE OF VR TECHNOLOGY AND PASSIVE HAPTICS FOR MANPADS TRAINING SYSTEM by Faisal Rashid September 2017...HAPTICS FOR MANPADS TRAINING SYSTEM 5. FUNDING NUMBERS 6. AUTHOR(S) Faisal Rashid 7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) Naval
Woo, Hyun Soo; Kim, Woo Seok; Ahn, Woojin; Lee, Doo Yong; Yi, Sun Young
This paper presents an improved haptic interface for the Korea Advanced Institute of Science and Technology Ewha Colonoscopy Simulator II. The haptic interface enables the distal portion of the colonoscope to be freely bent while guaranteeing sufficient workspace and reflective forces for colonoscopy simulation. Its force-torque sensor measures the profiles of the user. Manipulation of the colonoscope tip is monitored by four deflection sensors and triggers computations to render accurate graphic images corresponding to the rotation of the angle knob. Tack sensors are attached to the valve-actuation buttons of the colonoscope to simulate air injection or suction as well as the corresponding deformation of the colon. A survey study for face validation was conducted, and the result shows that the developed haptic interface provides realistic haptic feedback for colonoscopy simulations.
Overholt, Daniel; Kontogeorgakopoulos, Alexandros; Berdahl, Edgar
The Haptic Signal Processing (HSP) platform aims to enable musicians to easily design and perform with digital haptic musical instruments . In this paper, we present some new objects introduced in version v2 for modeling of musical dynamical systems such as resonators and vibrating strings. To....... To our knowledge, this is the first time that these diverse physical modeling elements have all been made available for a modular, real-time haptics platform....
Saga, Satoshi; Konyo, Masashi
This book examines the state of the art in diverse areas of haptics (touch)-related research, including the psychophysics and neurophysiology of haptics, development of haptics displays and sensors, and applications to a wide variety of fields such as industry, education, therapy, medicine, and welfare for the visually impaired. It also discusses the potential of future haptics interaction, such as haptics for emotional control and remote haptics communication. The book offers a valuable resource not only for haptics and human interface researchers, but also for developers and designers at manufacturing corporations and in the entertainment industries.
Full Text Available Robotic surgery offers various advantages over conventional surgery that includes less bleeding, less trauma, and more precise tissue cutting. However, even surgeons who use the best commercially available surgical robotic systems complain about the absence of haptic feedback in such systems. In this paper, we present the findings of our project to overcome this shortcoming of surgical robotic systems, in which a haptic-enabled robotic system based on master and slave topology is designed and developed. To detect real-time intrusion at the slave end, haptic feedback is implemented along with a programmable system on chip, functioning as an embedded system for processing information. In order to obtain real-time haptic feedback, force and motion sensors are mounted on each joint of the master and slave units. At the master end, results are displayed through a graphical user interface, along with the physical feeling of intrusion at the slave part. Apart from the obvious applications of the current system in robotic surgery, it could also be used in designing more intuitive video games with further precise haptic feedback mechanisms. Moreover, the results presented in our work should pave the way for further scientific investigation, to provide even better haptic mechanisms.
Full Text Available When a short flash occurs in spatial alignment with a moving object, the moving object is seen ahead the stationary one. Similar to this visual "flash-lag effect" (FLE it has been recently observed for the haptic sense that participants judge a moving hand to be ahead a stationary hand when judged at the moment of a short vibration ("haptic flash" that is applied when the two hands are spatially aligned. We further investigated the haptic FLE. First, we compared participants' performance in two isosensory visual or haptic conditions, in which moving object and flash were presented only in a single modality (visual: sphere and short color change, haptic: hand and vibration, and two bisensory conditions, in which the moving object was presented in both modalities (hand aligned with visible sphere, but the flash was presented only visually or only haptically. The experiment aimed to disentangle contributions of the flash's and the objects' modalities to the FLEs in haptics versus vision. We observed a FLE when the flash was visually displayed, both when the moving object was visual and visuo-haptic. Because the position of a visual flash, but not of an analogue haptic flash, is misjudged relative to a same visuo-haptic moving object, the difference between visual and haptic conditions can be fully attributed to characteristics of the flash. The second experiment confirmed that a haptic FLE can be observed depending on flash characteristics: the FLE increases with decreasing intensity of the flash (slightly modulated by flash duration, which had been previously observed for vision. These findings underline the high relevance of flash characteristics in different senses, and thus fit well with the temporal-sampling framework, where the flash triggers a high-level, supra-modal process of position judgement, the time point of which further depends on the processing time of the flash.
Erolin, Caroline; Wilkinson, Caroline; Soames, Roger
This project aims to create a three-dimensional digital model of the human hand and wrist which can be virtually 'dissected' through a haptic interface. Tissue properties will be added to the various anatomical structures to replicate a realistic look and feel. The project will explore the role of the medical artist, and investigate cross-discipline collaborations in the field of virtual anatomy. The software will be used to train anatomy students in dissection skills, before experience on a real cadaver. The effectiveness of the software will be evaluated and assessed both quantitatively as well as qualitatively.
Full Text Available It is well known that visual information can be retained in several types of memory systems. Haptic information can also be retained in a memory because we can repeat a hand movement. There may be a common memory system for vision and action. On the one hand, it may be convenient to have a common system for acting with visual information. On the other hand, different modalities may have their own memory and use retained information without transforming specific to the modality. We compared memory properties of visual and haptic information. There is a phenomenon known as mental rotation, which is possibly unique to visual representation. The mental rotation is a phenomenon where reaction time increases with the angle of visual target (eg,, a letter to identify. The phenomenon is explained by the difference in time to rotate the representation of the target in the visual sytem. In this study, we compared the effect of stimulus angle on visual and haptic shape identification (two-line shapes were used. We found that a typical effect of mental rotation for the visual stimulus. However, no such effect was found for the haptic stimulus. This difference cannot be explained by the modality differences in response because similar difference was found even when haptical response was used for visual representation and visual response was used for haptic representation. These results indicate that there are independent systems for visual and haptic representations.
Savita Abdulpur Mallikarjun
Full Text Available Throughout history, education has evolved, and new teaching/learning methods have been developed. These methods have helped us come a long way in understanding the pathogenesis, diagnosis, and treatment of diseases of the oral cavity. However, there is still no one good way to render a student/clinician the tactile sense for detecting calculus/caries or placing the incisions or detecting the smoothness of a restoration or any treatment procedures before entering the clinics. In the education field, to improve the tactile sensation, the sense of touch and force-feedback can offer great improvements to the existing learning methods, thus enhancing the quality of education procedures. The concept of Haptics, which is extensively in use and indispensable in other fields like aviation, telecommunication etc., is now making its way into dentistry. Against this background, the following write-up intends to provide a glimpse of the coming wave of Haptics - A virtual reality system in dental education and discusses the strengths and weak points of this system.
ANDERSON, THOMAS G.; BRECKENRIDGE, ARTHURINE; DAVIDSON, GEORGE S.
The emerging field of haptics represents a fundamental change in human-computer interaction (HCI), and presents solutions to problems that are difficult or impossible to solve with a two-dimensional, mouse-based interface. To take advantage of the potential of haptics, however, innovative interaction techniques and programming environments are needed. This paper describes FGB (FLIGHT GHUI Builder), a programming tool that can be used to create an application specific graphical and haptic user interface (GHUI). FGB is itself a graphical and haptic user interface with which a programmer can intuitively create and manipulate components of a GHUI in real time in a graphical environment through the use of a haptic device. The programmer can create a GHUI without writing any programming code. After a user interface is created, FGB writes the appropriate programming code to a file, using the FLIGHT API, to recreate what the programmer created in the FGB interface. FGB saves programming time and increases productivity, because a programmer can see the end result as it is created, and FGB does much of the programming itself. Interestingly, as FGB was created, it was used to help build itself. The further FGB was in its development, the more easily and quickly it could be used to create additional functionality and improve its own design. As a finished product, FGB can be used to recreate itself in much less time than it originally required, and with much less programming. This paper describes FGB's GHUI components, the techniques used in the interface, how the output code is created, where programming additions and modifications should be placed, and how it can be compared to and integrated with existing API's such as MFC and Visual C++, OpenGL, and GHOST
Koutsoklenis, Athanasios; Papadopoulos, Konstantinos
Introduction: The study presented here examines which haptic cues individuals with visual impairments use more frequently and determines which of these cues are deemed by these individuals to be the most important for way-finding in urban environments. It also investigates the ways in which these haptic cues are used by individuals with visual…
Daniliauskaite, Kristina; Magnusdottir, Agusta; Bjørkå, Henrik Birke
, by relying on visual cues, taking therefore advantage of sensory substitution (no haptic feedback device is actually present). The interdependency between presence and a pseudo-haptic feedback is investigated by building avirtual bowling game. Results indicate that there is a significant correlation between...
Jin, Seung-A Annie
This study gauged the effects of force feedback in the Novint Falcon haptics system on the sensory and cognitive dimensions of a virtual test-driving experience. First, in order to explore the effects of tactile stimuli with force feedback on users' sensory experience, feelings of physical presence (the extent to which virtual physical objects are experienced as actual physical objects) were measured after participants used the haptics interface. Second, to evaluate the effects of force feedback on the cognitive dimension of consumers' virtual experience, this study investigated brand personality perception. The experiment utilized the Novint Falcon haptics controller to induce immersive virtual test-driving through tactile stimuli. The author designed a two-group (haptics stimuli with force feedback versus no force feedback) comparison experiment (N = 238) by manipulating the level of force feedback. Users in the force feedback condition were exposed to tactile stimuli involving various force feedback effects (e.g., terrain effects, acceleration, and lateral forces) while test-driving a rally car. In contrast, users in the control condition test-drove the rally car using the Novint Falcon but were not given any force feedback. Results of ANOVAs indicated that (a) users exposed to force feedback felt stronger physical presence than those in the no force feedback condition, and (b) users exposed to haptics stimuli with force feedback perceived the brand personality of the car to be more rugged than those in the control condition. Managerial implications of the study for product trial in the business world are discussed.
Full Text Available Virtual reality has provided immersion and interactions through computer generated environments attempting to reproduce real life experiences through sensorial stimuli. Realism can be achieved through multimodal interactions which can enhance the user’s presence within the computer generated world. The most notorious advances in virtual reality can be seen in computer graphics visuals, where photorealism is the norm thriving to overcome the uncanny valley. Other advances have followed related to sound, haptics, and in a lesser manner smell and taste feedback. Currently, virtual reality systems (multimodal immersion and interactions through visual-haptic-sound are being massively used in entertainment (e.g., cinema, video games, art, and in non-entertainment scenarios (e.g., social inclusion, educational, training, therapy, and tourism. Moreover, the cost reduction of virtual reality technologies has resulted in the availability at a consumer-level of various haptic, headsets, and motion tracking devices. Current consumer-level devices offer low-fidelity experiences due to the properties of the sensors, displays, and other electro-mechanical devices, that may not be suitable for high-precision or realistic experiences requiring dexterity. However, research has been conducted on how toovercome or compensate the lack of high fidelity to provide an engaging user experience using storytelling, multimodal interactions and gaming elements. Our work focuses on analyzing the possible effects of auditory perception on haptic feedback within a drilling scenario. Drilling involves multimodal interactions and it is a task with multiple applications in medicine, crafting, and construction. We compare two drilling scenarios were two groups of participants had to drill through wood while listening to contextual and non-contextual audios. We gathered their perception using a survey after the task completion. From the results, we believe that sound does
This book covers all topics relevant for the design of haptic interfaces and teleoperation systems. The book provides the basic knowledge required for understanding more complex approaches and more importantly it introduces all issues that must be considered for designing efficient and safe haptic interfaces. Topics covered in this book provide insight into all relevant components of a haptic system. The reader is guided from understanding the virtual reality concept to the final goal of being able to design haptic interfaces for specific tasks such as nanomanipulation. The introduction chapter positions the haptic interfaces within the virtual reality context. In order to design haptic interfaces that will comply with human capabilities at least basic understanding of human sensors-motor system is required. An overview of this topic is provided in the chapter related to human haptics. The book does not try to introduce the state-of-the-art haptic interface solutions because these tend to change quickly. On...
Park, Chung Hyuk; Ryu, Eun-Seok; Howard, Ayanna M
This paper presents a haptic telepresence system that enables visually impaired users to explore locations with rich visual observation such as art galleries and museums by using a telepresence robot, a RGB-D sensor (color and depth camera), and a haptic interface. The recent improvement on RGB-D sensors has enabled real-time access to 3D spatial information in the form of point clouds. However, the real-time representation of this data in the form of tangible haptic experience has not been challenged enough, especially in the case of telepresence for individuals with visual impairments. Thus, the proposed system addresses the real-time haptic exploration of remote 3D information through video encoding and real-time 3D haptic rendering of the remote real-world environment. This paper investigates two scenarios in haptic telepresence, i.e., mobile navigation and object exploration in a remote environment. Participants with and without visual impairments participated in our experiments based on the two scenarios, and the system performance was validated. In conclusion, the proposed framework provides a new methodology of haptic telepresence for individuals with visual impairments by providing an enhanced interactive experience where they can remotely access public places (art galleries and museums) with the aid of haptic modality and robotic telepresence.
Salisbury, C M; Gillespie, R B; Tan, H Z; Barbagli, F; Salisbury, J K
In this paper, we extend the concept of the contrast sensitivity function - used to evaluate video projectors - to the evaluation of haptic devices. We propose using human observers to determine if vibrations rendered using a given haptic device are accompanied by artifacts detectable to humans. This determination produces a performance measure that carries particular relevance to applications involving texture rendering. For cases in which a device produces detectable artifacts, we have developed a protocol that localizes deficiencies in device design and/or hardware implementation. In this paper, we present results from human vibration detection experiments carried out using three commercial haptic devices and one high performance voice coil motor. We found that all three commercial devices produced perceptible artifacts when rendering vibrations near human detection thresholds. Our protocol allowed us to pinpoint the deficiencies, however, and we were able to show that minor modifications to the haptic hardware were sufficient to make these devices well suited for rendering vibrations, and by extension, the vibratory components of textures. We generalize our findings to provide quantitative design guidelines that ensure the ability of haptic devices to proficiently render the vibratory components of textures.
In this greatly reworked second edition of Engineering Haptic Devices the psychophysic content has been thoroughly revised and updated. Chapters on haptic interaction, system structures and design methodology were rewritten from scratch to include further basic principles and recent findings. New chapters on the evaluation of haptic systems and the design of three exemplary haptic systems from science and industry have been added. This book was written for students and engineers that are faced with the development of a task-specific haptic system. It is a reference book for the basics of hap
Ando, Hideyuki; Kyung, Ki-Uk
This book is aimed not only at haptics and human interface researchers, but also at developers and designers from manufacturing corporations and the entertainment industry who are working to change our lives. This publication comprises the proceedings of the first International AsiaHaptics conference, held in Tsukuba, Japan, in 2014. The book describes the state of the art of the diverse haptics- (touch-) related research, including scientific research into haptics perception and illusion, development of haptics devices, and applications for a wide variety of fields such as education, medicine, telecommunication, navigation, and entertainment.
Queisser, Hans J.
Tributes are paid to Zhores Alferov by presenting personal anecdotes from the fields, where Alferov performed his pioneering research: masers, lasers, solar cells and heterojunctions. What a pleasure and honor to pay tribute to Zhores Alferov in this Festschrift. Member of a remarkable laboratory and originator of imaginative and useful ideas for semiconductor physics and technology; a happy birthday! I would like to use this opportunity to ramble a little about the physics of masers, lasers, heterojunctions, solar cells— all themes of such vital importance in Alferov's career—and also tangible in my own endeavors. I start out with an anecdote of a colloquium presentation in my youthful days at Göttingen. The Physics Colloquium at Göttingen University presented a serious weekly meeting. Werner Heisenberg and Carl Friedrich von Weizsäcker attended, often Wolfgang Pauli visited from Zurich; Otto Hahn always sat in the first row, on the left corner— and he smoked his cigar. I had just obtained my doctorate — it was 1958, and my boss Rudolf Hilsch ordered me to contribute a colloquium talk. He hoped that I would report on color centers in alkali halides or review experiments on quenched amorphous bismuth, a surprising superconductor , or on my own dissertation , all recent results of our team. I, however, being an avid reader of the latest American physics literature, begged to differ. The English language gave me no problems because I had in 1951/52 spent a year at the University of Kansas. This experience in the friendly American Midwest provided me with a definite linguistic advantage over most of my German fellow students. I was fascinated by those very first reports on the maser, this molecular amplifier using ammonia for stimulated emission, and therefore decided, quite to the chagrin of my boss Hilsch, to choose this particular topic for a report at the Colloquium. So I went to the rostrum in the small auditorium 'Hörsaal II' and delivered a
Våpenstad, Cecilie; Hofstad, Erlend Fagertun; Langø, Thomas; Mårvik, Ronald; Chmarra, Magdalena Karolina
To improve patient safety, training of psychomotor laparoscopic skills is often done on virtual reality (VR) simulators outside the operating room. Haptic sensations have been found to influence psychomotor performance in laparoscopy. The emulation of haptic feedback is thus an important aspect of VR simulation. Some VR simulators try to simulate these sensations with handles equipped with haptic feedback. We conducted a survey on how laparoscopic surgeons perceive handles with and without haptic feedback. Surgeons with different levels of experience in laparoscopy were asked to test two handles: Xitact IHP with haptic feedback and Xitact ITP without haptic feedback (Mentice AB, Gothenburg, Sweden), connected to the LapSim (Surgical Science AB, Sweden) VR simulator. They performed two tasks on the simulator before answering 12 questions regarding the two handles. The surgeons were not informed about the differences in the handles. A total of 85 % of the 20 surgeons who participated in the survey claimed that it is important that handles with haptic feedback feel realistic. Ninety percent of the surgeons preferred the handles without haptic feedback. The friction in the handles with haptic feedback was perceived to be as in reality (5 %) or too high (95 %). Regarding the handles without haptic feedback, the friction was perceived as in reality (45 %), too low (50 %), or too high (5 %). A total of 85 % of the surgeons thought that the handle with haptic feedback attempts to simulate the resistance offered by tissue to deformation. Ten percent thought that the handle succeeds in doing so. The surveyed surgeons believe that haptic feedback is an important feature on VR simulators; however, they preferred the handles without haptic feedback because they perceived the handles with haptic feedback to add additional friction, making them unrealistic and not mechanically transparent.
Tsetserukou, Dzmitry; Neviarouskaya, Alena; Prendinger, Helmut; Kawakami, Naoki; Ishizuka, Mitsuru; Tachi, Susumu
Driven by the motivation to enhance emotionally immersive experience of real-time messaging in 3D virtual world Second Life, we are proposing a conceptually novel approach to reinforcing (intensifying) own feelings and reproducing (simulating) the emotions felt by the partner through specially designed system, iFeel_IM!. In the paper we are describing the development of novel haptic devices (HaptiHeart, HaptiHug, HaptiTickler, HaptiCooler, and HaptiWarmer) integrated into iFeel_IM! system, which architecture is presented in detail.
L'Orsa, Rachael; Macnab, Chris J B; Tavakoli, Mahdi
Robots are becoming increasingly relevant to neurosurgeons, extending a neurosurgeon's physical capabilities, improving navigation within the surgical landscape when combined with advanced imaging, and propelling the movement toward minimally invasive surgery. Most surgical robots, however, isolate surgeons from the full range of human senses during a procedure. This forces surgeons to rely on vision alone for guidance through the surgical corridor, which limits the capabilities of the system, requires significant operator training, and increases the surgeon's workload. Incorporating haptics into these systems, ie, enabling the surgeon to "feel" forces experienced by the tool tip of the robot, could render these limitations obsolete by making the robot feel more like an extension of the surgeon's own body. Although the use of haptics in neurosurgical robots is still mostly the domain of research, neurosurgeons who keep abreast of this emerging field will be more prepared to take advantage of it as it becomes more prevalent in operating theaters. Thus, this article serves as an introduction to the field of haptics for neurosurgeons. We not only outline the current and future benefits of haptics but also introduce concepts in the fields of robotic technology and computer control. This knowledge will allow readers to be better aware of limitations in the technology that can affect performance and surgical outcomes, and "knowing the right questions to ask" will be invaluable for surgeons who have purchasing power within their departments.
Overvliet, K.E.; Plaisier, M.A.
Spatial arrangement is known to influence enumeration times in vision. In haptic enumeration, it has been shown that dividing the total number of items over the two hands can speed up enumeration. Here we investigated how spatial arrangement of items and non-items presented to the individual fingers
Gorn, R A; Steinert, R F
Neodymium:YAG laser cutting of polymethylmethacrylate and polypropylene anterior chamber and posterior chamber intraocular lens haptics was studied in terms of ease of transection and physical structure of the cut areas as seen by scanning electron microscopy. A marked difference was discovered, with the polymethylmethacrylate cutting easily along transverse planes, whereas the polypropylene resisted cutting along longitudinal fibers. Clinical guidelines are presented.
岩田, 洋夫; 矢野, 博明; 中泉, 文孝
"ANOMALOCARIS" is an interactive work, which represents virtual creature through visual and haptic sensation. Anomalocaris is a name of an animal that supposed to live during the Cambrian Era. Virtual anomalocaris is displayed on the HapticScreen. HapticScreen is a new configuration of a force feedback device. HapticScreen has an innovative mechanism that creates sense of touch on whole palm. The device deforms itself to present shapes of virtual object. Typical force feedback device uses a g...
Wang, Dangxiao; Zhang, Yuru; Yang, Xiaoxiao; Yang, Gaofeng; Yang, Yi
Focused attention has great impact on our quality of life. Our learning, social skills and even happiness are closely intertwined with our capacity for focused attention. Attention promotion is replete with examples of training-induced increases in attention capability, most of which rely on visual and auditory stimulation. Pure haptic stimulation to increase attention capability is rarely found. We show that accurate force control tasks with pure haptic feedback enhance short-term focused attention. Participants were trained by a force control task in which information from visual and auditory channels was blocked, and only haptic feedback was provided. The trainees were asked to exert a target force within a pre-defined force tolerance for a specific duration. The tolerance was adaptively modified to different levels of difficulty to elicit full participant engagement. Three attention tests showed significant changes in different aspects of focused attention in participants who had been trained as compared with those who had not, thereby illustrating the role of haptic-based sensory-motor tasks in the promotion of short-term focused attention. The findings highlight the potential value of haptic stimuli in brain plasticity and serve as a new tool to extend existing computer games for cognitive enhancement.
Maria Teresa Restivo
Full Text Available Haptics can significantly enhance the user's sense of immersion and interactivity. An industrial application of virtual reality and haptics for product assembly is described in this paper, which provides a new and low-cost approach for product assembly design, assembly task planning and assembly operation training. A demonstration of the system with haptics device interaction was available at the session of exp.at'11.
Bolopion , Aude; Ni , Zhenjiang; Agnus , Joël; Benosman , Ryad; Régnier , Stéphane
International audience; This work presents a stable vision based haptic feedback for micromanipulation using both an asynchronous Address Event Representation (AER) silicon retina and a conventional frame-based camera. At this scale, most of the grippers used to manipulate objects lack of force sensing. High frequency vision detection thus provides a sound solution to get information about the position of the object and the tool to provide virtual haptic guides. Artificial retinas present hig...
Ko, Sang Min; Lee, Kwangil; Kim, Daeho; Ji, Yong Gu
Haptic technology is used in various fields to transmit information to the user with or without visual and auditory cues. This study aimed to provide preliminary data for use in developing a haptic interface for an antigravity (anti-G) suit. With the structural characteristics of the anti-G suit in mind, we determined five areas on the body (lower back, outer thighs, inner thighs, outer calves, and inner calves) on which to install ten bar-type eccentric rotating mass (ERM) motors as vibration actuators. To determine the design factors of the haptic anti-G suit, we conducted three experiments to find the absolute threshold, moderate intensity, and subjective assessments of vibrotactile stimuli. Twenty-six fighter pilots participated in the experiments, which were conducted in a fixed-based flight simulator. From the results of our study, we recommend 1) absolute thresholds of ∼11.98-15.84 Hz and 102.01-104.06 dB, 2) moderate intensities of 74.36 Hz and 126.98 dB for the lower back and 58.65 Hz and 122.37 dB for either side of the thighs and calves, and 3) subjective assessments of vibrotactile stimuli (displeasure, easy to perceive, and level of comfort). The results of this study will be useful for the design of a haptic anti-G suit. Copyright © 2016 Elsevier Ltd. All rights reserved.
Pacchierotti, Claudio; Prattichizzo, Domenico; Kuchenbecker, Katherine J
Telerobotic systems enable humans to explore and manipulate remote environments for applications such as surgery and disaster response, but few such systems provide the operator with cutaneous feedback. This article presents a novel approach to remote cutaneous interaction; our method is compatible with any fingertip tactile sensor and any mechanical tactile display device, and it does not require a position/force or skin deformation model. Instead, it directly maps the sensed stimuli to the best possible input commands for the device's motors using a data set recorded with the tactile sensor inside the device. As a proof of concept, we considered a haptic system composed of a BioTac tactile sensor, in charge of measuring contact deformations, and a custom 3-DoF cutaneous device with a flat contact platform, in charge of applying deformations to the user's fingertip. To validate the proposed approach and discover its inherent tradeoffs, we carried out two remote tactile interaction experiments. The first one evaluated the error between the tactile sensations registered by the BioTac in a remote environment and the sensations created by the cutaneous device for six representative tactile interactions and 27 variations of the display algorithm. The normalized average errors in the best condition were 3.0 percent of the BioTac's full 12-bit scale. The second experiment evaluated human subjects' experiences for the same six remote interactions and eight algorithm variations. The average subjective rating for the best algorithm variation was 8.2 out of 10, where 10 is best.
Fontana, Marco; Marcheschi, Simone; Salsedo, Fabio; Bergamasco, Massimo
In this work we present the design process, the characterization and testing of a novel three-axis mechanical force sensor. This sensor is optimized for use in closed-loop force control of haptic devices with three degrees of freedom. In particular the sensor has been conceived for integration with a dual finger haptic interface that aims at simulating forces that occur during grasping and surface exploration. The sensing spring structure has been purposely designed in order to match force an...
Suwelack, Stefan; Sander, Christian; Schill, Julian; Serf, Manuel; Danz, Marcel; Asfour, Tamim; Burger, Wolfgang; Dillmann, Rüdiger; Speidel, Stefanie
In minimally invasive surgery (MIS), virtual reality (VR) training systems have become a promising education tool. However, the adoption of these systems in research and clinical settings is still limited by the high costs of dedicated haptics hardware for MIS. In this paper, we present ongoing research towards an open-source, low-cost haptic interface for MIS simulation. We demonstrate the basic mechanical design of the device, the sensor setup as well as its software integration.
Li, Hongbing; Zhang, Lei; Kawashima, Kenji
Currently, haptic systems ignore the varying impedance of the human hand with its countless configurations and thus cannot recreate the complex haptic interactions. The literature does not reveal a comprehensive survey on the methods proposed and this study is an attempt to bridge this gap. The paper includes an extensive review of human arm impedance modeling and control deployed to address inherent stability and transparency issues in haptic interaction and teleoperation systems. Detailed classification and comparative study of various contributions in human arm modeling are presented and summarized in tables and diagrams. The main challenges in modeling human arm impedance for haptic robotic applications are identified. The possible future research directions are outlined based on the gaps identified in the survey. Copyright © 2018 John Wiley & Sons, Ltd.
Full Text Available This paper surveys the haptic technologies deployed in cars and their uses to enhance drivers’ safety during manual driving. These technologies enable to deliver haptic (tactile or kinesthetic feedback at various areas of the car, such as the steering wheel, the seat, or the pedal. The paper explores two main uses of the haptic modality to fulfill the safety objective: to provide driving assistance and warning. Driving assistance concerns the transmission of information usually conveyed with other modalities for controlling the car’s functions, maneuvering support, and guidance. Warning concerns the prevention of accidents using emergency warnings, increasing the awareness of surroundings, and preventing collisions, lane departures, and speeding. This paper discusses how haptic feedback has been introduced so far for these purposes and provides perspectives regarding the present and future of haptic cars meant to increase driver’s safety.
Neupert, Carsten; Matich, Sebastian; Scherping, Nick; Kupnik, Mario; Werthschutzky, Roland; Hatzfeld, Christian
In this paper, we develop possible realizations of pseudo-haptic feedback in teleoperation systems based on existing works for pseudo-haptic feedback in virtual reality and the intended applications. We derive four potential factors affecting the performance of haptic feedback (calculation operator, maximum displacement, offset force, and scaling factor), which are analyzed in three compliance identification experiments. First, we analyze the principle usability of pseudo-haptic feedback by comparing information transfer measures for teleoperation and direct interaction. Pseudo-haptic interaction yields well above-chance performance, while direct interaction performs almost perfectly. In order to optimize pseudo-haptic feedback, in the second study we perform a full-factorial experimental design with 36 subjects performing 6,480 trials with 36 different treatments. Information transfer ranges from 0.68 bit to 1.72 bit in a task with a theoretical maximum of 2.6 bit, with a predominant effect of the calculation operator and a minor effect of the maximum displacement. In a third study, short- and long-term learning effects are analyzed. Learning effects regarding the performance of pseudo-haptic feedback cannot be observed for single-day experiments. Tests over 10 days show a maximum increase in information transfer of 0.8 bit. The results show the feasibility of pseudo-haptic feedback for teleoperation and can be used as design basis for task-specific systems.
Full Text Available Although acoustic frequency is not a spatial property of physical objects, in common language, pitch, i.e., the psychological correlated of frequency, is often labeled spatially (i.e., high in pitch or low in pitch. Pitch-height is known to modulate (and interact with the response of participants when they are asked to judge spatial properties of non-auditory stimuli (e.g., visual in a variety of behavioral tasks. In the current study we investigated whether the modulatory action of pitch-height extended to the haptic estimation of height of a virtual step.We implemented a HW/SW setup which is able to render virtual 3D objects (stair-steps haptically through a PHANTOM device, and to provide real-time continuous auditory feedback depending on the user interaction with the object. The haptic exploration was associated with a sinusoidal tone whose pitch varied as a function of the interaction point’s height within (i a narrower and (ii a wider pitch range, or (iii a random pitch variation acting as a control audio condition. Explorations were also performed with no sound (haptic only. Participants were instructed to explore the virtual step freely, and to communicate height estimation by opening their thumb and index finger to mimic the step riser height, or verbally by reporting the height in centimeters of the step riser. We analyzed the role of musical expertise by dividing participants into non musicians and musicians. Results showed no effects of musical pitch on high-realistic haptic feedback. Overall there is no difference between the two groups in the proposed multimodal conditions. Additionally, we observed a different haptic response distribution between musicians and non musicians when estimations of the auditory conditions are matched with estimations in the no sound condition.
Marchal-Crespo, Laura; van Raai, Mark; Rauter, Georg; Wolf, Peter; Riener, Robert
While haptic guidance can improve ongoing performance of a motor task, several studies have found that it ultimately impairs motor learning. However, some recent studies suggest that the haptic demonstration of optimal timing, rather than movement magnitude, enhances learning in subjects trained with haptic guidance. Timing of an action plays a crucial role in the proper accomplishment of many motor skills, such as hitting a moving object (discrete timing task) or learning a velocity profile (time-critical tracking task). The aim of the present study is to evaluate which feedback conditions-visual or haptic guidance-optimize learning of the discrete and continuous elements of a timing task. The experiment consisted in performing a fast tennis forehand stroke in a virtual environment. A tendon-based parallel robot connected to the end of a racket was used to apply haptic guidance during training. In two different experiments, we evaluated which feedback condition was more adequate for learning: (1) a time-dependent discrete task-learning to start a tennis stroke and (2) a tracking task-learning to follow a velocity profile. The effect that the task difficulty and subject's initial skill level have on the selection of the optimal training condition was further evaluated. Results showed that the training condition that maximizes learning of the discrete time-dependent motor task depends on the subjects' initial skill level. Haptic guidance was especially suitable for less-skilled subjects and in especially difficult discrete tasks, while visual feedback seems to benefit more skilled subjects. Additionally, haptic guidance seemed to promote learning in a time-critical tracking task, while visual feedback tended to deteriorate the performance independently of the task difficulty and subjects' initial skill level. Haptic guidance outperformed visual feedback, although additional studies are needed to further analyze the effect of other types of feedback visualization on
Han, Young-Min; Kim, Chan-Jung; Choi, Seung-Bok
This paper presents control performances of a magnetorheological (MR) fluid-based multifunctional haptic device which is applicable to vehicular instrument controls. By combining in-vehicle functions into a single device, the proposed haptic device can transmit various reflection forces for each comfort function to a driver without requiring the driver's visual attention. As a multifunctional haptic device, a MR knob is proposed in this work and then devised to be capable of both rotary and push motions with a single knob. Under consideration of the spatial limitations of vehicle dashboards, design parameters are optimally determined by finite element analysis, and the objective function is to maximize a relative control torque. The proposed haptic device is then manufactured, and in-vehicle comfort functions are constructed in a virtual environment which makes the functions to communicate with the haptic device. Subsequently, a feed-forward controller using torque/force maps is formulated for the force tracking control. Control performances such as reflection force of the haptic device are experimentally evaluated via the torque/force map-based feed-forward controller
Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok
This paper presents the design and control performance of a novel type of 4-degrees-of-freedom (4-DOF) haptic master in cyberspace for a robot-assisted minimally invasive surgery (RMIS) application. By using a controllable magnetorheological (MR) fluid, the proposed haptic master can have a feedback function for a surgical robot. Due to the difficulty in utilizing real human organs in the experiment, the cyberspace that features the virtual object is constructed to evaluate the performance of the haptic master. In order to realize the cyberspace, a volumetric deformable object is represented by a shape-retaining chain-linked (S-chain) model, which is a fast volumetric model and is suitable for real-time applications. In the haptic architecture for an RMIS application, the desired torque and position induced from the virtual object of the cyberspace and the haptic master of real space are transferred to each other. In order to validate the superiority of the proposed master and volumetric model, a tracking control experiment is implemented with a nonhomogenous volumetric cubic object to demonstrate that the proposed model can be utilized in real-time haptic rendering architecture. A proportional-integral-derivative (PID) controller is then designed and empirically implemented to accomplish the desired torque trajectories. It has been verified from the experiment that tracking the control performance for torque trajectories from a virtual slave can be successfully achieved.
Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok
This paper presents the design and control performance of a novel type of 4-degrees-of-freedom (4-DOF) haptic master in cyberspace for a robot-assisted minimally invasive surgery (RMIS) application. By using a controllable magnetorheological (MR) fluid, the proposed haptic master can have a feedback function for a surgical robot. Due to the difficulty in utilizing real human organs in the experiment, the cyberspace that features the virtual object is constructed to evaluate the performance of the haptic master. In order to realize the cyberspace, a volumetric deformable object is represented by a shape-retaining chain-linked (S-chain) model, which is a fast volumetric model and is suitable for real-time applications. In the haptic architecture for an RMIS application, the desired torque and position induced from the virtual object of the cyberspace and the haptic master of real space are transferred to each other. In order to validate the superiority of the proposed master and volumetric model, a tracking control experiment is implemented with a nonhomogenous volumetric cubic object to demonstrate that the proposed model can be utilized in real-time haptic rendering architecture. A proportional-integral-derivative (PID) controller is then designed and empirically implemented to accomplish the desired torque trajectories. It has been verified from the experiment that tracking the control performance for torque trajectories from a virtual slave can be successfully achieved. (paper)
Vinod Kumar Baranwal
Full Text Available BACKGROUND Postoperative noninfectious inflammation after cataract surgery, which can be persistent, remains an undesirable consequence despite many advances in surgical techniques. This ocular inflammation after cataract surgery presents ophthalmologists with a treatment dilemma. The aim of the study was to evaluate and correlate the IOL haptic location and the presence of noninfectious postoperative inflammation in pseudophakic eyes using Ultrasound Biomicroscopy (UBM. MATERIALS AND METHODS In this prospective study, 80 eyes of 80 cataract patients underwent SICS with 6 mm optic non-foldable PCIOL implantation. Post surgery, an examination protocol was followed wherein the patients were assessed by slit-lamp examination on day 1, 2, 7, 14 and 30 for flare and cells. A UBM examination was performed on day 30 for locating the IOL haptic position. Finally, the postoperative inflammation was correlated with IOL haptic position. RESULTS The results showed that IOL haptic position outside the capsular bag significantly increased the amount and duration of postoperative inflammation. CONCLUSION Haptic position outside the bag increases the incidence and duration of postoperative inflammation significantly. In patients undergoing SICS, the aim should be a large continuous curvilinear capsulorhexis within the bag implantation of IOL. UBM examination on day 30 after surgery to know position of IOL haptics outside the bag will be helpful in decreasing apprehension of operating surgeon and suggesting prolonged need of steroids in cases having more than expected postoperative inflammation.
Needham, Caroline; Wilkinson, Caroline; Soames, Roger
This project aims to create a three-dimensional digital model of the human hand and wrist which can be virtually 'dissected' through a haptic interface. Tissue properties will be added to the various anatomical structures to replicate a realistic look and feel. The project will explore the role of the medical artist and investigate the cross-discipline collaborations required in the field of virtual anatomy. The software will be used to train anatomy students in dissection skills before experience on a real cadaver. The effectiveness of the software will be evaluated and assessed both quantitatively as well as qualitatively.
Cattaneo, Zaira; Lega, Carlotta; Vecchi, Tomaso; Vallar, Giuseppe
Neurologically intact individuals usually show a leftward bias in line bisection, a tendency known as "pseudoneglect", likely reflecting a right-hemisphere dominance in controlling the allocation of spatial attention. Studies in brain-damaged patients with left visuospatial neglect have reported that auditory stimulation may reduce the deficit, both in a spatially dependent and in a spatially independent way. Here we show for the first time that the concurrent binaural presentation of auditory white noise affects healthy individuals' performance in both visual and haptic bisection, reducing their leftward error. We suggest that this effect depends on the noise boosting alertness and restoring the hemispheric activation balance. Our data clearly show that task-irrelevant auditory noise crossmodally affects the allocation of spatial resources in both the haptic and the visual space; future research may clarify whether these effects are specific for the type of auditory stimulation.
Keemink, Arvid Quintijn Leon
This dissertation covers three aspects of upper-extremity exoskeleton design: 1) Kinematics & motion: How to support the full range of motion of the human shoulder? We present a 2D visualization method that can show coupling between the range of motion (ROM) of rotations of the glenohumeral joint.
Ben Mitchinson; Ian Gilhespy; Chris Melhuish; Mokhtar Nibouche; Tony J. Prescott; Anthony G. Pipe; Martin J. Pearson
The design and implementation of the periphery of an artificial whisker sensory system is presented. It has been developed by adopting a biomimetic approach to model the structure and function of rodent facial vibrissae. The artificial vibrissae have been formed using composite materials and have the ability to be actively moved or whisked. The sensory structures at the root of real vibrissae has been modelled and implemented using micro strain gauges and Digital Signal Processors. The primar...
Gang, Han Gyeol; Park, Jiong Min; Choi, Seung-Bok; Sohn, Jung Woo
In this paper, a new type of haptic system for surgical robot application is proposed and its performances are evaluated experimentally. The proposed haptic system consists of an effective master device and a precision slave robot. The master device has 3-DOF rotational motion as same as human wrist motion. It has lightweight structure with a gyro sensor and three small-sized MR brakes for position measurement and repulsive torque generation, respectively. The slave robot has 3-DOF rotational motion using servomotors, five bar linkage and a torque sensor is used to measure resistive torque. It has been experimentally demonstrated that the proposed haptic system has good performances on tracking control of desired position and repulsive torque. It can be concluded that the proposed haptic system can be effectively applied to the surgical robot system in real field.
Riener, R; Villgrattner, T; Kleiser, R; Nef, T; Kollias, S
A new haptic interface device is suggested, which can be used for functional magnetic resonance imaging (fMRI) studies. The basic component of this 1 DOF haptic device are two coils that produce a Lorentz force induced by the large static magnetic field of the MR scanner. A MR-compatible optical angular encoder and a optical force sensor enable the implementation of different control architectures for haptic interactions. The challenge was to provide a large torque, and not to affect image quality by the currents applied in the device. The haptic device was tested in a 3T MR scanner. With a current of up to 1A and a distance of 1m to the focal point of the MR-scanner it was possible to generate torques of up to 4 Nm. Within these boundaries image quality was not affected.
Full Text Available The design and implementation of the periphery of an artificial whisker sensory system is presented. It has been developed by adopting a biomimetic approach to model the structure and function of rodent facial vibrissae. The artificial vibrissae have been formed using composite materials and have the ability to be actively moved or whisked. The sensory structures at the root of real vibrissae has been modelled and implemented using micro strain gauges and Digital Signal Processors. The primary afferents and vibrissal trigeminal ganglion have been modelled using empirical data taken from electrophysiological measurements, and implemented in real-time using a Field Programmable Gate Array. Pipelining techniques were employed to maximise the utility of the FPGA hardware. The system is to be integrated into a more complete whisker sensory model, including neural structures within the central nervous system, which can be used to orient a mobile robot.
Martin J. Pearson
Full Text Available The design and implementation of the periphery of an artificial whisker sensory system is presented. It has been developed by adopting a biomimetic approach to model the structure and function of rodent facial vibrissae. The artificial vibrissae have been formed using composite materials and have the ability to be actively moved or whisked. The sensory structures at the root of real vibrissae has been modelled and implemented using micro strain gauges and Digital Signal Processors. The primary afferents and vibrissal trigeminal ganglion have been modelled using empirical data taken from electrophysiological measurements, and implemented in real-time using a Field Programmable Gate Array. Pipelining techniques were employed to maximise the utility of the FPGA hardware. The system is to be integrated into a more complete whisker sensory model, including neural structures within the central nervous system, which can be used to orient a mobile robot.
Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok
In this work, magnetorheological (MR) based haptic master for robot-assisted minimally invasive surgery (RMIS) is proposed and analyzed. Using a controllable MR fluid, the masters can generate a reflection force with the 4-DOF motion. The proposed master consists of two actuators: MR clutch featuring gimbal mechanism for 2-DOF rotational motion (X and Y axes) and MR clutch attached at gripper of gimbal structures for 1-DOF rotational motion (Z axis) and 1-DOF translational motion. After analyzing the dynamic motion by integrating mechanical and physical properties of the actuators, torque model of the proposed haptic master is derived. For realization of master-slave system, an encoder which can measure position information is integrated with the MR haptic master. In the RMIS system, the measured position is converted as a command signal and sent to the slave robot. In this work, slave and organ of patient are modeled in virtual space. In order to embody a human organ into virtual space, a volumetric deformable object is mathematically formulated by a shape retaining chain linked (S-chain) model. Accordingly, the haptic architecture is established by incorporating the virtual slave with the master device in which the reflection force and desired position originated from the object of the virtual slave and operator of the master, respectively, are transferred to each other. In order to achieve the desired force trajectories, a proportional-integral-derivative (PID) controller is designed and implemented. It has been demonstrated that the effective tracking control performance for the desired motion of reflection force is well presented in time domain.
Rosen, B-G; Fall, A; Farbrot, A; Bergström, P; Rosen, S
The way a product or material feels when touched, haptics, has been shown to be a property that plays an important role when consumers determine the quality of products For tissue products in constant touch with the skin, ''softness'' becomes a primary quality parameter. In the present work, the relationship between topography and the feeling of the surface has been investigated for commercial tissues with varying degree of texture from the low textured crepe tissue to the highly textured embossed- and air-dried tissue products. A trained sensory panel at was used to grade perceived haptic ''roughness''. The technique used to characterize the topography was Digital light projection (DLP) technique, By the use of multivariate statistics, strong correlations between perceived roughness and topography were found with predictability of above 90 percent even though highly textured products were included. Characterization was made using areal ISO 25178-2 topography parameters in combination with non-contacting topography measurement. The best prediction ability was obtained when combining haptic properties with the topography parameters auto-correlation length (Sal), peak material volume (Vmp), core roughness depth (Sk) and the maximum height of the surface (Sz)
The past decade and a half has seen a tremendous rise in the use of mobile manipulator robotic platforms for bomb inspection and disposal, explosive ordnance disposal, and other extremely hazardous tasks in both military and civilian settings. Skilled operators are able to control these robotic vehicles in amazing ways given the very limited situational awareness obtained from a few on-board camera views. Future generations of robotic platforms will, no doubt, provide some sort of additional force or haptic sensor feedback to further enhance the operator's interaction with the robot, especially when dealing with fragile, unstable, and explosive objects. Unfortunately, the robot operators need this capability today. This paper discusses an approach to provide existing (and future) robotic mobile manipulator platforms, with which trained operators are already familiar and highly proficient, this desired haptic and force feedback capability. The goals of this technology are to be rugged, reliable, and affordable. It should also be able to be applied to a wide range of existing robots with a wide variety of manipulator/gripper sizes and styles. Finally, the presentation of the haptic information to the operator is discussed, given the fact that control devices that physically interact with the operators are not widely available and still in the research stages.
Pan, Jun J; Chang, Jian; Yang, Xiaosong; Zhang, Jian J; Qureshi, Tahseen; Howell, Robert; Hickish, Tamas
Medical simulators with vision and haptic feedback techniques offer a cost-effective and efficient alternative to the traditional medical trainings. They have been used to train doctors in many specialties of medicine, allowing tasks to be practised in a safe and repetitive manner. This paper describes a virtual-reality (VR) system which will help to influence surgeons' learning curves in the technically challenging field of laparoscopic surgery of the rectum. Data from MRI of the rectum and real operation videos are used to construct the virtual models. A haptic force filter based on radial basis functions is designed to offer realistic and smooth force feedback. To handle collision detection efficiently, a hybrid model is presented to compute the deformation of intestines. Finally, a real-time cutting technique based on mesh is employed to represent the incision operation. Despite numerous research efforts, fast and realistic solutions of soft tissues with large deformation, such as intestines, prove extremely challenging. This paper introduces our latest contribution to this endeavour. With this system, the user can haptically operate with the virtual rectum and simultaneously watch the soft tissue deformation. Our system has been tested by colorectal surgeons who believe that the simulated tactile and visual feedbacks are realistic. It could replace the traditional training process and effectively transfer surgical skills to novices. Copyright © 2011 John Wiley & Sons, Ltd.
Full Text Available In recent years, wearable haptic systems (WHS have gained increasing attention as a novel and exciting paradigm for human–robot interaction (HRI. These systems can be worn by users, carried around, and integrated in their everyday lives, thus enabling a more natural manner to deliver tactile cues. At the same time, the design of these types of devices presents new issues: the challenge is the correct identification of design guidelines, with the two-fold goal of minimizing system encumbrance and increasing the effectiveness and naturalness of stimulus delivery. Fabrics can represent a viable solution to tackle these issues. They are specifically thought “to be worn”, and could be the key ingredient to develop wearable haptic interfaces conceived for a more natural HRI. In this paper, the author will review some examples of fabric-based WHS that can be applied to different body locations, and elicit different haptic perceptions for different application fields. Perspective and future developments of this approach will be discussed.
Abbasi, Nida Itrat; Bodala, Indu Prasad; Bezerianos, Anastasios; Yu Sun; Al-Nashash, Hasan; Thakor, Nitish V
Development of interventions to prevent vigilance decrement has important applications in sensitive areas like transportation and defence. The objective of this work is to use multisensory (visual and haptic) stimuli for cognitive enhancement during mundane tasks. Two different epoch intervals representing sensory perception and motor response were analysed using minimum variance distortionless response (MVDR) based single trial ERP estimation to understand the performance dependency on both factors. Bereitschaftspotential (BP) latency L3 (r=0.6 in phase 1 (visual) and r=0.71 in phase 2 (visual and haptic)) was significantly correlated with reaction time as compared to that of sensory ERP latency L2 (r=0.1 in both phase 1 and phase 2). This implies that low performance in monotonous tasks is predominantly dependent on the prolonged neural interaction with the muscles to initiate movement. Further, negative relationship was found between the ERP latencies related to sensory perception and Bereitschaftspotential (BP) and occurrence of epochs when multisensory cues are provided. This means that vigilance decrement is reduced with the help of multisensory stimulus presentation in prolonged monotonous tasks.
Salisbury, Curt; Salisbury, Jr., J. Kenneth
A haptic device for telerobotic surgery, including a base; a linkage system having first and second linkage members coupled to the base; a motor that provides a motor force; a transmission including first and second driving pulleys arranged such that their faces form an angle and their axes form a plane, first and second idler pulleys offset from the plane and arranged between the first and second driving pulleys such that their axes divide the angle between the first and second driving pulleys, and a cable that traverses the first and second driving pulleys and the set of idler pulleys and transfers the motor force to the linkage system; an end effector coupled to distal ends of the first and second linkage members and maneuverable relative to the base; and a controller that modulates the motor force to simulate a body part at a point portion of the end effector.
Frankær, Sarah Maria Grundahl
The work presented in this Thesis deals with the development of a stimuli-adaptable polymer material based on the UV-induced dimerisation of cinnamic acid and its derivatives. It is in the nature of an adhesive to adhere very well to its substrate and therefore problems can arise upon removal...
Song, Yu; Guo, Shuxiang; Yin, Xuanchun; Zhang, Linshuai; Hirata, Hideyuki; Ishihara, Hidenori; Tamiya, Takashi
In this paper, a novel robot-assisted catheter operating system (RCOS) has been proposed as a method to reduce physical stress and X-ray exposure time to physicians during endovascular procedures. The unique design of this system allows the physician to apply conventional bedside catheterization skills (advance, retreat and rotate) to an input catheter, which is placed at the master side to control another patient catheter placed at the slave side. For this purpose, a magnetorheological (MR) fluids-based master haptic interface has been developed to measure the axial and radial motions of an input catheter, as well as to provide the haptic feedback to the physician during the operation. In order to achieve a quick response of the haptic force in the master haptic interface, a hall sensor-based closed-loop control strategy is employed. In slave side, a catheter manipulator is presented to deliver the patient catheter, according to position commands received from the master haptic interface. The contact forces between the patient catheter and blood vessel system can be measured by designed force sensor unit of catheter manipulator. Four levels of haptic force are provided to make the operator aware of the resistance encountered by the patient catheter during the insertion procedure. The catheter manipulator was evaluated for precision positioning. The time lag from the sensed motion to replicated motion is tested. To verify the efficacy of the proposed haptic feedback method, the evaluation experiments in vitro are carried out. The results demonstrate that the proposed system has the ability to enable decreasing the contact forces between the catheter and vasculature.
Boos, Amy; Qiu, Qinyin; Fluet, Gerard G; Adamovich, Sergei V
This study describes the design and feasibility testing of a hand rehabilitation system that provides haptic assistance for hand opening in moderate to severe hemiplegia while subjects attempt to perform bilateral hand movements. A cable-actuated exoskeleton robot assists the subjects in performing impaired finger movements but is controlled by movement of the unimpaired hand. In an attempt to combine the neurophysiological stimuli of bilateral movement and action observation during training, visual feedback of the impaired hand is replaced by feedback of the unimpaired hand, either by using a sagittaly oriented mirror or a virtual reality setup with a pair of virtual hands presented on a flat screen controlled with movement of the unimpaired hand, providing a visual image of their paretic hand moving normally. Joint angles for both hands are measured using data gloves. The system is programmed to maintain a symmetrical relationship between the two hands as they respond to commands to open and close simultaneously. Three persons with moderate to severe hemiplegia secondary to stroke trained with the system for eight, 30 to 60 minute sessions without adverse events. Each demonstrated positive motor adaptations to training. The system was well tolerated by persons with moderate to severe upper extremity hemiplegia. Further testing of its effects on motor ability with a broader range of clinical presentations is indicated.
Grunwald, M; Weiss, T; Krause, W; Beyer, L; Rost, R; Gutberlet, I; Gertz, H J
Several studies have reported a functional relationship between spectral power within the theta-band of the EEG (theta-power) and memory load while processing visual or semantic information. We investigated theta power during the processing of different complex haptic stimuli using a delayed recall design. The haptic explorations consisted of palpating the structure of twelve sunken reliefs with closed eyes. Subjects had to reproduce each relief by drawing it 10 s after the end of the exploration. The relationship between mean theta power and mean exploration time was analysed using a regression model. A linear relationship was found between the exploration time and theta power over fronto-central regions (Fp1, Fp2, F3, F7, F8, Fz, C3) directly before the recall of the relief. This result is interpreted in favour of the hypothesis that fronto-central theta power of the EEG correlates with the load of working memory independent of stimulus modality.
Cuartielles, David; Göransson, Andreas; Olsson, Tony
In this article we give an overview of our iterative work in developing visual editors for creating high resolution haptic patterns to be used in wearable, haptic feedback devices. During the past four years we have found the need to address the question of how to represent, construct and edit high...... resolution haptic patterns so that they translate naturally to the user’s haptic experience. To solve this question we have developed and tested several visual editors...
Han, Insook; Black, John B.
The purpose of this study was to investigate the effectiveness of a haptic augmented simulation in learning physics. The results indicate that haptic augmented simulations, both the force and kinesthetic and the purely kinesthetic simulations, were more effective than the equivalent non-haptic simulation in providing perceptual experiences and…
Bolopion, Aude; Dahmen, Christian; Stolle, Christian; Haliyo, Sinan; Régnier, Stéphane; Fatikow, Sergej
This article presents an intuitive environment for remote micromanipulation composed of both haptic feedback and virtual reconstruction of the scene. To enable nonexpert users to perform complex teleoperated micromanipulation tasks, it is of utmost importance to provide them with information about the 3-D relative positions of the objects and the tools. Haptic feedback is an intuitive way to transmit such information. Since position sensors are not available at this scale, visual feedback is used to derive information about the scene. In this work, three different techniques are implemented, evaluated, and compared to derive the object positions from scanning electron microscope images. The modified correlation matching with generated template algorithm is accurate and provides reliable detection of objects. To track the tool, a marker-based approach is chosen since fast detection is required for stable haptic feedback. Information derived from these algorithms is used to propose an intuitive remote manipulation system that enables users situated in geographically distant sites to benefit from specific equipments, such as SEMs. Stability of the haptic feedback is ensured by the minimization of the delays, the computational efficiency of vision algorithms, and the proper tuning of the haptic coupling. Virtual guides are proposed to avoid any involuntary collisions between the tool and the objects. This approach is validated by a teleoperation involving melamine microspheres with a diameter of less than 2 μ m between Paris, France and Oldenburg, Germany.
Meli, Leonardo; Pacchierotti, Claudio; Prattichizzo, Domenico
Haptic feedback has been proven to play a key role in enhancing the performance of teleoperated medical procedures. However, due to safety issues, commercially-available medical robots do not currently provide the clinician with haptic feedback. This work presents the experimental evaluation of a teleoperation system for robot-assisted medical procedures able to provide magnified haptic feedback to the clinician. Forces registered at the operating table are magnified and provided to the clinician through a 7-DoF haptic interface. The same interface is also used to control the motion of a 6-DoF slave robotic manipulator. The safety of the system is guaranteed by a time-domain passivity-based control algorithm. Two experiments were carried out on stiffness discrimination (during palpation and needle insertion) and one experiment on needle guidance. Our haptic-enabled teleoperation system improved the performance with respect to direct hand interaction of 80%, 306%, and 27% in stiffness discrimination through palpation, stiffness discrimination during needle insertion, and guidance, respectively. Copyright © 2017 John Wiley & Sons, Ltd.
Full Text Available This work presents a novel 4-degree-of-freedom (4-DOF haptic master using magnetorheological (MR fluid which is applicable to a robot-assisted minimally invasive surgery (RMIS system. By using MR fluid, the proposed haptic device can easily generate bidirectional repulsive torque along the directions of the required motions. The proposed master consists of two actuators: an MR bidirectional clutch associated with a planetary gear system and an MR clutch with a bevel gear system. After demonstrating the configuration, the torque models of MR actuators are mathematically derived based on the field-dependent Bingham model. An optimal design that accounts for spatial-limitation and the desired torque constraint is then undertaken. An optimization procedure based on finite element analysis is proposed to determine optimal geometric dimensions. Based on the design procedure, MR haptic master with the optimal parameters has been manufactured. In order to demonstrate the practical feasibility of the proposed haptic master, the field-dependent generating repulsive force is measured. In addition, a proportional-integral-derivative (PID controller is empirically implemented to accomplish the desired torque trajectories. It has been shown that the proposed haptic master can track the desired torque trajectory without a significant error.
Full Text Available This work presents a torque measurement method of 3-degree-of-freedom (3-DOF haptic master featuring controllable electrorheological (ER fluid. In order to reflect the sense of an organ for a surgeon, the ER haptic master which can generate the repulsive torque of an organ is utilized as a remote controller for a surgery robot. Since accurate representation of organ feeling is essential for the success of the robot-assisted surgery, it is indispensable to develop a proper torque measurement method of 3-DOF ER haptic master. After describing the structural configuration of the haptic master, the torque models of ER spherical joint are mathematically derived based on the Bingham model of ER fluid. A new type of haptic device which has pitching, rolling, and yawing motions is then designed and manufactured using a spherical joint mechanism. Subsequently, the field-dependent parameters of the Bingham model are identified and generating repulsive torque according to applied electric field is measured. In addition, in order to verify the effectiveness of the proposed torque model, a comparative work between simulated and measured torques is undertaken.
Singapogu, Ravikiran; Burg, Timothy; Burg, Karen J L; Smith, Dane E; Eckenrode, Amanda H
Laparoscopic surgery is a minimally invasive surgical technique with significant potential benefits to the patient, including shorter recovery time, less scarring, and decreased costs. There is a growing need to teach surgical trainees this emerging surgical technique. Simulators, ranging from simple "box" trainers to complex virtual reality (VR) trainers, have emerged as the most promising method for teaching basic laparoscopic surgical skills. Current box trainers require oversight from an expert surgeon for both training and assessing skills. VR trainers decrease the dependence on expert teachers during training by providing objective, real-time feedback and automatic skills evaluation. However, current VR trainers generally have limited credibility as a means to prepare new surgeons and have often fallen short of educators' expectations. Several researchers have speculated that the missing component in modern VR trainers is haptic feedback, which refers to the range of touch sensations encountered during surgery. These force types and ranges need to be adequately rendered by simulators for a more complete training experience. This article presents a perspective of the role and utility of haptic feedback during laparoscopic surgery and laparoscopic skills training by detailing the ranges and types of haptic sensations felt by the operating surgeon, along with quantitative studies of how this feedback is used. Further, a number of research studies that have documented human performance effects as a result of the presence of haptic feedback are critically reviewed. Finally, key research directions in using haptic feedback for laparoscopy training simulators are identified.
Kang, Seok-Rae; Choi, Seung-Bok; Hwang, Yong-Hoon; Cha, Seung-Woo
This paper presents a 7 degrees-of-freedom (7-DOF) haptic master which is applicable to the robot-assisted minimally invasive surgery (RMIS). By utilizing a controllable magneto-rheological (MR) fluid, the haptic master can provide force information to the surgeon during surgery. The proposed haptic master consists of three degrees motions of X, Y, Z and four degrees motions of the pitch, yaw, roll and grasping. All of them have force feedback capability. The proposed haptic master can generate the repulsive forces or torques by activating MR clutch and MR brake. Both MR clutch and MR brake are designed and manufactured with consideration of the size and output torque which is usable to the robotic surgery. A proportional-integral-derivative (PID) controller is then designed and implemented to achieve torque/force tracking trajectories. It is verified that the proposed haptic master can track well the desired torque and force occurred in the surgical place by controlling the input current applied to MR clutch and brake.
Fontana, Marco; Marcheschi, Simone; Salsedo, Fabio; Bergamasco, Massimo
In this work we present the design process, the characterization and testing of a novel three-axis mechanical force sensor. This sensor is optimized for use in closed-loop force control of haptic devices with three degrees of freedom. In particular the sensor has been conceived for integration with a dual finger haptic interface that aims at simulating forces that occur during grasping and surface exploration. The sensing spring structure has been purposely designed in order to match force and layout specifications for the application. In this paper the design of the sensor is presented, starting from an analytic model that describes the characteristic matrix of the sensor. A procedure for designing an optimal overload protection mechanism is proposed. In the last part of the paper the authors describe the experimental characterization and the integrated test on a haptic hand exoskeleton showing the improvements in the controller performances provided by the inclusion of the force sensor.
Full Text Available In this work we present the design process, the characterization and testing of a novel three-axis mechanical force sensor. This sensor is optimized for use in closed-loop force control of haptic devices with three degrees of freedom. In particular the sensor has been conceived for integration with a dual finger haptic interface that aims at simulating forces that occur during grasping and surface exploration. The sensing spring structure has been purposely designed in order to match force and layout specifications for the application. In this paper the design of the sensor is presented, starting from an analytic model that describes the characteristic matrix of the sensor. A procedure for designing an optimal overload protection mechanism is proposed. In the last part of the paper the authors describe the experimental characterization and the integrated test on a haptic hand exoskeleton showing the improvements in the controller performances provided by the inclusion of the force sensor.
Platkiewicz, Jonathan; Lipson, Hod; Hayward, Vincent
Most tactile sensors are based on the assumption that touch depends on measuring pressure. However, the pressure distribution at the surface of a tactile sensor cannot be acquired directly and must be inferred from the deformation field induced by the touched object in the sensor medium. Currently, there is no consensus as to which components of strain are most informative for tactile sensing. Here, we propose that shape-related tactile information is more suitably recovered from shear strain than normal strain. Based on a contact mechanics analysis, we demonstrate that the elastic behavior of a haptic probe provides a robust edge detection mechanism when shear strain is sensed. We used a jamming-based robot gripper as a tactile sensor to empirically validate that shear strain processing gives accurate edge information that is invariant to changes in pressure, as predicted by the contact mechanics study. This result has implications for the design of effective tactile sensors as well as for the understanding of the early somatosensory processing in mammals.
Goodrich, Kenneth H.; Schutte, Paul C.; Williams, Ralph A.
The rapidly advancing capabilities of autonomous aircraft suggest a future where many of the responsibilities of today s pilot transition to the vehicle, transforming the pilot s job into something akin to driving a car or simply being a passenger. Notionally, this transition will reduce the specialized skills, training, and attention required of the human user while improving safety and performance. However, our experience with highly automated aircraft highlights many challenges to this transition including: lack of automation resilience; adverse human-automation interaction under stress; and the difficulty of developing certification standards and methods of compliance for complex systems performing critical functions traditionally performed by the pilot (e.g., sense and avoid vs. see and avoid). Recognizing these opportunities and realities, researchers at NASA Langley are developing a haptic-multimodal flight control (HFC) system concept that can serve as a bridge between today s state of the art aircraft that are highly automated but have little autonomy and can only be operated safely by highly trained experts (i.e., pilots) to a future in which non-experts (e.g., drivers) can safely and reliably use autonomous aircraft to perform a variety of missions. This paper reviews the motivation and theoretical basis of the HFC system, describes its current state of development, and presents results from two pilot-in-the-loop simulation studies. These preliminary studies suggest the HFC reshapes human-automation interaction in a way well-suited to revolutionary ease-of-use.
Easton, R D; Srinivas, K; Greene, A J
Previous assessments of verbal cross-modal priming have typically been conducted with the visual and auditory modalities. Within-modal priming is always found to be substantially larger than cross-modal priming, a finding that could reflect modality modularity, or alternatively, differences between the coding of visual and auditory verbal information (i.e., geometric vs. phonological). The present experiments assessed implicit and explicit memory within and between vision and haptics, where verbal information could be coded in geometric terms. Because haptic perception of words is sequential or letter-by-letter, experiments were also conducted to isolate the effects of simultaneous versus sequential processing from the manipulation of modality. Together, the results reveal no effects of modality change on implicit or explicit tests. The authors discuss representational similarities between vision and haptics as well as image mediation as possible explanations for the results.
Perdigão, Luís M A; Saywell, Alex
The operation of a haptic device interfaced with a scanning tunneling microscope (STM) is presented here. The user moves the STM tip in three dimensions by means of a stylus attached to the haptic instrument. The tunneling current measured by the STM is converted to a vertical force, applied to the stylus and felt by the user, with the user being incorporated into the feedback loop that controls the tip-surface distance. A haptic-STM interface of this nature allows the user to feel atomic features on the surface and facilitates the tactile manipulation of the adsorbate/substrate system. The operation of this device is demonstrated via the room temperature STM imaging of C(60) molecules adsorbed on an Au(111) surface in ultra-high vacuum.
Ergin, Mehmet Alper; Kühne, Markus; Thielscher, Axel
Functional magnetic resonance imaging is an often adopted tool to study human motor control mechanisms. Highly controlled experiments as required by this form of analysis can be realized with haptic interfaces. Their design is challenging because of strong safety and MR compatibility requirements....... Existing MR-compatible haptic interfaces are restricted to maximum three actuated degrees of freedom. We propose an MR-compatible haptic interface with six actuated degrees of freedom to be able to study human brain mechanisms of natural pick-and-place movements including arm transport. In this work, we...... present its mechanical design, kinematic and dynamic model, as well as report on its model-based characterization. A novel hybrid control scheme for the employed ultrasonic motors is introduced. Preliminary MR compatibility tests based on one complete actuator-sensor module are performed. No measurable...
Full Text Available In robot-assisted tele-operated laparoscopic surgeries, the patient side manipulators are controlled via the master manipulators that are controlled by the surgeon. The current generation of robots approved for laparoscopic surgery lack haptic feedback. In theory, haptic feedback would enhance the surgical procedures by enabling better coordination between the hand movements that are improved by the tactile sense of the operating environment. This research presents an overall control framework for a haptic feedback on existing robot platforms, and demonstrated on the daVinci Research Kit (dVRK system. The paper discusses the implementation of a flexible framework that incorporates a stiffness control with gravity compensation for the surgeons manipulator and a sensing and collision detection algorithm for calculating the interaction between the patients manipulators and the surgical area.
Ozsecen, Muzaffer Y.; Sivak, Mark; Mavroidis, Constantinos
Quality, amplitude and frequency of the interaction forces between a human and an actuator are essential traits for haptic applications. A variety of Electro-Active Polymer (EAP) based actuators can provide these characteristics simultaneously with quiet operation, low weight, high power density and fast response. This paper demonstrates a rolled Dielectric Elastomer Actuator (DEA) being used as a telepresence device in a heart beat measurement application. In the this testing, heart signals were acquired from a remote location using a wireless heart rate sensor, sent through a network and DEA was used to haptically reproduce the heart beats at the medical expert's location. A series of preliminary human subject tests were conducted that demonstrated that a) DE based haptic feeling can be used in heart beat measurement tests and b) through subjective testing the stiffness and actuator properties of the EAP can be tuned for a variety of applications.
Covarrubias, Mario; Bordegoni, Monica; Cugini, Umberto
In this article, we present an approach that uses both two force sensitive handles (FSH) and a flexible capacitive touch sensor (FCTS) to drive a haptic-based immersive system. The immersive system has been developed as part of a multimodal interface for product design. The haptic interface consists of a strip that can be used by product designers to evaluate the quality of a 3D virtual shape by using touch, vision and hearing and, also, to interactively change the shape of the virtual object...
Tremblay, Line; Bouchard, Stephane; Chebbi, Brahim; Wei, Lai; Monthuy-Blanc, Johana; Boulanger, Dominic
We report the results of a preliminary study testing the effect of participants' mood rating on visual motor performance using a haptic device to manipulate a cartoonish human body. Our results suggest that moods involving high arousal (e.g. happiness) produce larger movements whereas mood involving low arousal (e.g. sadness) produce slower speed of performance. Our results are used for the development of a new haptic virtual reality application that we briefly present here. This application is intended to create a more interactive and motivational environment to treat body image issues and for emotional communication.
Starting with novel algorithms for optimally updating bounding volume hierarchies of objects undergoing arbitrary deformations, the author presents a new data structure that allows, for the first time, the computation of the penetration volume. The penetration volume is related to the water displacement of the overlapping region, and thus corresponds to a physically motivated and continuous force. The practicability of the approaches used is shown by realizing new applications in the field of robotics and haptics, including a user study that evaluates the influence of the degrees of freedom in
Full Text Available Categorization has traditionally been studied in the visual domain with only a few studies focusing on the abilities of the haptic system in object categorization. During the first years of development, however, touch and vision are closely coupled in the exploratory procedures used by the infant to gather information about objects. Here, we investigate how well shape information can be transferred between those two modalities in a categorization task. Our stimuli consisted of amoeba-like objects that were parametrically morphed in well-defined steps. Participants explored the objects in a categorization task either visually or haptically. Interestingly, both modalities led to similar categorization behavior suggesting that similar shape processing might occur in vision and haptics. Next, participants received training on specific categories in one of the two modalities. As would be expected, training increased performance in the trained modality; however, we also found significant transfer of training to the other, untrained modality after only relatively few training trials. Taken together, our results demonstrate that complex shape information can be transferred efficiently across the two modalities, which speaks in favor of multisensory, higher-level representations of shape.
Full Text Available This paper investigates the integration of a multimodal sensing system for exploring limits of vibrato tactile haptic feedback when interacting with 3D representation of real objects. In this study, the spatial locations of the objects are mapped to the work volume of the user using a Kinect sensor. The position of the user’s hand is obtained using the marker-based visual processing. The depth information is used to build a vibrotactile map on a haptic glove enhanced with vibration motors. The users can perceive the location and dimension of remote objects by moving their hand inside a scanning region. A marker detection camera provides the location and orientation of the user’s hand (glove to map the corresponding tactile message. A preliminary study was conducted to explore how different users can perceive such haptic experiences. Factors such as total number of objects detected, object separation resolution, and dimension-based and shape-based discrimination were evaluated. The preliminary results showed that the localization and counting of objects can be attained with a high degree of success. The users were able to classify groups of objects of different dimensions based on the perceived haptic feedback.
Having identified key determinants of teaching and learning spinal anesthesia, it was necessary to characterize and render the haptic sensations (feeling of touch) associated with needle insertion in the lower back. The approach used is to match recreated sensations (eg, "pop" through skin or dura mater) with experts\\' perceptions of the equivalent clinical events.
Turchet, Luca; Serafin, Stefania
In this paper, we present an experiment whose goal is to assess the role of temporal aspects in sonically and haptically simulating the act of walking on a bump or a hole. In particular, we investigated whether the timing between heel and toe and the timing between footsteps affected perception...
Stramigioli, Stefano; Mahony, Robert; Corke, Peter
We present a novel, simple and effective approach for tele-operation of aerial robotic vehicles with haptic feedback. Such feedback provides the remote pilot with an intuitive feel of the robot's state and perceived local environment that will ensure simple and safe operation in cluttered 3D
Rovers, A.F.; Essen, van H.A.
A new method for researching haptic interaction styles is presented, based on a layered interaction model and a classification of existing devices. The method is illustrated by designing a new foot interaction device. The aim of which is to enhance non-verbal communication over a computer network. A
Ruesch, A.; Mersha, A.Y.; Stramigioli, Stefano; Carloni, Raffaella
In this paper, we present a haptic teleoperation control algorithm for unmanned aerial vehicles, applying a kinetic scrolling-based position mapping. The proposed algorithm overcomes the master workspace limitations and enables to teleoperate the aerial vehicle in unbounded workspace in a fast and
Lindauer, M S
Physiognomic color responses in perception, imagery, and affect were investigated. Maluma and taketa, nonsense stimuli defined by many investigators as physiognomic, were utilized as prototypical physiognomic stimuli, along with eight other stimuli of various sorts. In Experiment 1, 22 subjects matched the colors of the stimuli; in Experiment 2, 27 subjects reported their imagery to the stimuli; and in Experiment 3, 16 subjects gave their color preferences for the stimuli. The Munsell sets of colors were employed throughout. Significant differences between the physiognomic and other stimuli were found on the brightness and saturation of color matches, images, and preferences. Other differences (e.g., the latency of color images) were also present. Distinctions were also noted between the two physiognomic stimuli. These results support the priority of innate and perceptual processes in physiognomy over those of learning and memory, although some ambiguities still remain.
Tse, Z T H; Elhawary, H; Rea, M; Young, I; Davis, B L; Lamperth, M
The magnetic fields present in the magnetic resonance (MR) environment impose severe constraints on any mechatronic device present in its midst, requiring alternative actuators, sensors, and materials to those conventionally used in traditional system engineering. In addition the spatial constraints of closed-bore scanners require a physical separation between the radiologist and the imaged region of the patient. This configuration produces a loss of the sense of touch from the target anatomy for the clinician, which often provides useful information. To recover the force feedback from the tissue, an MR-compatible haptic unit, designed to be integrated with a five-degrees-of-freedom mechatronic system for MR-guided prostate biopsy, has been developed which incorporates position control and force feedback to the operator. The haptic unit is designed to be located inside the scanner isocentre with the master console in the control room. MR compatibility of the device has been demonstrated, showing a negligible degradation of the signal-to-noise ratio and virtually no geometric distortion. By combining information from the position encoder and force sensor, tissue stiffness measurement along the needle trajectory is demonstrated in a lamb liver to aid diagnosis of suspected cancerous tissue.
Moreno-Montañés, Javier; Fernández-Hortelano, Ana; Caire, Josemaría
An 82-year-old man had uneventful phacoemulsification with bilateral implantation of a hydrophilic acrylic, single-piece intraocular lens (IOL) (ACR6D SE, Laboratoires Cornéal). Five years later, simultaneous and bilateral IOL subluxations occurred. In both eyes, the subluxation was situated on the side of one haptic that had moved forward (temporal area in the right eye and superior area in the left eye). In the right eye, the haptic-capsular bag was entrapped by the pupil and produced endothelial damage. A transscleral suture was placed over and under the subluxated haptic through the anterior and posterior capsules to capture the haptic. The haptic was then sutured to the sclera. No postoperative complications developed. We hypothesize that 10-degree angulated and broad haptic junctions can lead to zonular damage and IOL subluxation.
Lee, Huai-Ping; Audette, Michel; Joldes, Grand R.; Enquobahrie, Andinet
Real-time surgical simulation is becoming an important component of surgical training. To meet the realtime requirement, however, the accuracy of the biomechancial modeling of soft tissue is often compromised due to computing resource constraints. Furthermore, haptic integration presents an additional challenge with its requirement for a high update rate. As a result, most real-time surgical simulation systems employ a linear elasticity model, simplified numerical methods such as the boundary element method or spring-particle systems, and coarse volumetric meshes. However, these systems are not clinically realistic. We present here an ongoing work aimed at developing an efficient and physically realistic neurosurgery simulator using a non-linear finite element method (FEM) with haptic interaction. Real-time finite element analysis is achieved by utilizing the total Lagrangian explicit dynamic (TLED) formulation and GPU acceleration of per-node and per-element operations. We employ a virtual coupling method for separating deformable body simulation and collision detection from haptic rendering, which needs to be updated at a much higher rate than the visual simulation. The system provides accurate biomechancial modeling of soft tissue while retaining a real-time performance with haptic interaction. However, our experiments showed that the stability of the simulator depends heavily on the material property of the tissue and the speed of colliding objects. Hence, additional efforts including dynamic relaxation are required to improve the stability of the system.
Tarcisio Torres Silva
Full Text Available In this paper, it is intended to propose a theoretical approach to the political effects of the sense of touch/haptic in order to understand to what extent the intensification of contemporary haptic experience contributes to create proximity and engagement among individuals overloaded by too much visual information offered by multiple media. At the end, it is mentioned the work of Brazilian artist Rodrigo Braga to exemplify the contemporary political use of haptic sense.
Sørensen, Thomas Sangild; Mosegaard, Jesper
The GPU has proven to be a powerful processor to compute spring-mass based surgical simulations. It has not previously been shown however, how to effectively implement haptic interaction with a simulation running entirely on the GPU. This paper describes a method to calculate haptic feedback...... with limited performance cost. It allows easy balancing of the GPU workload between calculations of simulation, visualisation, and the haptic feedback....
Färber, Matthias; Heller, Julika; Handels, Heinz
The lumbar puncture is performed by inserting a needle into the spinal chord of the patient to inject medicaments or to extract liquor. The training of this procedure is usually done on the patient guided by experienced supervisors. A virtual reality lumbar puncture simulator has been developed in order to minimize the training costs and the patient's risk. We use a haptic device with six degrees of freedom (6DOF) to feedback forces that resist needle insertion and rotation. An improved haptic volume rendering approach is used to calculate the forces. This approach makes use of label data of relevant structures like skin, bone, muscles or fat and original CT data that contributes information about image structures that can not be segmented. A real-time 3D visualization with optional stereo view shows the punctured region. 2D visualizations of orthogonal slices enable a detailed impression of the anatomical context. The input data consisting of CT and label data and surface models of relevant structures is defined in an XML file together with haptic rendering and visualization parameters. In a first evaluation the visible human male data has been used to generate a virtual training body. Several users with different medical experience tested the lumbar puncture trainer. The simulator gives a good haptic and visual impression of the needle insertion and the haptic volume rendering technique enables the feeling of unsegmented structures. Especially, the restriction of transversal needle movement together with rotation constraints enabled by the 6DOF device facilitate a realistic puncture simulation.
In recent years, a haptic device that output power as one of the computer output devices has been developed. We can get the feeling that we really touch the material through a sensor of haptic device when we touch a material simulated in a computer. In this research, a virtual guitar in which the feeling playing guitar and the sound volume are changed by adjusting power to input with a haptic device was developed. With the haptic device we feel as if we play a genuine guitar. Moreover, it see...
Visell, Y; Law, A; Cooperstock, J R
Floor surfaces are notable for the diverse roles that they play in our negotiation of everyday environments. Haptic communication via floor surfaces could enhance or enable many computer-supported activities that involve movement on foot. In this paper, we discuss potential applications of such interfaces in everyday environments and present a haptically augmented floor component through which several interaction methods are being evaluated. We describe two approaches to the design of structured vibrotactile signals for this device. The first is centered on a musical phrase metaphor, as employed in prior work on tactile display. The second is based upon the synthesis of rhythmic patterns of virtual physical impact transients. We report on an experiment in which participants were able to identify communication units that were constructed from these signals and displayed via a floor interface at well above chance levels. The results support the feasibility of tactile information display via such interfaces and provide further indications as to how to effectively design vibrotactile signals for them.
Davis, J.T. [Oak Ridge National Lab., TN (United States); Book, W.J. [Georgia Inst. of Tech., Atlanta, GA (United States). School of Mechanical Engineering
Haptic interfaces enhance cooperation between humans and robotic manipulators by providing force and tactile feedback to the human user during the execution of arbitrary tasks. The use of active actuators in haptic displays presents a certain amount of risk since they are capable of providing unacceptable levels of energy to the systems upon which they operate. An alternative to providing numerous safeguards is to remove the sources of risk altogether. This research investigates the feasibility of trajectory control using passive devices, that is, devices that cannot add energy to the system. Passive actuators are capable only of removing energy from the system or transferring energy within the system. It is proposed that the utility of passive devices is greatly enhanced by the use of redundant actuators. In a passive system, once motion is provided to the system, presumably by a human user, passive devices may be able to modify this motion to achieve a desired resultant trajectory. A mechanically passive, 2-Degree-of-Freedom (D.O.F.) manipulator has been designed and built. It is equipped with four passive actuators: two electromagnetic brakes and two electromagnetic clutches. This paper gives a review of the literature on passive and robotics and describes the experimental test bed used in this research. Several control algorithms are investigated, resulting in the formulation of a passive control law.
Hellman, Randall B; Tekin, Cem; van der Schaar, Mihaela; Santos, Veronica J
Many tasks involve the fine manipulation of objects despite limited visual feedback. In such scenarios, tactile and proprioceptive feedback can be leveraged for task completion. We present an approach for real-time haptic perception and decision-making for a haptics-driven, functional contour-following task: the closure of a ziplock bag. This task is challenging for robots because the bag is deformable, transparent, and visually occluded by artificial fingertip sensors that are also compliant. A deep neural net classifier was trained to estimate the state of a zipper within a robot's pinch grasp. A Contextual Multi-Armed Bandit (C-MAB) reinforcement learning algorithm was implemented to maximize cumulative rewards by balancing exploration versus exploitation of the state-action space. The C-MAB learner outperformed a benchmark Q-learner by more efficiently exploring the state-action space while learning a hard-to-code task. The learned C-MAB policy was tested with novel ziplock bag scenarios and contours (wire, rope). Importantly, this work contributes to the development of reinforcement learning approaches that account for limited resources such as hardware life and researcher time. As robots are used to perform complex, physically interactive tasks in unstructured or unmodeled environments, it becomes important to develop methods that enable efficient and effective learning with physical testbeds.
Davis, J.T.; Book, W.J.
Haptic interfaces enhance cooperation between humans and robotic manipulators by providing force and tactile feedback to the human user during the execution of arbitrary tasks. The use of active actuators in haptic displays presents a certain amount of risk since they are capable of providing unacceptable levels of energy to the systems upon which they operate. An alternative to providing numerous safeguards is to remove the sources of risk altogether. This research investigates the feasibility of trajectory control using passive devices, that is, devices that cannot add energy to the system. Passive actuators are capable only of removing energy from the system or transferring energy within the system. It is proposed that the utility of passive devices is greatly enhanced by the use of redundant actuators. In a passive system, once motion is provided to the system, presumably by a human user, passive devices may be able to modify this motion to achieve a desired resultant trajectory. A mechanically passive, 2-Degree-of-Freedom (D.O.F.) manipulator has been designed and built. It is equipped with four passive actuators: two electromagnetic brakes and two electromagnetic clutches. This paper gives a review of the literature on passive and robotics and describes the experimental test bed used in this research. Several control algorithms are investigated, resulting in the formulation of a passive control law
Full Text Available In this article, we present an approach that uses both two force sensitive handles (FSH and a flexible capacitive touch sensor (FCTS to drive a haptic-based immersive system. The immersive system has been developed as part of a multimodal interface for product design. The haptic interface consists of a strip that can be used by product designers to evaluate the quality of a 3D virtual shape by using touch, vision and hearing and, also, to interactively change the shape of the virtual object. Specifically, the user interacts with the FSH to move the virtual object and to appropriately position the haptic interface for retrieving the six degrees of freedom required for both manipulation and modification modalities. The FCTS allows the system to track the movement and position of the user’s fingers on the strip, which is used for rendering visual and sound feedback. Two evaluation experiments are described, which involve both the evaluation and the modification of a 3D shape. Results show that the use of the haptic strip for the evaluation of aesthetic shapes is effective and supports product designers in the appreciation of the aesthetic qualities of the shape.
Elayaperumal, Santhi; Bae, Jung Hwa; Daniel, Bruce L; Cutkosky, Mark R
This paper presents calibration and user test results of a 3-D tip-force sensing needle with haptic feedback. The needle is a modified MRI-compatible biopsy needle with embedded fiber Bragg grating (FBG) sensors for strain detection. After calibration, the needle is interrogated at 2 kHz, and dynamic forces are displayed remotely with a voice coil actuator. The needle is tested in a single-axis master/slave system, with the voice coil haptic display at the master, and the needle at the slave end. Tissue phantoms with embedded membranes were used to determine the ability of the tip-force sensors to provide real-time haptic feedback as compared to external sensors at the needle base during needle insertion via the master/slave system. Subjects were able to determine the position of the embedded membranes with significantly better accuracy using FBG tip feedback than with base feedback using a commercial force/torque sensor (p = 0.045) or with no added haptic feedback (p = 0.0024).
Covarrubias, Mario; Bordegoni, Monica; Cugini, Umberto
In this article, we present an approach that uses both two force sensitive handles (FSH) and a flexible capacitive touch sensor (FCTS) to drive a haptic-based immersive system. The immersive system has been developed as part of a multimodal interface for product design. The haptic interface consists of a strip that can be used by product designers to evaluate the quality of a 3D virtual shape by using touch, vision and hearing and, also, to interactively change the shape of the virtual object. Specifically, the user interacts with the FSH to move the virtual object and to appropriately position the haptic interface for retrieving the six degrees of freedom required for both manipulation and modification modalities. The FCTS allows the system to track the movement and position of the user's fingers on the strip, which is used for rendering visual and sound feedback. Two evaluation experiments are described, which involve both the evaluation and the modification of a 3D shape. Results show that the use of the haptic strip for the evaluation of aesthetic shapes is effective and supports product designers in the appreciation of the aesthetic qualities of the shape.
Khaled, W; Reichling, S; Bruhns, O T; Boese, H; Baumann, M; Monkman, G; Egersdoerfer, S; Klein, D; Tunayar, A; Freimuth, H; Lorenz, A; Pessavento, A; Ermert, H
In the field of medical diagnosis, there is a strong need to determine mechanical properties of biological tissue, which are of histological and pathological relevance. Malignant tumors are significantly stiffer than surrounding healthy tissue. One of the established diagnosis procedures is the palpation of body organs and tissue. Palpation is used to measure swelling, detect bone fracture, find and measure pulse, or to locate changes in the pathological state of tissue and organs. Current medical practice routinely uses sophisticated diagnostic tests through magnetic resonance imaging (MRI), computed tomography (CT) and ultrasound (US) imaging. However, they cannot provide direct measure of tissue elasticity. Last year we presented the concept of the first haptic sensor actuator system to visualize and reconstruct mechanical properties of tissue using ultrasonic elastography and a haptic display with electrorheological fluids. We developed a real time strain imaging system for tumor diagnosis. It allows biopsies simultaneously to conventional ultrasound B-Mode and strain imaging investigations. We deduce the relative mechanical properties by using finite element simulations and numerical solution models solving the inverse problem. Various modifications on the haptic sensor actuator system have been investigated. This haptic system has the potential of inducing real time substantial forces, using a compact lightweight mechanism which can be applied to numerous areas including intraoperative navigation, telemedicine, teaching and telecommunication.
Uhm, Chang-Ho; Nguyen, Phoung Bac; Choi, Seung-Bok
In this work, magnetorheological (MR) haptic master and slave robot for minimally invasive surgery (MIS) have been designed and tested. The proposed haptic master consists of four actuators; three MR brakes featuring gimbal structure for 3-DOF rotation motion(X, Y and Z axes) and one MR linear actuator for 1-DOF translational motion. The proposed slave robot which is connected with the haptic master has vertically multi- joints, and it consists of four DC servomotors; three for positioning endoscope and one for spinning motion. We added a fixed bar with a ball joint on the base of the slave for the endoscope position at the patient's abdomen to maintain safety. A gimbal structure at the end of the slave robotic arm for the last joint rotates freely with respect to the pivot point of the fixed bar. This master-slave system runs as if a teleoperation system through TCP/IP connection, programmed by LabVIEW. In order to achieve the desired position trajectory, a proportional-integral-derivative (PID) controller is designed and implemented. It has been demonstrated that the effective tracking control performances for the desired motion are well achieved and presented in time domain. At last, an experiment in virtual environments is undertaken to investigate the effectiveness of the MR haptic master device for MIS system.
Full Text Available Deafblind persons’ perception and experiences are based on their residual auditive and visual senses, and touch. Their haptic exploration, through movements and orientation towards objects give blind persons direct, independent experience. Few studies explore the aesthetic experiences and appreciation of artefacts of deafblind people using cochlear implant (CI technology, and how they interpret and express their perceived aesthetic experience through another sensory modality. While speech recognition is studied extensively in this area, the aspect of auditive descriptions made by CI users are a less-studied domain. This present research intervention describes and analyses five different deafblind people sharing their interpretation of five statues vocally, using sounds and written descriptions based on their haptic explorations. The participants found new and multimodal ways of expressing their experiences, as well as re-experiencing them through technological aids. We also found that the CI users modify technology to better suit their personal needs. We conclude that CI technology in combination with self-made sound descriptions enhance memorization of haptic art experiences that can be re-called by the recording of the sound descriptions. This research expands the idea of auditive descriptions, and encourages user-produced descriptions as artistic supports to traditional linguistic, audio descriptions. These can be used to create personal auditive–haptic memory collections similar to how sighted create photo albums.
Hwang, Inwook; Lee, Hyeseon; Choi, Seungmoon
We introduce a novel dual-band haptic music player for real-time simultaneous vibrotactile playback with music in mobile devices. Our haptic music player features a new miniature dual-mode actuator that can produce vibrations consisting of two principal frequencies and a real-time vibration generation algorithm that can extract vibration commands from a music file for dual-band playback (bass and treble). The algorithm uses a "haptic equalizer" and provides plausible sound-to-touch modality conversion based on human perceptual data. In addition, we present a user study carried out to evaluate the subjective performance (precision, harmony, fun, and preference) of the haptic music player, in comparison with the current practice of bass-band-only vibrotactile playback via a single-frequency voice-coil actuator. The evaluation results indicated that the new dual-band playback outperforms the bass-only rendering, also providing several insights for further improvements. The developed system and experimental findings have implications for improving the multimedia experience with mobile devices.
Full Text Available We present the usability evaluation of a haptic-enhanced telerehabilitation system for massage therapy of the back using the Vybe haptic gaming pad and the gesture sensor LEAP motion controller. The evaluated system includes features that allow for (i administering online therapy programs, (ii providing self-adjustable and safety treatment of back massages using a virtual environment, and (iii saving and replaying massage sessions according to a patient’s therapy program. The usability evaluation with 25 older adults and 10 specialists suggests that the haptic telerehabilitation system is perceived with high usability and pleasurable user experience, while providing personalized intensity of haptic therapy in a supervised, real-time, and secure way to treat the patient. Moreover, the specialists totally agree that the system design features, such as save and play, and delimiting therapy zones are the most important for back massage therapy, while the features of regulating feedback intensity and providing/receiving a massage remotely are also important. Finally, based on their comments, five design insights aiming at improving the current version of the system were generated.
Feder, J M; Rosenberg, M A; Farber, M D
Various complications following intraocular lens (IOL) surgery result in explantation of the lenses. Haptic fibrosis may necessitate cutting the IOL haptics prior to removal. In this study we used the neodymium: YAG (Nd:YAG) laser to cut polypropylene and poly(methyl methacrylate) (PMMA) haptics in vitro and in rabbit eyes. In vitro we were able to cut 100% of both haptic types successfully (28 PMMA and 30 polypropylene haptics). In rabbit eyes we were able to cut 50% of the PMMA haptics and 43% of the polypropylene haptics. Poly(methyl methacrylate) haptics were easier to cut in vitro and in vivo than polypropylene haptics, requiring fewer shots for transection. Complications of Nd:YAG laser use frequently interfered with haptic transections in rabbit eyes. Haptic transection may be more easily accomplished in human eyes.
Full Text Available This paper outlines the ongoing development of a wearable haptic game interface, in this case for controlling a flight simulator. The device differs from many traditional haptic feedback implementations in that it combines vibrotactile feedback with gesture based input, thus becoming a two-way conduit between the user and the virtual environment. The device is intended to challenge what is considered an “interface” and sets out to purposefully blur the boundary between man and machine. This allows for a more immersive experience, and a user evaluation shows that the intuitive interface allows the user to become the aircraft that is controlled by the movements of the user's hand.
Moehler, Tobias; Fiehler, Katja
The current study investigated the role of automatic encoding and maintenance of remembered, past, and present visual distractors for reach movement planning. The previous research on eye movements showed that saccades curve away from locations actively kept in working memory and also from task-irrelevant perceptually present visual distractors, but not from task-irrelevant past distractors. Curvature away has been associated with an inhibitory mechanism resolving the competition between multiple active movement plans. Here, we examined whether reach movements underlie a similar inhibitory mechanism and thus show systematic modulation of reach trajectories when the location of a previously presented distractor has to be (a) maintained in working memory or (b) ignored, or (c) when the distractor is perceptually present. Participants performed vertical reach movements on a computer monitor from a home to a target location. Distractors appeared laterally and near or far from the target (equidistant from central fixation). We found that reaches curved away from the distractors located close to the target when the distractor location had to be memorized and when it was perceptually present, but not when the past distractor had to be ignored. Our findings suggest that automatically encoding present distractors and actively maintaining the location of past distractors in working memory evoke a similar response competition resolved by inhibition, as has been previously shown for saccadic eye movements.
The Novint Falcon is a low cost, 3-axis, haptic device primarily designed and built for the gaming industry. Meant to replace the conventional mouse, the Novint Falcon has sub- millimeter accuracy and is capable of real time updates. The device itself has the potential to be used in telerobotics applications when coupled with a robotic gripper for example. Recently, the Intelligent Control Lab at Örebro University in Sweden built such a robotic gripper. The robotic gripper has three fingers a...
Casey, Sarah J; Newell, Fiona N
Recent studies have suggested that the familiarity of a face leads to more robust recognition, at least within the visual domain. The aim of our study was to investigate whether face familiarity resulted in a representation of faces that was easily shared across the sensory modalities. In Experiment 1, we tested whether haptic recognition of a highly familiar face (one's own face) was as efficient as visual recognition. Our observers were unable to recognise their own face models from tactile memory alone but were able to recognise their faces visually. However, haptic recognition improved when participants were primed by their own live face. In Experiment 2, we found that short-term familiarisation with a set of previously unfamiliar face stimuli improved crossmodal recognition relative to the recognition of unfamiliar faces. Our findings suggest that familiarisation provides a strong representation of faces but that the nature of the information encoded during learning is critical for efficient crossmodal recognition.
Klatzky, R L; Loomis, J M; Lederman, S J; Wake, H; Fujita, N
Haptic identification of real objects is superior to that of raised two-dimensional (2-D) depictions. Three explanations of real-object superiority were investigated: contribution of material information, contribution of 3-D shape and size, and greater potential for integration across the fingers. In Experiment 1, subjects, while wearing gloves that gently attenuated material information, haptically identified real objects that provided reduced cues to compliance, mass, and part motion. The gloves permitted exploration with free hand movement, a single outstretched finger, or five outstretched fingers. Performance decreased over these three conditions but was superior to identification of pictures of the same objects in all cases, indicating the contribution of 3-D structure and integration across the fingers. Picture performance was also better with five fingers than with one. In Experiment 2, the subjects wore open-fingered gloves, which provided them with material information. Consequently, the effect of type of exploration was substantially reduced but not eliminated. Material compensates somewhat for limited access to object structure but is not the primary basis for haptic object identification.
Czekóová, K.; Shaw, D. J.; Janoušová, E.; Urbánek, Tomáš
Roč. 6, č. 367 (2015), s. 1-11 ISSN 1664-1078 Institutional support: RVO:68081740 Keywords : emotion * temporal context * presentation sequence * assimilation effect * contrast effect Subject RIV: AN - Psychology Impact factor: 2.463, year: 2015 http://journal.frontiersin.org/article/10.3389/fpsyg.2015.00367/full
Cattaneo, Zaira; Lega, Carlotta; Boehringer, Jana; Gallucci, Marcello; Girelli, Luisa; Carbon, Claus-Christian
Emotion recognition is mediated by a complex network of cortical and subcortical areas, with the two hemispheres likely being differently involved in processing positive and negative emotions. As results on valence-dependent hemispheric specialisation are quite inconsistent, we carried out three experiments with emotional stimuli with a task being sensitive to measure specific hemispheric processing. Participants were required to bisect visual lines that were delimited by emotional face flankers, or to haptically bisect rods while concurrently listening to emotional vocal expressions. We found that prolonged (but not transient) exposition to concurrent happy stimuli significantly shifted the bisection bias to the right compared to both sad and neutral stimuli, indexing a greater involvement of the left hemisphere in processing of positively connoted stimuli. No differences between sad and neutral stimuli were observed across the experiments. In sum, our data provide consistent evidence in favour of a greater involvement of the left hemisphere in processing positive emotions and suggest that (prolonged) exposure to stimuli expressing happiness significantly affects allocation of (spatial) attentional resources, regardless of the sensory (visual/auditory) modality in which the emotion is perceived and space is explored (visual/haptic).
Nordahl, Rolf; Berrezag, Amir; Dimitrov, Smilen
We describe a system that provides combined auditory and haptic sensations to simulate walking on different grounds. It uses a physical model that drives haptic transducers embedded in sandals and headphones. The model represents walking interactions with solid surfaces that can creak, or be cove...
Gelineck, Steven; Overholt, Daniel
This paper describes the implementation and informal evaluation of a user interface that explores haptic feedback for 3D audio mixing. The implementation compares different approaches using either the LEAP Motion for mid-air hand gesture control, or the Novint Falcon for active haptic feed- back...
Bargerhuff, Mary Ellen; Cowan, Heidi; Oliveira, Francisco; Quek, Francis; Fang, Bing
This article introduces a recently developed haptic glove system and describes how the participants used a video game that was purposely designed to train them in skills that are needed for the efficient use of the haptic glove. Assessed skills included speed, efficiency, embodied skill, and engagement. The findings and implications for future…
Waade, Anne Marit; Jørgensen, Ulla Angkjær
and the media in which aesthetical, cultural and symbolic values are related to the way food is mediatised. The main argument is that cooking television series produce haptic images of place and food that include a specific sensuous and emotional relation between screen and viewer. The haptic imagery...
Turchet, Luca; Serafin, Stefania
of semantic congruence for those audio–haptic pairs of materials which belonged to the same typology. Furthermore, better matching ability was found for the passive case compared to the interactive one, although this may be due to the limits of the technology used for the interactive haptic simulations....
Font, I.; Weiland, S.; Franken, M.; Steinbuch, M.; Rovers, A.F.
One of the major shortcomings of state-of-the-art robotic systems for minimal invasive surgery is the lack of haptic feedback for the surgeon. In order to provide haptic information, sensors and actuators have to be added to the master and slave device. A control system should process the data and
Pinzon, David; Byrns, Simon; Zheng, Bin
Background The amount of direct hand-tool-tissue interaction and feedback in minimally invasive surgery varies from being attenuated in laparoscopy to being completely absent in robotic minimally invasive surgery. The role of haptic feedback during surgical skill acquisition and its emphasis in training have been a constant source of controversy. This review discusses the major developments in haptic simulation as they relate to surgical performance and the current research questions that remain unanswered. Search Strategy An in-depth review of the literature was performed using PubMed. Results A total of 198 abstracts were returned based on our search criteria. Three major areas of research were identified, including advancements in 1 of the 4 components of haptic systems, evaluating the effectiveness of haptic integration in simulators, and improvements to haptic feedback in robotic surgery. Conclusions Force feedback is the best method for tissue identification in minimally invasive surgery and haptic feedback provides the greatest benefit to surgical novices in the early stages of their training. New technology has improved our ability to capture, playback and enhance to utility of haptic cues in simulated surgery. Future research should focus on deciphering how haptic training in surgical education can increase performance, safety, and improve training efficiency. © The Author(s) 2016.
The presented materials consist of presentations of international workshop which held in Warsaw from 4 to 5 October 2007. Main subject of the meeting was progress in manufacturing as well as research program development for neutron detector which is planned to be placed at GANIL laboratory and will be used in nuclear spectroscopy research
experiments are presented: in the first type our assembly is piloted directly by the computer and shows its performances in achieving the gripping of micrometric objects in controlled way. The second type involves the coupling between our assembly and the haptic system to explore a surface and achieve fast recognition of shapes of sub-micron samples. This experiment shows the capability of haptic coupling in directly transmitting to the user the interactions registered at nanometer scale and the possibility of performing complex tasks on the recognition of shapes and tracking of contours. (author)
Ledermann, Christoph; Pauer, Hendrikje; Woern, Heinz
In minimally invasive surgery, exible mechatronic instruments promise to improve the overall performance of surgical interventions. However, those instruments require highly developed sensors in order to provide haptic feedback to the surgeon or to enable (semi-)autonomous tasks. Precisely, haptic sensors and a shape sensor are required. In this paper, we present our ber optical sensor system of Fiber Bragg Gratings, which consists of a shape sensor, a kinesthetic sensor and a tactile sensor. The status quo of each of the three sensors is described, as well as the concept to integrate them into one ber optical sensor system.
Kern, T A; Herrmann, J; Klages, S; Meiss, T; Werthschützky, R
During catheterization navigation within the patient is mainly dependent on a live x-ray image on the screen. Although methods for 3D visualisation and remote navigation of the catheter are discussed and tested still precise positioning is merely the result of intense training and a high skill and level of training of the performing surgeon. This article refers to a system which can be considered as an add-on for existing procedures of catheterization. It compromises of a miniaturised force sensor located at the tip of guide-wires whose prototype is shown here. The measured forces will be presented to the surgeon amplified by an external actuator described in this article. As a result a haptic perception of the forces between the tip of the guide-wire and the vessels walls will be available and enable the surgeon to gain an impression which is comparable to palpation of living vessels from the inside
Nguyen, Phuong-Bac; Oh, Jong-Seok; Choi, Seung-Bok
This paper introduces a novel 3-DOF haptic master device for minimally invasive surgery featuring magneto-rheological (MR) fluid. It consists of three rotational motions. These motions are constituted by two bi-directional MR (BMR) plus one conventional MR brakes. The BMR brake used in the system possesses a salient advantage that its range of braking torque varies from negative to positive values. Therefore, the device is expected to be able sense in a wide environment from very soft tissues to bones. In this paper, overall of the design of the device is presented from idea, modeling, optimal design, manufacturing to control of the device. Moreover, experimental investigation is undertaken to validate the effectiveness of the device.
Nishino, Hiroaki; Yamaguchi, Akira; Kagawa, Tsuneo; Utsumiya, Kouichi
We present a system to realize an on-line instruction environment among physically separated participants based on a multi-modal communication strategy. In addition to visual and acoustic information, commonly used communication modalities in network environments, our system provides a haptic channel to intuitively conveying partners' sense of touch. The human touch sensation, however, is very sensitive for delays and jitters in the networked virtual reality (NVR) systems. Therefore, a method to compensate for such negative factors needs to be provided. We show an NVR architecture to implement a basic framework that can be shared by various applications and effectively deals with the problems. We take a hybrid approach to implement both data consistency by client-server and scalability by peer-to-peer models. As an application system built on the proposed architecture, a remote instruction system targeted at teaching handwritten characters and line patterns on a Korea-Japan high-speed research network also is mentioned.
The PARIS meeting held in Cracow, Poland from 14 to 15 May 2007. The main subjects discussed during this meeting were the status of international project dedicated to gamma spectroscopy research. The scientific research program includes investigations of giant dipole resonance, probe of hot nuclei induced in heavy reactions, Jacobi shape transitions, isospin mixing and nuclear multifragmentation. The mentioned programme needs Rand D development such as new scintillations materials as lanthanum chlorides and bromides as well as new photo detection sensors as avalanche photodiodes - such subjects are also subjects of discussion. Additionally results of computerized simulations of scintillation detectors properties by means of GEANT- 4 code are presented
Lin, Ming C
For a long time, human beings have dreamed of a virtual world where it is possible to interact with synthetic entities as if they were real. It has been shown that the ability to touch virtual objects increases the sense of presence in virtual environments. This book provides an authoritative overview of state-of-theart haptic rendering algorithms and their applications. The authors examine various approaches and techniques for designing touch-enabled interfaces for a number of applications, including medical training, model design, and maintainability analysis for virtual prototyping, scienti
Bobbitt, III, John Thomas
A process of providing driver fuel economy feedback is disclosed in which vehicle sensors provide for haptic feedback on fuel usage. Such sensors may include one or more of a speed sensors, global position satellite units, vehicle pitch/roll angle sensors, suspension displacement sensors, longitudinal accelerometer sensors, throttle position in sensors, steering angle sensors, break pressure sensors, and lateral accelerometer sensors. Sensors used singlely or collectively can provide enhanced feedback as to various environmental conditions and operating conditions such that a more accurate assessment of fuel economy information can be provided to the driver.
Nielsen, Carsten Søren; Kyllingsbæk, Søren; Markussen, Bo
The article “Testing a Poisson Counter Model for Visual Identification of Briefly Presented, Mutually Confusable Single Stimuli in Pure Accuracy Tasks” by Søren Kyllingsbæk, Bo Markussen and Claus Bundesen (Journal of Experimental Psychology: Human Perception and Performance, 2012, Vol. 38, No. 3......, pp. 628–642. http://dx.doi.org/10.1037/a0024751) used a computational shortcut (Equation A5) that strongly reduced the time needed to fit the Poisson counter model to experimental data. Unfortunately, the computational shortcut built on an approximation that was not well-founded in the Poisson...... counter model. To measure the actual deviation, the authors refitted both the computational shortcut and the Poisson counter model (Equations A1-A4) to the experimental data reported in the article. The Poisson counter model fits did, fortunately, not deviate noticeably from those produced...
Pan, Jun J; Ahn, Woojin; Dargar, Saurabh; Halic, Tansel; Li, Bai C; Sankaranarayanan, Ganesh; Roberts, Kurt; Schwaitzberg, Steven; De, Suvranu
Natural Orifice Transluminal Endoscopic Surgery (NOTES) provides an emerging surgical technique which usually needs a long learning curve for surgeons. Virtual reality (VR) medical simulators with vision and haptic feedback can usually offer an efficient and cost-effective alternative without risk to the traditional training approaches. Under this motivation, we developed the first virtual reality simulator for transvaginal cholecystectomy in NOTES (VTEST™). This VR-based surgical simulator aims to simulate the hybrid NOTES of cholecystectomy. We use a 6DOF haptic device and a tracking sensor to construct the core hardware component of simulator. For software, an innovative approach based on the inner-spheres is presented to deform the organs in real time. To handle the frequent collision between soft tissue and surgical instruments, an adaptive collision detection method based on GPU is designed and implemented. To give a realistic visual performance of gallbladder fat tissue removal by cautery hook, a multi-layer hexahedral model is presented to simulate the electric dissection of fat tissue. From the experimental results, trainees can operate in real time with high degree of stability and fidelity. A preliminary study was also performed to evaluate the realism and the usefulness of this hybrid NOTES simulator. This prototyped simulation system has been verified by surgeons through a pilot study. Some items of its visual performance and the utility were rated fairly high by the participants during testing. It exhibits the potential to improve the surgical skills of trainee and effectively shorten their learning curve. Copyright © 2016 Elsevier Inc. All rights reserved.
Monaco, Simona; Gallivan, Jason P; Figley, Teresa D; Singhal, Anthony; Culham, Jody C
The role of the early visual cortex and higher-order occipitotemporal cortex has been studied extensively for visual recognition and to a lesser degree for haptic recognition and visually guided actions. Using a slow event-related fMRI experiment, we investigated whether tactile and visual exploration of objects recruit the same "visual" areas (and in the case of visual cortex, the same retinotopic zones) and if these areas show reactivation during delayed actions in the dark toward haptically explored objects (and if so, whether this reactivation might be due to imagery). We examined activation during visual or haptic exploration of objects and action execution (grasping or reaching) separated by an 18 s delay. Twenty-nine human volunteers (13 females) participated in this study. Participants had their eyes open and fixated on a point in the dark. The objects were placed below the fixation point and accordingly visual exploration activated the cuneus, which processes retinotopic locations in the lower visual field. Strikingly, the occipital pole (OP), representing foveal locations, showed higher activation for tactile than visual exploration, although the stimulus was unseen and location in the visual field was peripheral. Moreover, the lateral occipital tactile-visual area (LOtv) showed comparable activation for tactile and visual exploration. Psychophysiological interaction analysis indicated that the OP showed stronger functional connectivity with anterior intraparietal sulcus and LOtv during the haptic than visual exploration of shapes in the dark. After the delay, the cuneus, OP, and LOtv showed reactivation that was independent of the sensory modality used to explore the object. These results show that haptic actions not only activate "visual" areas during object touch, but also that this information appears to be used in guiding grasping actions toward targets after a delay. SIGNIFICANCE STATEMENT Visual presentation of an object activates shape
Full Text Available In the present edition of Significação – Scientific Journal for Audiovisual Culture and in the others to follow something new is brought: the presence of thematic dossiers which are to be organized by invited scholars. The appointed subject for the very first one of them was Radio and the invited scholar, Eduardo Vicente, professor at the Graduate Course in Audiovisual and at the Postgraduate Program in Audiovisual Media and Processes of the School of Communication and Arts of the University of São Paulo (ECA-USP. Entitled Radio Beyond Borders the dossier gathers six articles and the intention of reuniting works on the perspectives of usage of such media as much as on the new possibilities of aesthetical experimenting being build up for it, especially considering the new digital technologies and technological convergences. It also intends to present works with original theoretical approach and original reflections able to reset the way we look at what is today already a centennial media. Having broadened the meaning of “beyond borders”, four foreign authors were invited to join the dossier. This is the first time they are being published in this country and so, in all cases, the articles where either written or translated into Portuguese.The dossier begins with “Radio is dead…Long live to the sound”, which is the transcription of a thought provoking lecture given by Armand Balsebre (Autonomous University of Barcelona – one of the most influential authors in the world on the Radio study field. It addresses the challenges such media is to face so that it can become “a new sound media, in the context of a new soundscape or sound-sphere, for the new listeners”. Andrew Dubber (Birmingham City University regarding the challenges posed by a Digital Era argues for a theoretical approach in radio studies which can consider a Media Ecology. The author understands the form and discourse of radio as a negotiation of affordances and
Rizun, P; Gunn, D; Cox, B; Sutherland, G
Haptic feedback increases operator performance and comfort during telerobotic manipulation. Feedback of grasping pressure is critical in many microsurgical tasks, yet no haptic interface for surgical tools is commercially available. Literature on the psychophysics of touch was reviewed to define the spectrum of human touch perception and the fidelity requirements of an ideal haptic interface. Mechanical design and control literature was reviewed to translate the psychophysical requirements to engineering specification. High-fidelity haptic forceps were then developed through an iterative process between engineering and surgery. The forceps are a modular device that integrate with a haptic hand controller to add force feedback for tool actuation in telerobotic or virtual surgery. Their overall length is 153 mm and their mass is 125 g. A contact-free voice coil actuator generates force feedback at frequencies up to 800 Hz. Maximum force output is 6 N (2N continuous) and the force resolution is 4 mN. The forceps employ a contact-free magnetic position sensor as well as micro-machined accelerometers to measure opening/closing acceleration. Position resolution is 0.6 microm with 1.3 microm RMS noise. The forceps can simulate stiffness greater than 20N/mm or impedances smaller than 15 g with no noticeable haptic artifacts or friction. As telerobotic surgery evolves, haptics will play an increasingly important role. Copyright 2006 John Wiley & Sons, Ltd.
Park, Chulwook; Kim, Seonjin
This study measured whether self-produced movement influences haptic perception ability (experiment 1) as well as the factors associated with levels of influence (experiment 2) in racket sports. For experiment 1, the haptic perception accuracy levels of five male table tennis experts and five male novices were examined under two different conditions (no movement vs. movement). For experiment 2, the haptic afferent subsystems of five male table tennis experts and five male novices were investigated in only the self-produced movement-coupled condition. Inferential statistics (ANOVA, t-test) and custom-made devices (shock & vibration sensor, Qualisys Track Manager) of the data were used to determine the haptic perception accuracy (experiment 1, experiment 2) and its association with expertise. The results of this research show that expert-level players acquire higher accuracy with less variability (racket vibration and angle) than novice-level players, especially in their self-produced movement coupled performances. The important finding from this result is that, in terms of accuracy, the skill-associated differences were enlarged during self-produced movement. To explain the origin of this difference between experts and novices, the functional variability of haptic afferent subsystems can serve as a reference. These two factors (self-produced accuracy and the variability of haptic features) as investigated in this study would be useful criteria for educators in racket sports and suggest a broader hypothesis for further research into the effects of the haptic accuracy related to variability.
Srinivas Sulugodu Ramachandra
Full Text Available The essence of dental education is not only to impart knowledge but also to equip an aspiring clinician with all the para-phernalia to face most clinical situations if not all. What be-comes important here is the requirement that a student be not only observant but also have a precise idea of what a lesion or a surface should feel like under an instrument. No matter how far we have come in terms of pathogenesis and treatment of diseases of the oral cavity, there is still no one good way to teach a student about the tactile sense, be it while de-tecting calculus/caries or placing the incisions or detecting the smoothness of a restoration. Most often than not students learn these by a trial and error method. A not-so-recent development called Haptics may well be the answer to this predicament, at least in the near future. The concept which is extensively in use and indis-pensable in other fields like aviation, telecommunication etc is now making inroads into dentistry. It is essentially software which brings in the idea of giving the feedback response to applied force, be it simple exploration of caries or the fine pressure applied in placing an incision or an array of other areas/situations in dentistry where fine tactile sense becomes a prerequisite for intelligent diagnoses or cutting edge treatment procedures. The following write-up is an attempt to throw light on this new technology and the impact it may have on pre-clinical teaching in dentistry. The advantages, disadvantages be-tween manikin based dental simulators and haptics based dental simulators are also pre-sented.
Jacopo Aleotti; Giorgio Micconi; Stefano Caselli; Giacomo Benassi; Nicola Zambelli; Manuele Bettelli; Andrea Zappettini
A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the sit...
and interchangeable use of the haptic and auditory modality in floor interfaces, and for the synergy of perception and action in capturing and guiding human walking. We describe the technology developed in the context of this project, together with some experiments performed to evaluate the role of auditory......In this paper an overview of the work conducted on audio-haptic physically based simulation and evaluation of walking is provided. This work has been performed in the context of the Natural Interactive Walking (NIW) project, whose goal is to investigate possibilities for the integrated...... and haptic feedback in walking tasks....
Kim, Youngjae; Hahn, Minsoo
This work was conducted on the combination of two fields, i.e., haptic and social messaging. Haptic is one of the most attention-drawing fields and the biggest buzzwords among nextgeneration users. Haptic is being applied to conventional devices such as the cellular phone and even the door lock. Diverse forms of media such as blogs, social network services, and instant messengers are used to send and receive messages. That is mainly why we focus on the messaging experience, the most frequent ...
Bowers, R L; Mollenhauer, M S; Luxford, J
The present study examined short-term memory for tactile and temporal stimuli. Subjects were required to touch three-dimensional sample objects of different shapes and textures, presented for three durations: short, medium, or long. After the sample duration elapsed, a retention interval (5 sec.-20 sec.) occurred followed by a recall test for one of the sample dimensions of shape, texture, or time, across trials. Analysis showed that accuracy for shape and texture was high throughout testing (95-99%), but memory for perceived duration was relatively poor (60%). Further analysis indicated that poor recall on the time dimension was isolated to the medium and long samples; accuracy for short durations was consistently high (90%). In addition, a reliable response bias emerged; subjects recalled durations shorter than the actual duration presented. The results were discussed in terms of two lines of research, one indicating that haptic short-term memory is strong relative to other memory systems, and the other suggesting that the choose-short bias occurs across species.
Olsson, Pontus; Nysjo, Fredrik; Carlbom, Ingrid B; Johansson, Stefan
Piezoelectric motors offer an attractive alternative to electromagnetic actuators in portable haptic interfaces: they are compact, have a high force-to-volume ratio, and can operate with limited or no gearing. However, the choice of a piezoelectric motor type is not obvious due to differences in performance characteristics. We present our evaluation of two commercial, operationally different, piezoelectric motors acting as actuators in two kinesthetic haptic grippers, a walking quasi-static motor and a traveling wave ultrasonic motor. We evaluate each gripper's ability to display common virtual objects including springs, dampers, and rigid walls, and conclude that the walking quasi-static motor is superior at low velocities. However, for applications where high velocity is required, traveling wave ultrasonic motors are a better option.
Postma, Albert; Zuidhoek, Sander; Noordzij, Matthijs L.; Kappers, A. M L
Early-blind, late-blind, and blindfolded sighted participants were presented with two haptic allocentric spatial tasks: a parallel-setting task, in an immediate and a 10-sec delay condition, and a task in which the orientation of a single bar was judged verbally. With respect to deviation size, the
Che Me, Rosalam; Biamonti, Alessandro; Mohd Saad, Mohd Rashid
Wayfinding ability in older adults with Alzheimer's disease (AD) is progressively impaired due to ageing and deterioration of cognitive domains. Usually, the sense of direction is deteriorated as visuospatial and spatial cognition are associated with the sensory acuity. Therefore, navigation systems that support only visual interactions may not be appropriate in case of AD. This paper presents a concept of wearable navigation device that integrates the haptic-feedback technology to facilitate the wayfinding of individuals with AD. The system provides the simplest instructions; left/right using haptic signals, as to avoid users' distraction during navigation. The advantages of haptic/tactile modality for wayfinding purpose based on several significant studies are presented. As preliminary assessment, a survey is conducted to understand the potential of this design concept in terms of (1) acceptability, (2) practicality, (3) wearability, and (4) environmental settings. Results indicate that the concept is highly acceptable and commercially implementable. A working prototype will be developed based on the results of the preliminary assessment. Introducing a new method of navigation should be followed by continuous practices for familiarization purpose. Improved navigability allows the good performance of activities of daily living (ADLs) hence maintain the good quality of life in older adults with AD.
Neumann, Annika; Frank, Daniel; Vondenhoff, Thomas; Schmitt, Robert
Haptic perception is regarded as a key component of customer appreciation and acceptance for various products. The prediction of customers’ haptic perception is of interest both during product development and production phases. This paper presents the results of a multivariate analysis between perceived roughness and texture related surface measurements, to examine whether perceived roughness can be accurately predicted using technical measurements. Studies have shown that standardized measurement parameters, such as the roughness coefficients (e.g. Rz or Ra), do not show a one-dimensional linear correlation with the human perception (of roughness). Thus, an alternative measurement method was compared to standard measurements of roughness, in regard to its capability of predicting perceived roughness through technical measurements. To estimate perceived roughness, an experimental study was conducted in which 102 subjects evaluated four sets of 12 different geometrical surface structures regarding their relative perceived roughness. The two different metrological procedures were examined in relation to their capability to predict the perceived roughness of the subjects stated within the study. The standardized measurements of the surface roughness were made using a structured light 3D-scanner. As an alternative method, surface induced vibrations were measured by a finger-like sensor during robot-controlled traverse over a surface. The presented findings provide a better understanding of the predictability of human haptic perception using technical measurements.
Han, Young-Min; Choi, Seung-Bok
This paper presents the control performance of an electrorheological (ER) fluid-based haptic master device connected to a virtual slave environment that can be used for minimally invasive surgery (MIS). An already developed haptic joint featuring controllable ER fluid and a spherical joint mechanism is adopted for the master system. Medical forceps and an angular position measuring device are devised and integrated with the joint to establish the MIS master system. In order to embody a human organ in virtual space, a volumetric deformable object is used. The virtual object is then mathematically formulated by a shape-retaining chain-linked (S-chain) model. After evaluating the reflection force, computation time and compatibility with real-time control, the haptic architecture for MIS is established by incorporating the virtual slave with the master device so that the reflection force for the object of the virtual slave and the desired position for the master operator are transferred to each other. In order to achieve the desired force trajectories, a sliding mode controller is formulated and then experimentally realized. Tracking control performances for various force trajectories are evaluated and presented in the time domain
Pınar ÖKTEM ERKARTAL
Full Text Available Ocular-centrism is the utilitarian-aesthetic perspective which dominates the perception of spatial quality and architectural success in the West. In locating vision as the dominant discourse in architectural design, this perspective has been criticized for ignoring the physical and psychological relation created between subject and space during the spatial experience, sensual memory, movement and time. The phenomenon of touch, which may be defined as the interaction between architecture and subject dependent on physical and cognitive perception, offers another way of thinking and interpreting architecture, and constitutes an alternative starting point for design. The aim of this study was three-fold: to research and describe the phenomenon of touch in design concepts, to present the effects of hapticity in spatial experience on the user, and to present a visualization study for this phenomenon which is quite challenging to express. For the fieldwork, five buildings designed by Peter Zumthor were chosen. Zumthor stresses the importance of sensation, materiality and atmosphere in the architectural design process. Zumthor’s abstract design elements, their use in architectural space and the effect were determined using physical measurement. The findings were represented in “haptic mapping”. This visualization study consisted of a “haptic scatter chart”, “materiality- affect analysis” and “sensation analysis” and revealed that the phenomenon of touch and concepts identified it such as sensations, influence, materiality and mental associations are not abstract and inaccessible assumptions, but tools which can be included in the architectural design process.
Kaklanis, Nikolaos; Votis, Konstantinos; Tzovaras, Dimitrios
The use of spatial (geographic) information is becoming ever more central and pervasive in today's internet society but the most of it is currently inaccessible to visually impaired users. However, access in visual maps is severely restricted to visually impaired and people with blindness, due to their inability to interpret graphical information. Thus, alternative ways of a map's presentation have to be explored, in order to enforce the accessibility of maps. Multiple types of sensory perception like touch and hearing may work as a substitute of vision for the exploration of maps. The use of multimodal virtual environments seems to be a promising alternative for people with visual impairments. The present paper introduces a tool for automatic multimodal map generation having haptic and audio feedback using OpenStreetMap data. For a desired map area, an elevation map is being automatically generated and can be explored by touch, using a haptic device. A sonification and a text-to-speech (TTS) mechanism provide also audio navigation information during the haptic exploration of the map.
Full Text Available A vehicle steering by wire (SBW haptic system based on high gain generalized proportional integral (GPI observers is introduced. The observers are considered for the estimation of dynamic perturbations that are present at the tire and steering wheel. To ensure efficient tracking between the commanded steering wheel angle and the tire orientation angle, the estimated perturbations are on line canceled. As to provide a haptic interface with the driver, the estimated dynamic effects at the steering rack are fed back to the steering wheel, yielding a master-slave haptic system with bilateral communication. For implementation purposes few sensors and minimum knowledge of the dynamic model are required, which is a major advantage compared to other approaches. Only position tracking errors are fed back, while all other signals are estimated by the high gain GPI observers. The scheme is robust to uncertainty on the input gain and cancels dynamic perturbation effects such as friction and aligning forces on the tire. Experimental results are presented on a prototype platform.
Spiers, Adam J; Dollar, Aaron M
Shape-changing interfaces are a category of device capable of altering their form in order to facilitate communication of information. In this work, we present a shape-changing device that has been designed for navigation assistance. 'The Animotus' (previously, 'The Haptic Sandwich' ), resembles a cube with an articulated upper half that is able to rotate and extend (translate) relative to the bottom half, which is fixed in the user's grasp. This rotation and extension, generally felt via the user's fingers, is used to represent heading and proximity to navigational targets. The device is intended to provide an alternative to screen or audio based interfaces for visually impaired, hearing impaired, deafblind, and sighted pedestrians. The motivation and design of the haptic device is presented, followed by the results of a navigation experiment that aimed to determine the role of each device DOF, in terms of facilitating guidance. An additional device, 'The Haptic Taco', which modulated its volume in response to target proximity (negating directional feedback), was also compared. Results indicate that while the heading (rotational) DOF benefited motion efficiency, the proximity (translational) DOF benefited velocity. Combination of the two DOF improved overall performance. The volumetric Taco performed comparably to the Animotus' extension DOF.
Edmondson, Richard; Light, Kenneth; Bodenhamer, Andrew; Bosscher, Paul; Wilkinson, Loren
Polaris Sensor Technologies (PST) has developed a stereo vision upgrade kit for TALON® robot systems comprised of a replacement gripper camera and a replacement mast zoom camera on the robot, and a replacement display in the Operator Control Unit (OCU). Harris Corporation has developed a haptic manipulation upgrade for TALON® robot systems comprised of a replacement arm and gripper and an OCU that provides haptic (force) feedback. PST and Harris have recently collaborated to integrate the 3D vision system with the haptic manipulation system. In multiple studies done at Fort Leonard Wood, Missouri it has been shown that 3D vision and haptics provide more intuitive perception of complicated scenery and improved robot arm control, allowing for improved mission performance and the potential for reduced time on target. This paper discusses the potential benefits of these enhancements to robotic systems used for the domestic homeland security mission.
Lu, Keke; Liu, Guanyang; Liu, Lingzhi
A study on collaborative game in shared virtual environment with haptic feedback over computer networks is introduced in this paper. A collaborative task was used where the players located at remote sites and played the game together. The player can feel visual and haptic feedback in virtual environment compared to traditional networked multiplayer games. The experiment was desired in two conditions: visual feedback only and visual-haptic feedback. The goal of the experiment is to assess the impact of force feedback on collaborative task performance. Results indicate that haptic feedback is beneficial for performance enhancement for collaborative game in shared virtual environment. The outcomes of this research can have a powerful impact on the networked computer games.
Kayla Dawn Stone
Full Text Available This review aims to provide a comprehensive outlook on the sensory (visual and haptic contributions to reaching and grasping. The focus is on studies in developing children, normal and neuropsychological populations, and in sensory-deprived individuals. Studies have suggested a right-hand/left-hemisphere specialization for visually-guided grasping and a left-hand/right-hemisphere specialization for haptically-guided object recognition. This poses the interesting possibility that when vision is not available and grasping relies heavily on the haptic system, there is an advantage to use the left hand. We review the evidence for this possibility and dissect the unique contributions of the visual and haptic systems to grasping. We ultimately discuss how the integration of these two sensory modalities shape hand preference.
Xu, Zhaohong; Song, Chengli; Wu, Wenwu
Haptic feedback plays a significant role in minimally invasive robotic surgery (MIRS). A major deficiency of the current MIRS is the lack of haptic perception for the surgeon, including the commercially available robot da Vinci surgical system. In this paper, a dynamics model of a haptic robot is established based on Newton-Euler method. Because it took some period of time in exact dynamics solution, we used a digital PID arithmetic dependent on robot dynamics to ensure real-time bilateral control, and it could improve tracking precision and real-time control efficiency. To prove the proposed method, an experimental system in which two Novint Falcon haptic devices acting as master-slave system has been developed. Simulations and experiments showed proposed methods could give instrument force feedbacks to operator, and bilateral control strategy is an effective method to master-slave MIRS. The proposed methods could be used to tele-robotic system.
Bloomfield, Aaron; Deng, Yu; Wampler, Jeff; Rondot, Pascale; Harth, Dina; McManus, Mary; Badler, Norman
.... We conducted a series of human subject experiments to compare user performance and preference on a disassembly task with and without haptic feedback using CyberGlove, Phantom, and SpaceMouse interfaces...
Kodama, Taisuke; Izumi, Shintaro; Masaki, Kana; Kawaguchi, Hiroshi; Maenaka, Kazusuke; Yoshimoto, Masahiko
Recently, given Japan's aging society background, wearable healthcare devices have increasingly attracted attention. Many devices have been developed, but most devices have only a sensing function. To expand the application area of wearable healthcare devices, an interactive communication function with the human body is required using an actuator. For example, a device must be useful for medication assistance, predictive alerts of a disease such as arrhythmia, and exercise. In this work, a haptic stimulus actuator using a piezoelectric pump is proposed to realize a large displacement in wearable devices. The proposed actuator drives tactile sensation of the human body. The measurement results obtained using a sensory examination demonstrate that the proposed actuator can generate sufficient stimuli even if adhered to the chest, which has fewer tactile receptors than either the fingertip or wrist.
Full Text Available Marina Yiasemidou, Daniel Glassman, Peter Vasas, Sarit Badiani, Bijendra Patel Barts and the London School of Medicine and Dentistry, Department of Upper GI Surgery, Barts and The Royal London Hospital, London, UK Background: Virtual reality simulators have been gradually introduced into surgical training. One of the enhanced features of the latest virtual simulators is haptic feedback. The usefulness of haptic feedback technology has been a matter of controversy in recent years. Previous studies have assessed the importance of haptic feedback in executing parts of a procedure or basic tasks, such as tissue grasping. The aim of this study was to assess the role of haptic feedback within a structured educational environment, based on the performance of junior surgical trainees after undergoing substantial simulation training. Methods: Novices, whose performance was assessed after several repetitions of a task, were recruited for this study. The performance of senior house officers at the last stage of a validated laparoscopic cholecystectomy curriculum was assessed. Nine senior house officers completed a validated laparoscopic cholecystectomy curriculum on a haptic simulator and nine on a nonhaptic simulator. Performance in terms of mean total time, mean total number of movements, and mean total path length at the last level of the validated curriculum (full procedure of laparoscopic cholecystectomy was compared between the two groups. Results: Haptic feedback significantly reduced the time required to complete the full procedure of laparoscopic cholecystectomy (mean total time for nonhaptic machine 608.83 seconds, mean total time for haptic machine 553.27 seconds; P = 0.019 while maintaining safety standards similar to those of the nonhaptic machine (mean total number of movements: nonhaptic machine 583.74, haptic machine 603.93, P = 0.145, mean total path length: for nonhaptic machine 1207.37 cm, for haptic machine 1262.36 cm, P = 0
the human user. 2 Compared to our understanding of vision and audition , our knowledge of the human haptic perception is very limited. Many basic...modalities such as vision and audition on haptic perception of viscosity or mass, for example. 116 Some preliminary work has already been done in this...string; *posx="x" *forf="f’ *velv="v" * acca ="a" trial; resp; /* random number */ /* trial number */ /* index */ /* array holding stim
Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok
This paper presents control performances of a new type of four-degrees-of-freedom (4-DOF) haptic master that can be used for robot-assisted minimally invasive surgery (RMIS). By adopting a controllable electrorheological (ER) fluid, the function of the proposed master is realized as a haptic feedback as well as remote manipulation. In order to verify the efficacy of the proposed master and method, an experiment is conducted with deformable objects featuring human organs. Since the use of real human organs is difficult for control due to high cost and moral hazard, an excellent alternative method, the virtual reality environment, is used for control in this work. In order to embody a human organ in the virtual space, the experiment adopts a volumetric deformable object represented by a shape-retaining chain linked (S-chain) model which has salient properties such as fast and realistic deformation of elastic objects. In haptic architecture for RMIS, the desired torque/force and desired position originating from the object of the virtual slave and operator of the haptic master are transferred to each other. In order to achieve the desired torque/force trajectories, a sliding mode controller (SMC) which is known to be robust to uncertainties is designed and empirically implemented. Tracking control performances for various torque/force trajectories from the virtual slave are evaluated and presented in the time domain. (paper)
Oh, Jong-Seok; Choi, Seung-Hyun; Choi, Seung-Bok
This paper presents control performances of a new type of four-degrees-of-freedom (4-DOF) haptic master that can be used for robot-assisted minimally invasive surgery (RMIS). By adopting a controllable electrorheological (ER) fluid, the function of the proposed master is realized as a haptic feedback as well as remote manipulation. In order to verify the efficacy of the proposed master and method, an experiment is conducted with deformable objects featuring human organs. Since the use of real human organs is difficult for control due to high cost and moral hazard, an excellent alternative method, the virtual reality environment, is used for control in this work. In order to embody a human organ in the virtual space, the experiment adopts a volumetric deformable object represented by a shape-retaining chain linked (S-chain) model which has salient properties such as fast and realistic deformation of elastic objects. In haptic architecture for RMIS, the desired torque/force and desired position originating from the object of the virtual slave and operator of the haptic master are transferred to each other. In order to achieve the desired torque/force trajectories, a sliding mode controller (SMC) which is known to be robust to uncertainties is designed and empirically implemented. Tracking control performances for various torque/force trajectories from the virtual slave are evaluated and presented in the time domain.
Wang, Huihui; Lane, William Brian; Pappas, Devin; Duque, Bryam; Leong, John
In this paper we present a prototype using a dry ionic polymer metal composite (IPMC) in interactive personal devices such as bracelet, necklace, pocket key chain or mobile devices for haptic interaction when audio or visual feedback is not possible or practical. This prototype interface is an electro-mechanical system that realizes a shape-changing haptic display for information communication. A dry IPMC will change its dimensions due to the electrostatic effect when an electrical potential is provided to them. The IPMC can operate at a lower voltage (less than 2.5V) which is compatible with requirements for personal electrical devices or mobile devices. The prototype consists of the addressable arrays of the IPMCs with different dimensions which are deformable to different shapes with proper handling or customization. 3D printing technology will be used to form supporting parts. Microcontrollers (about 3cm square) from DigiKey will be imbedded into this personal device. An Android based mobile APP will be developed to talk with microcontrollers to control IPMCs. When personal devices receive information signals, the original shape of the prototype will change to another shape related to the specific sender or types of information sources. This interactive prototype can simultaneously realize multiple methods for conveying haptic information such as dimension, force, and texture due to the flexible array design. We conduct several studies of user experience to explore how users' respond to shape change information.
Deshpande, Nikhil; Chauhan, Manish; Pacchierotti, Claudio; Prattichizzo, Domenico; Caldwell, Darwin G; Mattos, Leonardo S
In this paper, a novel, motorized, multi-degrees-of-freedom (DoF), microsurgical forceps tool is presented, which is based on a master-slave teleoperation architecture. The slave device is a 7-DoF manipulator with: (i) 6-DoF positioning and orientation, (ii) 1 open/close gripper DoF; and (iii) an integrated force/torque sensor for tissue grip-force measurement. The master device is a 7-DoF haptic interface which teleoperates the slave device, and provides haptic feedback in its gripper interface. The combination of the device and the surgeon interface replaces the manual, hand-held device providing easy-to-use and ergonomic tissue control, simplifying the surgical tasks. This makes the system suitable to real surgical scenarios in the operating room (OR). The performance of the system was analysed through the evaluation of teleoperation control and characterization of gripping force. The new system offers an overall positioning error of less than 400 μm demonstrating its safety and accuracy. Improved system precision, usability, and ergonomics point to the potential suitability of the device for the OR and its ability to advance haptic-feedback-enhanced transoral laser microsurgeries.
Mulatto, Sara; Formaglio, Alessandro; Malvezzi, Monica; Prattichizzo, Domenico
A technique to animate a realistic hand avatar with 20 DoFs based on the biomechanics of the human hand is presented. The animation does not use any sensor glove or advanced tracker with markers. The proposed approach is based on the knowledge of a set of kinematic constraints on the model of the hand, referred to as postural synergies, which allows to represent the hand posture using a number of variables lower than the number of joints of the hand model. This low-dimensional set of parameters is estimated from direct measurement of the motion of thumb and index finger tracked using two haptic devices. A kinematic inversion algorithm has been developed, which takes synergies into account and estimates the kinematic configuration of the whole hand, i.e., also of the fingers whose end tips are not directly tracked by the two haptic devices. The hand skin is deformable and its deformation is computed using a linear vertex blending technique. The proposed synergy-based animation of the hand avatar involves only algebraic computations and is suitable for real-time implementation as required in haptics.
Hussein, Sami; Kruger, Jörg
Robot assisted training has proven beneficial as an extension of conventional therapy to improve rehabilitation outcome. Further facilitation of this positive impact is expected from the application of cooperative control algorithms to increase the patient's contribution to the training effort according to his level of ability. This paper presents an approach for cooperative training for end-effector based gait rehabilitation devices. Thereby it provides the basis to firstly establish sophisticated cooperative control methods in this class of devices. It uses a haptic control framework to synthesize and render complex, task specific training environments, which are composed of polygonal primitives. Training assistance is integrated as part of the environment into the haptic control framework. A compliant window is moved along a nominal training trajectory compliantly guiding and supporting the foot motion. The level of assistance is adjusted via the stiffness of the moving window. Further an iterative learning algorithm is used to automatically adjust this assistance level. Stable haptic rendering of the dynamic training environments and adaptive movement assistance have been evaluated in two example training scenarios: treadmill walking and stair climbing. Data from preliminary trials with one healthy subject is provided in this paper. © 2011 IEEE
Kannan Megalingam, Rajesh; Sreekanth, M. M.; Sivanantham, Vinu; Sai Kumar, K.; Ghanta, Sriharsha; Surya Teja, P.; Reddy, Rajesh G.
Robots can differentiate with open loop system and closed loop system robots. We face many problems when we do not have a feedback from robots. In this research paper, we are discussing all possibilities to achieve complete closed loop system for Multiple-DOF Robotic Arm, which is used in a coconut tree climbing and cutting robot by introducing a Haptic device. We are working on various sensors like tactile, vibration, force and proximity sensors for getting feedback. For monitoring the robotic arm achieved by graphical user interference software which simulates the working of the robotic arm, send the feedback of all the real time analog values which are produced by various sensors and provide real-time graphs for estimate the efficiency of the Robot.
Heck, D.J.F.; Heemskerk, C.J.M.; Koning, J.F.; Abbasi, A.; Nijmeijer, H.
Highlights: • ITER remote handling maintenance can be controlled safely over a large distance. • Bilateral teleoperation experiments were performed in a local network. • Wave variables make the controller robust against constant communication delays. • Master and slave position synchronization guaranteed by proportional action. -- Abstract: During shutdowns, maintenance crews are expected to work in 24/6 shifts to perform critical remote handling maintenance tasks on the ITER system. In this article, we investigate the possibility to safely perform these haptic maintenance tasks remotely from control stations located anywhere around the world. To guarantee stability in time delayed bilateral teleoperation, the symmetric position tracking controller using wave variables is selected. This algorithm guarantees robustness against communication delays, can eliminate wave reflections and provide position synchronization of the master and slave devices. Experiments have been conducted under realistic local network bandwidth, latency and jitter constraints. They show sufficient transparency even for substantial communication delays
Heck, D.J.F., E-mail: firstname.lastname@example.org [Eindhoven University of Technology, Department of Mechanical Engineering, Eindhoven (Netherlands); Heemskerk, C.J.M.; Koning, J.F. [Heemskerk Innovative Technologies, Sassenheim (Netherlands); Abbasi, A.; Nijmeijer, H. [Eindhoven University of Technology, Department of Mechanical Engineering, Eindhoven (Netherlands)
Highlights: • ITER remote handling maintenance can be controlled safely over a large distance. • Bilateral teleoperation experiments were performed in a local network. • Wave variables make the controller robust against constant communication delays. • Master and slave position synchronization guaranteed by proportional action. -- Abstract: During shutdowns, maintenance crews are expected to work in 24/6 shifts to perform critical remote handling maintenance tasks on the ITER system. In this article, we investigate the possibility to safely perform these haptic maintenance tasks remotely from control stations located anywhere around the world. To guarantee stability in time delayed bilateral teleoperation, the symmetric position tracking controller using wave variables is selected. This algorithm guarantees robustness against communication delays, can eliminate wave reflections and provide position synchronization of the master and slave devices. Experiments have been conducted under realistic local network bandwidth, latency and jitter constraints. They show sufficient transparency even for substantial communication delays.
Mavroidis, Constantinos; Pfeiffer, Charles; Paljic, Alex; Celestino, James; Lennon, Jamie; Bar-Cohen, Yoseph
For many years, the robotic community sought to develop robots that can eventually operate autonomously and eliminate the need for human operators. However, there is an increasing realization that there are some tasks that human can perform significantly better but, due to associated hazards, distance, physical limitations and other causes, only robot can be employed to perform these tasks. Remotely performing these types of tasks requires operating robots as human surrogates. While current "hand master" haptic systems are able to reproduce the feeling of rigid objects, they present great difficulties in emulating the feeling of remote/virtual stiffness. In addition, they tend to be heavy, cumbersome and usually they only allow limited operator workspace. In this paper a novel haptic interface is presented to enable human-operators to "feel" and intuitively mirror the stiffness/forces at remote/virtual sites enabling control of robots as human-surrogates. This haptic interface is intended to provide human operators intuitive feeling of the stiffness and forces at remote or virtual sites in support of space robots performing dexterous manipulation tasks (such as operating a wrench or a drill). Remote applications are referred to the control of actual robots whereas virtual applications are referred to simulated operations. The developed haptic interface will be applicable to IVA operated robotic EVA tasks to enhance human performance, extend crew capability and assure crew safety. The electrically controlled stiffness is obtained using constrained ElectroRheological Fluids (ERF), which changes its viscosity under electrical stimulation. Forces applied at the robot end-effector due to a compliant environment will be reflected to the user using this ERF device where a change in the system viscosity will occur proportionally to the force to be transmitted. In this paper, we will present the results of our modeling, simulation, and initial testing of such an
Stock, Oliver; Röder, Brigitte; Burke, Michael; Bien, Siegfried; Rösler, Frank
The present study used functional magnetic resonance imaging to delineate cortical networks that are activated when objects or spatial locations encoded either visually (visual encoding group, n=10) or haptically (haptic encoding group, n=10) had to be retrieved from long-term memory. Participants learned associations between auditorily presented words and either meaningless objects or locations in a 3-D space. During the retrieval phase one day later, participants had to decide whether two auditorily presented words shared an association with a common object or location. Thus, perceptual stimulation during retrieval was always equivalent, whereas either visually or haptically encoded object or location associations had to be reactivated. Moreover, the number of associations fanning out from each word varied systematically, enabling a parametric increase of the number of reactivated representations. Recall of visual objects predominantly activated the left superior frontal gyrus and the intraparietal cortex, whereas visually learned locations activated the superior parietal cortex of both hemispheres. Retrieval of haptically encoded material activated the left medial frontal gyrus and the intraparietal cortex in the object condition, and the bilateral superior parietal cortex in the location condition. A direct test for modality-specific effects showed that visually encoded material activated more vision-related areas (BA 18/19) and haptically encoded material more motor and somatosensory-related areas. A conjunction analysis identified supramodal and material-unspecific activations within the medial and superior frontal gyrus and the superior parietal lobe including the intraparietal sulcus. These activation patterns strongly support the idea that code-specific representations are consolidated and reactivated within anatomically distributed cell assemblies that comprise sensory and motor processing systems.
Kim, Mingyu; Jeon, Changyu; Kim, Jinmo
This paper proposes a portable hand haptic system using Leap Motion as a haptic interface that can be used in various virtual reality (VR) applications. The proposed hand haptic system was designed as an Arduino-based sensor architecture to enable a variety of tactile senses at low cost, and is also equipped with a portable wristband. As a haptic system designed for tactile feedback, the proposed system first identifies the left and right hands and then sends tactile senses (vibration and hea...
Podlesnik, Christopher A; Miranda-Dukoski, Ludmila; Jonas Chan, C K; Bland, Vikki J; Bai, John Y H
Differential-reinforcement treatments reduce target problem behavior in the short term but at the expense of making it more persistent long term. Basic and translational research based on behavioral momentum theory suggests that combining features of stimuli governing an alternative response with the stimuli governing target responding could make target responding less persistent. However, changes to the alternative stimulus context when combining alternative and target stimuli could diminish the effectiveness of the alternative stimulus in reducing target responding. In an animal model with pigeons, the present study reinforced responding in the presence of target and alternative stimuli. When combining the alternative and target stimuli during extinction, we altered the alternative stimulus through changes in line orientation. We found that (1) combining alternative and target stimuli in extinction more effectively decreased target responding than presenting the target stimulus on its own; (2) combining these stimuli was more effective in decreasing target responding trained with lower reinforcement rates; and (3) changing the alternative stimulus reduced its effectiveness when it was combined with the target stimulus. Therefore, changing alternative stimuli (e.g., therapist, clinical setting) during behavioral treatments that combine alternative and target stimuli could reduce the effectiveness of those treatments in disrupting problem behavior. © 2017 Society for the Experimental Analysis of Behavior.
Full Text Available The human hand comprises complex sensorimotor functions that can be impaired by neurological diseases and traumatic injuries. Effective rehabilitation can bring the impaired hand back to a functional state because of the plasticity of the central nervous system to relearn and remodel the lost synapses in the brain. Current rehabilitation therapies focus on strengthening motor skills, such as grasping, employ multiple objects of varying stiffness so that affected persons can experience a wide range of strength training. These devices have limited range of stiffness due to the rigid mechanisms employed in their variable stiffness actuators. This paper presents a novel soft robotic haptic device for neuromuscular rehabilitation of the hand, which is designed to offer adjustable stiffness and can be utilized in both clinical and home settings. The device eliminates the need for multiple objects by employing a pneumatic soft structure made with highly compliant materials that act as the actuator of the haptic interface. It is made with interchangeable sleeves that can be customized to include materials of varying stiffness to increase the upper limit of the stiffness range. The device is fabricated using existing 3D printing technologies, and polymer molding and casting techniques, thus keeping the cost low and throughput high. The haptic interface is linked to either an open-loop system that allows for an increased pressure during usage or closed-loop system that provides pressure regulation in accordance to the stiffness the user specifies. Preliminary evaluation is performed to characterize the effective controllable region of variance in stiffness. It was found that the region of controllable stiffness was between points 3 and 7, where the stiffness appeared to plateau with each increase in pressure. The two control systems are tested to derive relationships between internal pressure, grasping force exertion on the surface, and displacement using
Full Text Available The fingertips are one of the most important and sensitive parts of our body.They are the first stimulated areas of the hand when we interact with our environment.Providing haptic feedback to the fingertips in virtual reality could thus drastically improve perception and interaction with virtual environments.In this paper, we present a modular approach called HapTip to display such haptic sensations at the level of the fingertips.This approach relies on a wearable and compact haptic device able to simulate 2 Degree of Freedom (DoF shear forces on the fingertip with a displacement range of +/- 2 mm. Several modules can be added and used jointly in order to address multi-finger and/or bimanual scenarios in virtual environments.For that purpose, we introduce several haptic rendering techniques to cover different cases of 3D interaction such as touching a rough virtual surface, or feeling the inertia or weight of a virtual object.In order to illustrate the possibilities offered by HapTip, we provide four use cases focused on touching or grasping virtual objects.To validate the efficiency of our approach, we also conducted experiments to assess the tactile perception obtained with HapTip.Our results show that participants can successfully discriminate the directions of the 2 DoF stimulation of our haptic device.We found also that participants could well perceive different weights of virtual objects simulated using two HapTip devices. We believe that HapTip could be used in numerous applications in virtual reality for which 3D manipulation and tactile sensations are often crucial, such as in virtual prototyping or virtual training.
Gorlewicz, Jenna L.; Kratchman, Louis B.; Webster, Robert J., III
The haptic paddle is a force-feedback joystick used at several universities in teaching System Dynamics, a core mechanical engineering undergraduate course where students learn to model dynamic systems in several domains. A second goal of the haptic paddle is to increase the accessibility of robotics and haptics by providing a low-cost device for…
Full Text Available Tools such as pliers systematically change the relationship between an object's size and the hand opening required to grasp it. Previous work suggests the brain takes this into account, integrating visual and haptic size information that refers to the same object, independent of the similarity of the ‘raw’ visual and haptic signals (Takahashi et al., VSS 2009. Variations in tool geometry also affect the reliability (precision of haptic size estimates, however, because they alter the change in hand opening caused by a given change in object size. Here, we examine whether the brain appropriately adjusts the weights given to visual and haptic size signals when tool geometry changes. We first estimated each cue's reliability by measuring size-discrimination thresholds in vision-alone and haptics-alone conditions. We varied haptic reliability using tools with different object-size:hand-opening ratios (1:1, 0.7:1, and 1.4:1. We then measured the weights given to vision and haptics with each tool, using a cue-conflict paradigm. The weight given to haptics varied with tool type in a manner that was well predicted by the single-cue reliabilities (MLE model; Ernst and Banks, 2002. This suggests that the process of visual-haptic integration appropriately accounts for variations in haptic reliability introduced by different tool geometries.
Full Text Available This paper is concerned with compliant haptic contact and deformation of soft objects. A human soft fingertip model is considered to act as the haptic interface and is brought into contact with and deforms a discrete surface. A nonlinear constitutive law is developed in predicting normal forces and, for the haptic display of surface texture, motions along the surface are also resisted at various rates by accounting for dynamic Lund-Grenoble (LuGre frictional forces. For the soft fingertip to apply forces over an area larger than a point, normal and frictional forces are distributed around the soft fingertip contact location on the deforming surface. The distribution is realized based on a kernel smoothing function and by a nonlinear spring-damper net around the contact point. Experiments conducted demonstrate the accuracy and effectiveness of our approach in real-time haptic rendering of a kidney surface. The resistive (interaction forces are applied at the user fingertip bone edge. A 3-DoF parallel robotic manipulator equipped with a constraint based controller is used for the implementation. By rendering forces both in lateral and normal directions, the designed haptic interface system allows the user to realistically feel both the geometrical and mechanical (nonlinear properties of the deforming kidney.
Mullins, James; Fielding, Mick; Nahavandi, Saeid
This paper reports on robotic and haptic technologies and capabilities developed for the law enforcement and defence community within Australia by the Centre for Intelligent Systems Research (CISR). The OzBot series of small and medium surveillance robots have been designed in Australia and evaluated by law enforcement and defence personnel to determine suitability and ruggedness in a variety of environments. Using custom developed digital electronics and featuring expandable data busses including RS485, I2C, RS232, video and Ethernet, the robots can be directly connected to many off the shelf payloads such as gas sensors, x-ray sources and camera systems including thermal and night vision. Differentiating the OzBot platform from its peers is its ability to be integrated directly with haptic technology or the 'haptic bubble' developed by CISR. Haptic interfaces allow an operator to physically 'feel' remote environments through position-force control and experience realistic force feedback. By adding the capability to remotely grasp an object, feel its weight, texture and other physical properties in real-time from the remote ground control unit, an operator's situational awareness is greatly improved through Haptic augmentation in an environment where remote-system feedback is often limited.
Hirokawa, Masakazu; Uesugi, Naohisa; Furugori, Satoru; Kitagawa, Tomoko; Suzuki, Kenji
Compared to conventional visual- and auditory-based assisted driving technologies, haptic modality promises to be more effective and less disturbing assistance to the driver. However, in most previous studies, haptic assistance systems were evaluated from safety and stability viewpoints. Moreover, the effect of haptic assistance on human driving behavior has not been sufficiently discussed. In this paper, we introduce an assisted driving method based on haptic assistance for driver training in reverse parking, which is considered as an uncertain factor in conventional assisted driving systems. The proposed system assists the driver by applying a torque on the steering wheel to guide proper and well-timed steering. To design the appropriate assistance method, we conducted a measurement experiment to determine the qualitative reverse parking driver characteristics. Based on the determined characteristics, we propose a haptic assistance calculation method that utilizes the receding horizon control algorithm. For a simulation environment to assess the proposed assistance method, we also developed a scaled car simulator comprising a 1/10 scaled robot car and an omnidirectional camera. We used the scaled car simulator to conduct comparative experiments on subjects, and observed that the driving skills of the assisted subjects were significantly better than those of the control subjects.
Viirre, Erik; Ellisman, Mark
A researcher was working with a desktop virtual environment system. The system was displaying vector fields of a cyclonic weather system, and the system incorporated a haptic display of the forces in the cyclonic field. As the subject viewed the rotating cyclone field, they would move a handle "through" the representation of the moving winds and "feel" the forces buffeting the handle as it moved. Stopping after using the system for about 10 min, the user experienced an immediate sensation of postural instability for several minutes. Several hours later, there was the onset of vertigo with head turns. This vertigo lasted several hours and was accompanied with nausea and motion illusions that exacerbated by head movements. Symptoms persisted mildly the next day and were still present the third and fourth day, but by then were only provoked by head movements. There were no accompanying symptoms or history to suggest an inner ear disorder. Physical examination of inner ear and associated neurologic function was normal. No other users of this system have reported similar symptoms. This case suggests that some individuals may be susceptible to the interaction of displays with motion and movement forces and as a result experience motion illusions. Operators of such systems should be aware of this potential and minimize exposure if vertigo occurs.
Kassuba, Tanja; Klinge, Corinna; Hölig, Cordula
approach of multisensory integration would predict that haptics as the less efficient sense for object recognition gains more from integrating additional visual information than vice versa. To test for asymmetries between vision and touch in visuo-haptic interactions, we measured regional changes in brain...... processed the target object, being more pronounced for haptic than visual targets. This preferential response of visuo-haptic regions indicates a modality-specific asymmetry in crossmodal matching of visual and haptic object features, suggesting a functional primacy of vision over touch in visuo...
Full Text Available People obtain a lot of information from visual and auditory sensation on daily life. Regarding the effect of visual stimuli on perception of auditory stimuli, studies of phonological perception and sound localization have been made in great numbers. This study examined the effect of visual stimuli on perception in loudness and pitch of auditory stimuli. We used the image of figures whose size or brightness was changed as visual stimuli, and the sound of pure tone whose loudness or pitch was changed as auditory stimuli. Those visual and auditory stimuli were combined independently to make four types of audio-visual multisensory stimuli for psychophysical experiments. In the experiments, participants judged change in loudness or pitch of auditory stimuli, while they judged the direction of size change or the kind of a presented figure in visual stimuli. Therefore they cannot neglect visual stimuli while they judged auditory stimuli. As a result, perception in loudness and pitch were promoted significantly around their difference limen, when the image was getting bigger or brighter, compared with the case in which the image had no changes. This indicates that perception in loudness and pitch were affected by change in size and brightness of visual stimuli.
This thesis focuses on the modeling and the identification of haptic interfaces using cable drive. An haptic interface is a force feedback device, which enables its user to interact with a virtual world or a remote environment explored by a slave system. It aims at the matching between the forces and displacements given by the user and those applied to virtual world. Usually, haptic interfaces make use of a mechanical actuated structure whose distal link is equipped with a handle. When manipulating this handle to interact with explored world, the user feels the apparent mass, compliance and friction of the interface. This distortion introduced between the operator and the virtual world must be modeled and identified to enhance the design of the interface and develop appropriate control laws. The first approach has been to adapt the modeling and identification methods of rigid and localized flexibilities robots to haptic interfaces. The identification technique makes use of the inverse dynamic model and the linear least squares with the measurements of joint torques and positions. This approach is validated on a single degree of freedom and a three degree of freedom haptic devices. A new identification method needing only torque data is proposed. It is based on a closed loop simulation using the direct dynamic model. The optimal parameters minimize the 2 norms of the error between the actual torque and the simulated torque assuming the same control law and the same tracking trajectory. This non linear least squares problem dramatically is simplified using the inverse model to calculate the simulated torque. This method is validated on the single degree of freedom haptic device and the SCARA robot. (author)
Chie Takahashi; Simon J Watt
Tools such as pliers systematically change the relationship between an object's size and the hand opening required to grasp it. Previous work suggests the brain takes this into account, integrating visual and haptic size information that refers to the same object, independent of the similarity of the ‘raw’ visual and haptic signals (Takahashi et al., VSS 2009). Variations in tool geometry also affect the reliability (precision) of haptic size estimates, however, because they alter the change ...
Bergmann Tiest, W.M.; Kappers, A.M.L.
For the perception of the hardness of compliant materials, several cues are available. In this paper, the relative roles of force/displacement and surface deformation cues are investigated. We have measured discrimination thresholds with silicone rubber stimuli of differing thickness and compliance.
Williams, Camille K.; Tseung, Victrine; Carnahan, Heather
Studies of self-controlled practice have shown benefits when learners controlled feedback schedule, use of assistive devices and task difficulty, with benefits attributed to information processing and motivational advantages of self-control. Although haptic assistance serves as feedback, aids task performance and modifies task difficulty, researchers have yet to explore whether self-control over haptic assistance could be beneficial for learning. We explored whether self-control of haptic assistance would be beneficial for learning a tracing task. Self-controlled participants selected practice blocks on which they would receive haptic assistance, while participants in a yoked group received haptic assistance on blocks determined by a matched self-controlled participant. We inferred learning from performance on retention tests without haptic assistance. From qualitative analysis of open-ended questions related to rationales for/experiences of the haptic assistance that was chosen/provided, themes emerged regarding participants’ views of the utility of haptic assistance for performance and learning. Results showed that learning was directly impacted by the frequency of haptic assistance for self-controlled participants only and view of haptic assistance. Furthermore, self-controlled participants’ views were significantly associated with their requested haptic assistance frequency. We discuss these findings as further support for the beneficial role of self-controlled practice for motor learning. PMID:29255438
Kjellerup, Marie Kjær; Larsen, Anne Cathrine; Maier, Anja
This paper explores how designers may communicate with the users of their products through haptic design. More specifically, how tactile properties of materials evoke emotions such as satisfaction, joy, or disgust. A research through design approach has been followed; mood- and material boards...... and prototypes of four ‘haptically enhanced’ (physical) keys were created. Types of keys selected include home, bicycle, hobby, and basement. An experiment with ten participants was conducted, using word association and a software to elicit product emotions (PrEmo). Results show a mapping between the designer...
Juan Manuel Ibarra-Zannatha
Full Text Available The aim of this work is the integration of a virtual environment containing a deformable object, manipulated by an open kinematical chain virtual slave robot, to a bilateral teleoperation scheme based on a real haptic device. The virtual environment of this hybrid bilateral teleoperation system combines collision detection algorithms, dynamical, kinematical and geometrical models with a position–position and/or force–position bilateral control algorithm, to produce on the operator side the reflected forces corresponding to the virtual mechanical interactions, through a haptic device. Contact teleoperation task over the virtual environment with a flexible object is implemented and analysed.
Panait, Lucian; Akkary, Ehab; Bell, Robert L; Roberts, Kurt E; Dudrick, Stanley J; Duffy, Andrew J
Laparoscopic virtual reality simulators are becoming a ubiquitous tool in resident training and assessment. These devices provide the operator with various levels of realism, including haptic (or force) feedback. However, this feature adds significantly to the cost of the devices, and limited data exist assessing the value of haptics in skill acquisition and development. Utilizing the Laparoscopy VR (Immersion Medical, Gaithersburg, MD), we hypothesized that the incorporation of force feedback in the simulated operative environment would allow superior trainee performance compared with performance of the same basic skills tasks in a non-haptic model. Ten medical students with minimal laparoscopic experience and similar baseline skill levels as proven by performance of two fundamentals of laparoscopic surgery (FLS) tasks (peg transfer and cutting drills) voluntarily participated in the study. Each performed two tasks, analogous to the FLS drills, on the Laparoscopy VR at 3 levels of difficulty, based on the established settings of the manufacturer. After achieving familiarity with the device and tasks, the students completed the drills both with and without force feedback. Data on completion time, instrument path length, right and left hand errors, and grasping tension were analyzed. The scores in the haptic-enhanced simulation environment were compared with the scores in the non-haptic model and analyzed utilizing Student's t-test. The peg transfer drill showed no difference in performance between the haptic and non-haptic simulations for all metrics at all three levels of difficulty. For the more complex cutting exercise, the time to complete the tasks was significantly shorter when force feedback was provided, at all levels of difficulty (158+/-56 versus 187+/-51 s, 176+/-49 versus 222+/-68 s, and 275+/-76 versus 422+/-220 s, at levels 1, 2, and 3, respectively, Psimulation did not demonstrate an appreciable performance improvement among our trainees. These data
Potencial evocado auditivo de longa latência para estímulo de fala apresentado com diferentes transdutores em crianças ouvintes Late auditory evoked potentials to speech stimuli presented with different transducers in hearing children
Raquel Sampaio Agostinho-Pesse
rate of 1.9 stimuli per second. Whenever present, P1, N1 and P2 components were analyzed as to latency and amplitude. RESULTS: it was found a strong level of agreement between the researcher and the judge. There was no statistically significant difference when comparing the values of latency and amplitude of the P1, N1 and P2 components, when considering gender and ear, as well as the latency of components when considering the types of transducers. However, there was a statistically significant difference for the amplitude of the P1 and N1 components with greater amplitude for the speaker transducer. CONCLUSION: the latency values of the P1, N1 and P2 components and P2 amplitude obtained with insertion phone may be used as normal reference independent of the transducer used for the recording of auditory evoked potentials of long latency.
Courtecuisse, Hadrien; Jung, Hoeryong; Allard, Jérémie; Duriez, Christian; Lee, Doo Yong; Cotin, Stéphane
This article describes a series of contributions in the field of real-time simulation of soft tissue biomechanics. These contributions address various requirements for interactive simulation of complex surgical procedures. In particular, this article presents results in the areas of soft tissue deformation, contact modelling, simulation of cutting, and haptic rendering, which are all relevant to a variety of medical interventions. The contributions described in this article share a common underlying model of deformation and rely on GPU implementations to significantly improve computation times. This consistency in the modelling technique and computational approach ensures coherent results as well as efficient, robust and flexible solutions. Copyright © 2010 Elsevier Ltd. All rights reserved.
Hanyu, Ryosuke; Tsuji, Toshiaki
This paper proposes a whole-body haptic sensing system that has multiple supporting points between the body frame and the end-effector. The system consists of an end-effector and multiple force sensors. Using this mechanism, the position of a contact force on the surface can be calculated without any sensor array. A haptic sensing system with a single supporting point structure has previously been developed by the present authors. However, the system has drawbacks such as low stiffness and low strength. Therefore, in this study, a mechanism with multiple supporting points was proposed and its performance was verified. In this paper, the basic concept of the mechanism is first introduced. Next, an evaluation of the proposed method, performed by conducting some experiments, is presented.
Zhou, Jiawei; Liu, Rong; Zhou, Yifeng; Hess, Robert F.
Phase information is a fundamental aspect of visual stimuli. However, the nature of the binocular combination of stimuli defined by modulations in contrast, so-called second-order stimuli, is presently not clear. To address this issue, we measured binocular combination for first- (luminance modulated) and second-order (contrast modulated) stimuli using a binocular phase combination paradigm in seven normal adults. We found that the binocular perceived phase of second-order gratings depends on the interocular signal ratio as has been previously shown for their first order counterparts; the interocular signal ratios when the two eyes were balanced was close to 1 in both first- and second-order phase combinations. However, second-order combination is more linear than previously found for first-order combination. Furthermore, binocular combination of second-order stimuli was similar regardless of whether the carriers in the two eyes were correlated, anti-correlated, or uncorrelated. This suggests that, in normal adults, the binocular phase combination of second-order stimuli occurs after the monocular extracting of the second-order modulations. The sensory balance associated with this second-order combination can be obtained from binocular phase combination measurements. PMID:24404180
Plaisier, Myrthe A; Bergmann Tiest, Wouter M.; Kappers, Astrid M L
Shape is an important cue for recognizing an object by touch. Several features, such as edges, curvature, surface area, and aspect ratio, are associated with 3-D shape. To investigate the saliency of 3-D shape features, we developed a haptic search task. The target and distractor items consisted of
Wijntjes, Maarten W A; Volcic, Robert; Pont, Sylvia C.; Koenderink, Jan J.; Kappers, Astrid M L
We studied the influence of haptics on visual perception of three-dimensional shape. Observers were shown pictures of an oblate spheroid in two different orientations. A gauge-figure task was used to measure their perception of the global shape. In the first two sessions only vision was used. The
Suebnukarn, Siriwan; Haddawy, Peter; Rhienmora, Phattanapon; Gajananan, Kugamoorthy
Haptic virtual reality (VR) has revolutionized the skill acquisition in dentistry. The strength of the haptic VR system is that it can automatically record the outcome and associated kinematic data on how each step of the task is performed, which are not available in the conventional skill training environments. The aim of this study was to assess skill acquisition in endodontics and to identify process and outcome variables for the quantification of proficiency. Twenty novices engaged in the experimental study that involved practicing the access opening task with the haptic VR system. Process (speed, force utilization, and bimanual coordination) and outcome variables were determined for assessing skill performance. These values were compared before and after training. Significant improvements were observed through training in all variables. A unique force used pattern and bimanual coordination were observed in each step of the access opening in the posttraining session. The novices also performed the tasks considerably faster with greater outcome within the first two to three training sessions. The study objectively showed that the novices could learn to perform access opening tasks faster and with more consistency, better bimanual dexterity, and better force utilization. The variables examined showed great promise as objective indicators of proficiency and skill acquisition in haptic VR.
Garcia Canseco, E.; Ayemlong Fokem, A.; Serrarens, A.F.A.; Steinbuch, M.; Stigter, H.
The goal of this project is to research the effectiveness of a controlled haptic force feedback shift lever that can accurately reproduce the behavior of a manual gear shift during driving, and that can also be used to control interior and comfort functions in the car.
Sinclair, I.; Carter, J.; Kassner, S.; Erp, J.B.F. van; Weber, G.; Elliott, L.; Andrew, I.
Tactile and haptic interaction is becoming increasingly important; ergonomic standards can ensure that systems are designed with sufficient concern for ergonomics and interoperability. ISO (through working group TC159/SC4/WG9) is developing international standards in this subject area, dual-tracked
Smisek, J.; Mugge, W.; Smeets, J.B.J.; Van Paassen, M.M.; Schiele, A
Haptic guidance systems support the operator in task execution using additional forces on the input device. Scaling of the guidance forces determines the control authority of the support system. As task complexity may vary, one level of the guidance scaling may be insufficient, and adaptation of the
The experience of "virtual reality" can consist of head-tracked and stereoscopic virtual worlds, spatialized sound, haptic feedback, and to a lesser extent olfactory cues. Although virtual reality systems have been proposed for numerous applications, the field of education is one particular application that seems well-suited for virtual…
Meyer, Georg F.; Shao, Fei; White, Mark D.; Hopkins, Carl; Robotham, Antony J.
Externally generated visual motion signals can cause the illusion of self-motion in space (vection) and corresponding visually evoked postural responses (VEPR). These VEPRs are not simple responses to optokinetic stimulation, but are modulated by the configuration of the environment. The aim of this paper is to explore what factors modulate VEPRs in a high quality virtual reality (VR) environment where real and virtual foreground objects served as static visual, auditory and haptic reference points. Data from four experiments on visually evoked postural responses show that: 1) visually evoked postural sway in the lateral direction is modulated by the presence of static anchor points that can be haptic, visual and auditory reference signals; 2) real objects and their matching virtual reality representations as visual anchors have different effects on postural sway; 3) visual motion in the anterior-posterior plane induces robust postural responses that are not modulated by the presence of reference signals or the reality of objects that can serve as visual anchors in the scene. We conclude that automatic postural responses for laterally moving visual stimuli are strongly influenced by the configuration and interpretation of the environment and draw on multisensory representations. Different postural responses were observed for real and virtual visual reference objects. On the basis that automatic visually evoked postural responses in high fidelity virtual environments should mimic those seen in real situations we propose to use the observed effect as a robust objective test for presence and fidelity in VR. PMID:23840760
Georg F Meyer
Full Text Available Externally generated visual motion signals can cause the illusion of self-motion in space (vection and corresponding visually evoked postural responses (VEPR. These VEPRs are not simple responses to optokinetic stimulation, but are modulated by the configuration of the environment. The aim of this paper is to explore what factors modulate VEPRs in a high quality virtual reality (VR environment where real and virtual foreground objects served as static visual, auditory and haptic reference points. Data from four experiments on visually evoked postural responses show that: 1 visually evoked postural sway in the lateral direction is modulated by the presence of static anchor points that can be haptic, visual and auditory reference signals; 2 real objects and their matching virtual reality representations as visual anchors have different effects on postural sway; 3 visual motion in the anterior-posterior plane induces robust postural responses that are not modulated by the presence of reference signals or the reality of objects that can serve as visual anchors in the scene. We conclude that automatic postural responses for laterally moving visual stimuli are strongly influenced by the configuration and interpretation of the environment and draw on multisensory representations. Different postural responses were observed for real and virtual visual reference objects. On the basis that automatic visually evoked postural responses in high fidelity virtual environments should mimic those seen in real situations we propose to use the observed effect as a robust objective test for presence and fidelity in VR.
Meyer, Georg F; Shao, Fei; White, Mark D; Hopkins, Carl; Robotham, Antony J
Externally generated visual motion signals can cause the illusion of self-motion in space (vection) and corresponding visually evoked postural responses (VEPR). These VEPRs are not simple responses to optokinetic stimulation, but are modulated by the configuration of the environment. The aim of this paper is to explore what factors modulate VEPRs in a high quality virtual reality (VR) environment where real and virtual foreground objects served as static visual, auditory and haptic reference points. Data from four experiments on visually evoked postural responses show that: 1) visually evoked postural sway in the lateral direction is modulated by the presence of static anchor points that can be haptic, visual and auditory reference signals; 2) real objects and their matching virtual reality representations as visual anchors have different effects on postural sway; 3) visual motion in the anterior-posterior plane induces robust postural responses that are not modulated by the presence of reference signals or the reality of objects that can serve as visual anchors in the scene. We conclude that automatic postural responses for laterally moving visual stimuli are strongly influenced by the configuration and interpretation of the environment and draw on multisensory representations. Different postural responses were observed for real and virtual visual reference objects. On the basis that automatic visually evoked postural responses in high fidelity virtual environments should mimic those seen in real situations we propose to use the observed effect as a robust objective test for presence and fidelity in VR.
Pekedis, Mahmut; Mascerañas, David; Turan, Gursoy; Ercan, Emre; Farrar, Charles R.; Yildiz, Hasan
For the last two decades, developments in damage detection algorithms have greatly increased the potential for autonomous decisions about structural health. However, we are still struggling to build autonomous tools that can match the ability of a human to detect and localize the quantity of damage in structures. Therefore, there is a growing interest in merging the computational and cognitive concepts to improve the solution of structural health monitoring (SHM). The main object of this research is to apply the human-machine cooperative approach on a tower structure to detect damage. The cooperation approach includes haptic tools to create an appropriate collaboration between SHM sensor networks, statistical compression techniques and humans. Damage simulation in the structure is conducted by releasing some of the bolt loads. Accelerometers are bonded to various locations of the tower members to acquire the dynamic response of the structure. The obtained accelerometer results are encoded in three different ways to represent them as a haptic stimulus for the human subjects. Then, the participants are subjected to each of these stimuli to detect the bolt loosened damage in the tower. Results obtained from the human-machine cooperation demonstrate that the human subjects were able to recognize the damage with an accuracy of 88 ± 20.21% and response time of 5.87 ± 2.33 s. As a result, it is concluded that the currently developed human-machine cooperation SHM may provide a useful framework to interact with abstract entities such as data from a sensor network.
Full Text Available The neural bases of haptically-guided grasp planning and execution are largely unknown, especially for stimuli having no visual representations. Therefore, we used functional magnetic resonance imaging (fMRI to monitor brain activity during haptic exploration of novel 3D complex objects, subsequent grasp planning, and the execution of the pre-planned grasps. Haptic object exploration, involving extraction of shape, orientation and length of the to-be-grasped targets, was associated with the fronto-parietal, temporo-occipital, and insular cortex activity. Yet, only the anterior divisions of the posterior parietal cortex (PPC of the right hemisphere were significantly more engaged in exploration of complex objects (vs. simple control disks. None of these regions were re-recruited during the planning phase. Even more surprisingly, the left-hemisphere intraparietal, temporal, and occipital areas that were significantly invoked for grasp planning did not show sensitivity to object features. Finally, grasp execution, involving the re-recruitment of the critical right-hemisphere PPC clusters, was also significantly associated with two kinds of bilateral parieto-frontal processes. The first represents transformations of grasp-relevant target features and is linked to the dorso-dorsal (lateral and medial parieto-frontal networks. The second monitors grasp kinematics and belongs to the ventro-dorsal networks. Indeed, signal modulations associated with these distinct functions follow dorso-ventral gradients, with left aIPS showing significant sensitivity to both target features and the characteristics of the required grasp. Thus, our results from the haptic domain are consistent with the notion that the parietal processing for action guidance reflects primarily transformations from object-related to effector-related coding, and these mechanisms are rather independent of sensory input modality.
Lin, Shiyong; Lee, Yuan-Shin; Narayan, Roger J.
This paper presents a novel technique for modeling soft biological tissues as well as the development of an innovative interface for bio-manufacturing and medical applications. Heterogeneous deformable models may be used to represent the actual internal structures of deformable biological objects, which possess multiple components and nonuniform material properties. Both heterogeneous deformable object modeling and accurate haptic rendering can greatly enhance the realism and fidelity of virtual reality environments. In this paper, a tri-ray node snapping algorithm is proposed to generate a volumetric heterogeneous deformable model from a set of object interface surfaces between different materials. A constrained local static integration method is presented for simulating deformation and accurate force feedback based on the material properties of a heterogeneous structure. Biological soft tissue modeling is used as an example to demonstrate the proposed techniques. By integrating the heterogeneous deformable model into a virtual environment, users can both observe different materials inside a deformable object as well as interact with it by touching the deformable object using a haptic device. The presented techniques can be used for surgical simulation, bio-product design, bio-manufacturing, and medical applications.
Hedayat, Isabel; Moraes, Renato; Lanovaz, Joel L; Oates, Alison R
There are different ways to add haptic input during walking which may affect walking balance. This study compared the use of two different haptic tools (rigid railing and haptic anchors) and investigated whether any effects on walking were the result of the added sensory input and/or the posture generated when using those tools. Data from 28 young healthy adults were collected using the Mobility Lab inertial sensor system (APDM, Oregon, USA). Participants walked with and without both haptic tools and while pretending to use both haptic tools (placebo trials), with eyes opened and eyes closed. Using the tools or pretending to use both tools decreased normalized stride velocity (p .999). These findings highlight a difference in the type of tool used to add haptic input and suggest that changes in balance control strategy resulting from using the railing are based on arm placement, where it is the posture combined with added sensory input that affects balance control strategies with the haptic anchors. These findings provide a strong framework for additional research to be conducted on the effects of haptic input on walking in populations known to have decreased walking balance.
Katzschmann, Robert K; Araki, Brandon; Rus, Daniela
This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user's waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user's upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device's capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases.
Su, Hao; Shang, Weijian; Li, Gang; Patel, Niravkumar; Fischer, Gregory S
This paper presents a surgical master-slave teleoperation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. The slave robot consists of a piezoelectrically actuated 6-degree-of-freedom (DOF) robot for needle placement with an integrated fiber optic force sensor (1-DOF axial force measurement) using the Fabry-Perot interferometry (FPI) sensing principle; it is configured to operate inside the bore of the MRI scanner during imaging. By leveraging the advantages of pneumatic and piezoelectric actuation in force and position control respectively, we have designed a pneumatically actuated master robot (haptic device) with strain gauge based force sensing that is configured to operate the slave from within the scanner room during imaging. The slave robot follows the insertion motion of the haptic device while the haptic device displays the needle insertion force as measured by the FPI sensor. Image interference evaluation demonstrates that the telesurgery system presents a signal to noise ratio reduction of less than 17% and less than 1% geometric distortion during simultaneous robot motion and imaging. Teleoperated needle insertion and rotation experiments were performed to reach 10 targets in a soft tissue-mimicking phantom with 0.70 ± 0.35 mm Cartesian space error.
Bar-Cohen, Y.; Mavroidis, C.; Bouzit, M.; Dolgin, B.; Harm, D. L.; Kopchok, G. E.; White, R.
There is an increasing realization that some tasks can be performed significantly better by humans than robots but, due to associated hazards, distance, etc., only a robot can be employed. Telemedicine is one area where remotely controlled robots can have a major impact by providing urgent care at remote sites. In recent years, remotely controlled robotics has been greatly advanced. The robotic astronaut, "Robonaut," at NASA Johnson Space Center is one such example. Unfortunately, due to the unavailability of force and tactile feedback capability the operator must determine the required action using only visual feedback from the remote site, which limits the tasks that Robonaut can perform. There is a great need for dexterous, fast, accurate teleoperated robots with the operator?s ability to "feel" the environment at the robot's field. Recently, we conceived a haptic mechanism called MEMICA (Remote MEchanical MIrroring using Controlled stiffness and Actuators) that can enable the design of high dexterity, rapid response, and large workspace system. Our team is developing novel MEMICA gloves and virtual reality models to allow the simulation of telesurgery and other applications. The MEMICA gloves are designed to have a high dexterity, rapid response, and large workspace and intuitively mirror the conditions at a virtual site where a robot is simulating the presence of the human operator. The key components of MEMICA are miniature electrically controlled stiffness (ECS) elements and Electrically Controlled Force and Stiffness (ECFS) actuators that are based on the sue of Electro-Rheological Fluids (ERF). In this paper the design of the MEMICA system and initial experimental results are presented.
Yashiro, Daisuke; Tian, Dapeng; Yakoh, Takahiro
This paper proposes an end-to-end flow controller for visual-haptic communication. A visual-haptic communication system transmits non-real-time packets, which contain large-size visual data, and real-time packets, which contain small-size haptic data. When the transmission rate of visual data exceeds the communication bandwidth, the visual-haptic communication system becomes unstable owing to buffer overflow. To solve this problem, an end-to-end flow controller is proposed. This controller determines the optimal transmission rate of visual data on the basis of the traffic conditions, which are estimated by the packets for haptic communication. Experimental results confirm that in the proposed method, a short packet-sending interval and a short delay are achieved under bandwidth change, and thus, high-precision visual-haptic communication is realized.
Full Text Available This paper describes an experiment conducted to measure haptic sensitivity and the effects of haptic training with and without visual aid. The protocol for haptic training consisted of a needle insertion task using dual-layer silicon samples. A visual aid was provided as a multimodal cue for the haptic perception task. Results showed that for a group of novices (subjects with no previous experience in needle insertion, training with a visual aid resulted in a longer time to task completion, and a greater applied force, during post-training tests. This suggests that haptic perception is easily overshadowed, and may be completely replaced, by visual feedback. Therefore, haptic skills must be trained differently from visuomotor skills.
Petermeijer, Sebastiaan M; Abbink, David A; de Winter, Joost C F
The aim of this study was to compare continuous versus bandwidth haptic steering guidance in terms of lane-keeping behavior, aftereffects, and satisfaction. An important human factors question is whether operators should be supported continuously or only when tolerance limits are exceeded. We aimed to clarify this issue for haptic steering guidance by investigating costs and benefits of both approaches in a driving simulator. Thirty-two participants drove five trials, each with a different level of haptic support: no guidance (Manual); guidance outside a 0.5-m bandwidth (Band1); a hysteresis version of Band1, which guided back to the lane center once triggered (Band2); continuous guidance (Cont); and Cont with double feedback gain (ContS). Participants performed a reaction time task while driving. Toward the end of each trial, the guidance was unexpectedly disabled to investigate aftereffects. All four guidance systems prevented large lateral errors (>0.7 m). Cont and especially ContS yielded smaller lateral errors and higher time to line crossing than Manual, Band1, and Band2. Cont and ContS yielded short-lasting aftereffects, whereas Band1 and Band2 did not. Cont yielded higher self-reported satisfaction and faster reaction times than Band1. Continuous and bandwidth guidance both prevent large driver errors. Continuous guidance yields improved performance and satisfaction over bandwidth guidance at the cost of aftereffects and variability in driver torque (indicating human-automation conflicts). The presented results are useful for designers of haptic guidance systems and support critical thinking about the costs and benefits of automation support systems.
Bernard, F.; Casset, F.; Danel, J. S.; Chappaz, C.; Basrour, S.
This paper presents for the first time the characterization of a smartphone-size haptic rendering system based on the friction modulation effect. According to previous work and finite element modeling, the homogeneous flexural modes are needed to get the haptic feedback effect. The device studied consists of a thin film AlN transducers deposited on an 110 × 65 mm2 glass substrate. The transducer’s localization on the glass plate allows a transparent central area of 90 × 49 mm2. Electrical and mechanical parameters of the system are extracted from measurement. From this extraction, the electrical impedance matching reduced the applied voltage to 17.5 V AC and the power consumption to 1.53 W at the resonance frequency of the vibrating system to reach the haptic rendering specification. Transient characterizations of the actuation highlight a delay under the dynamic tactile detection. The characterization of the AlN transducers used as sensors, including the noise rejection, the delay or the output charge amplitude allows detections with high accuracy of any variation due to external influences. Those specifications are the first step to a low-power-consumption feedback-looped system.
Bernard, F; Basrour, S; Casset, F; Danel, J S; Chappaz, C
This paper presents for the first time the characterization of a smartphone-size haptic rendering system based on the friction modulation effect. According to previous work and finite element modeling, the homogeneous flexural modes are needed to get the haptic feedback effect. The device studied consists of a thin film AlN transducers deposited on an 110 × 65 mm 2 glass substrate. The transducer’s localization on the glass plate allows a transparent central area of 90 × 49 mm 2 . Electrical and mechanical parameters of the system are extracted from measurement. From this extraction, the electrical impedance matching reduced the applied voltage to 17.5 V AC and the power consumption to 1.53 W at the resonance frequency of the vibrating system to reach the haptic rendering specification. Transient characterizations of the actuation highlight a delay under the dynamic tactile detection. The characterization of the AlN transducers used as sensors, including the noise rejection, the delay or the output charge amplitude allows detections with high accuracy of any variation due to external influences. Those specifications are the first step to a low-power-consumption feedback-looped system. (paper)
May, Michael; Petersen, Johannes
A semiotic approach to the design space of information presentation is presented in which Formal Concept Analysis (FCA) is used to represent and explore attributes of abstract sign types and the media (graphical, haptic, acoustic, gestic) through which they are presented as specific...
This thesis explores haptic data processing methods for teleoperation systems, including prediction, compression, and error correction. In the proposed haptic data prediction method, unreliable network conditions, such as time-varying delay and packet loss, are detected by a transport layer protocol. Given the information from the transport layer, a Bayesian approach is introduced to predict position and force data in haptic teleoperation systems. Stability of the proposed method within stoch...
We make a proposal for a music baton system for visual handicapped persons. This system is constituted by an acceleration sensor. a radio module. and a haptic interface device. The acceleration sensor is built in the music baton grip and the data are transmitted by the radio module. A performer has a receiver with the haptic interface device. The receiver's CPU picks up rhythm from the data and vibrates the haptic interface device. This paper is described about an experiment of comparing the ...
Boer, Laurens; Vallgårda, Anna; Cahill, Ben
The Hedonic Haptics player is a portable wearable device that plays back vibrotactile compositions. It consists of three domes each of which houses a vibration motor providing vibrotactile sensations to the wearer. The domes are connected to a control unit the size of a small Walkman. The Hedonic Haptics player can store up to ten different compositions made up of haptic signals varying in amplitude, waveform and length. We use these different compositions to explore the aesthetic potential o...
Kazén, Miguel; Solís-Macías, Víctor M
In two experiments, we investigate hypermnesia, net memory improvements with repeated testing of the same material after a single study trial. In the first experiment, we found hypermnesia across three trials for the recall of word solutions to Socratic stimuli (dictionary-like definitions of concepts) replicating Erdelyi, Buschke, and Finkelstein and, for the first time using these materials, for their recognition. In the second experiment, we had two "yes/no" recognition groups, a Socratic stimuli group presented with concrete and abstract verbal materials and a word-only control group. Using signal detection measures, we found hypermnesia for concrete Socratic stimuli-and stable performance for abstract stimuli across three recognition tests. The control group showed memory decrements across tests. We interpret these findings with the alternative retrieval pathways (ARP) hypothesis, contrasting it with alternative theories of hypermnesia, such as depth of processing, generation and retrieve-recognise. We conclude that recognition hypermnesia for concrete Socratic stimuli is a reliable phenomenon, which we found in two experiments involving both forced-choice and yes/no recognition procedures.
Full Text Available Attribute amnesia is the counterintuitive phenomenon where observers are unable to report a salient aspect of a stimulus (e.g., its colour or its identity immediately after the stimulus was presented, despite both attending to and processing the stimulus. Almost all previous attribute amnesia studies used highly familiar stimuli. Our study investigated whether attribute amnesia would also occur for unfamiliar stimuli. We conducted four experiments using stimuli that were highly familiar (colours or repeated animal images or that were unfamiliar to the observers (unique animal images. Our results revealed that attribute amnesia was present for both sets of familiar stimuli, colour (p < .001 and repeated animals (p = .001; but was greatly attenuated, and possibly eliminated, when the stimuli were unique animals (p = .02. Our data shows that attribute amnesia is greatly reduced for novel stimuli.
Wu, Jun; Westermann, Rüdiger; Dick, Christian
We present our systematic efforts in advancing the computational performance of physically accurate soft tissue cutting simulation, which is at the core of surgery simulators in general. We demonstrate a real-time performance of 15 simulation frames per second for haptic soft tissue cutting of a deformable body at an effective resolution of 170,000 finite elements. This is achieved by the following innovative components: (1) a linked octree discretization of the deformable body, which allows for fast and robust topological modifications of the simulation domain, (2) a composite finite element formulation, which thoroughly reduces the number of simulation degrees of freedom and thus enables to carefully balance simulation performance and accuracy, (3) a highly efficient geometric multigrid solver for solving the linear systems of equations arising from implicit time integration, (4) an efficient collision detection algorithm that effectively exploits the composition structure, and (5) a stable haptic rendering algorithm for computing the feedback forces. Considering that our method increases the finite element resolution for physically accurate real-time soft tissue cutting simulation by an order of magnitude, our technique has a high potential to significantly advance the realism of surgery simulators.
Full Text Available A visuo-haptic augmented reality (VHAR interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source.
Full Text Available The winner of many prestigious prizes (Oscar for the best foreign language film, Grand Prize of the Cannes Film Festival, and the Golden Globe among them, the Hungarian film, Son of Saul – according to most critics – represents the Holocaust trauma in a completely new and intriguing way. The filmmakers have invented a special form in order to tackle the heroic task of showing the unwatchable, representing the unthinkable. In this essay I analyse the representational strategy of the film from a phenomenological point of view, and position it in the theoretical framework of haptic sensuality formulated by Vivian Sobchack and Laura U. Marks, among others. I mainly focus on the use of sound, in particular the role of sound design in the creation of haptic space. With the help of the analysis of the representation and artistic invocation of the different bodily senses in the film, I demonstrate how traditional artistic formal elements (characteristic of highly artistic, even experimental productions are combined with high impact effects often present in popular film forms. I argue that the successful combination of these two factors makes the film an example of artistic immersive cinema.1
Bailes, S M; Lambert, R M
Studies using haptic form recognition tasks have generally concluded that the adventitiously blind perform better than the congenitally blind, implicating the importance of early visual experience in improved spatial functioning. The hypothesis was tested that the adventitiously blind have retained some ability to encode successive information obtained haptically in terms of a global visual representation, while the congenitally blind use a coding system based on successive inputs. Eighteen blind (adventitiously and congenitally) and 18 sighted (blindfolded and performing with vision) subjects were tested on their recognition of raised line patterns when the standard was presented in segments: in immediate succession, or with unfilled intersegmental delays of 5, 10, or 15 seconds. The results did not support the above hypothesis. Three main findings were obtained: normally sighted subjects were both faster and more accurate than the other groups; all groups improved in accuracy of recognition as a function of length of interstimulus interval; sighted subjects tended to report using strategies with a strong verbal component while the blind tended to rely on imagery coding. These results are explained in terms of information-processing theory consistent with dual encoding systems in working memory.
Ponce Wong, Ruben D; Hellman, Randall B; Santos, Veronica J
Upper-limb amputees rely primarily on visual feedback when using their prostheses to interact with others or objects in their environment. A constant reliance upon visual feedback can be mentally exhausting and does not suffice for many activities when line-of-sight is unavailable. Upper-limb amputees could greatly benefit from the ability to perceive edges, one of the most salient features of 3D shape, through touch alone. We present an approach for estimating edge orientation with respect to an artificial fingertip through haptic exploration using a multimodal tactile sensor on a robot hand. Key parameters from the tactile signals for each of four exploratory procedures were used as inputs to a support vector regression model. Edge orientation angles ranging from -90 to 90 degrees were estimated with an 85-input model having an R (2) of 0.99 and RMS error of 5.08 degrees. Electrode impedance signals provided the most useful inputs by encoding spatially asymmetric skin deformation across the entire fingertip. Interestingly, sensor regions that were not in direct contact with the stimulus provided particularly useful information. Methods described here could pave the way for semi-autonomous capabilities in prosthetic or robotic hands during haptic exploration, especially when visual feedback is unavailable.
Aleotti, Jacopo; Micconi, Giorgio; Caselli, Stefano; Benassi, Giacomo; Zambelli, Nicola; Bettelli, Manuele; Zappettini, Andrea
A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source.
Hung, Nguyen Quoc; Tri, Diep Bao; Cuong, Vo Van; Choi, Seung-Bok
In this research, a new configuration of bidirectional actuator featuring MR fluid (BMRA) is proposed for haptic application. The proposed BMRA consists of a driving disc, a driving housing and a driven disc. The driving disc is placed inside the driving housing and rotates counter to each other by a servo DC motor and a bevel gear system. The driven shaft is also placed inside the housing and next to the driving disc. The gap between the two disc and the gap between the discs and the housing are filled with MR fluid. On the driven disc, two mutual magnetic coils are placed. By applying currents to the two coils mutually, the torque at the output shaft, which is fixed to the driven disc, can be controlled with positive, zero or negative value. This make the actuator be suitable for haptic application. After a review of MR fluid and its application, configuration of the proposed BMRA is presented. The modeling of the actuator is then derived based on Bingham rheological model of MRF and magnetic finite element analysis (FEA). The optimal design of the actuator is then performed to minimize the mass of the BMRA. From the optimal design result, performance characteristics of the actuator is simulated and detailed design of a prototype actuator is conducted.
Wang, Jiabin; Zhao, Lu; Liu, Yue; Wang, Yongtian; Cai, Yi
A shape-changing table-top display with haptic feedback allows its users to perceive 3D visual and texture displays interactively. Since few existing devices are developed as accurate displays with regulatory haptic feedback, a novel attentive and immersive shape changing mechanical interface (SCMI) consisting of image processing unit and transformation unit was proposed in this paper. In order to support a precise 3D table-top display with an offset of less than 2 mm, a custommade mechanism was developed to form precise surface and regulate the feedback force. The proposed image processing unit was capable of extracting texture data from 2D picture for rendering shape-changing surface and realizing 3D modeling. The preliminary evaluation result proved the feasibility of the proposed system.
Kassuba, Tanja; Klinge, Corinna; Hölig, Cordula
, the same stimulation gave rise to relative increases in activation during S2 processing in the right LO, left FG, bilateral IPS, and other regions previously associated with object recognition. Critically, the modality of S2 determined which regions were recruited after rTMS. Relative to sham rTMS, real r......TMS induced increased activations during crossmodal congruent matching in the left FG for haptic S2 and the temporal pole for visual S2. In addition, we found stronger activations for incongruent than congruent matching in the right anterior parahippocampus and middle frontal gyrus for crossmodal matching......Functional magnetic resonance imaging (fMRI) studies have provided ample evidence for the involvement of the lateral occipital cortex (LO), fusiform gyrus (FG), and intraparietal sulcus (IPS) in visuo-haptic object integration. Here we applied 30 min of sham (non-effective) or real offline 1 Hz...
de Jonge, A. W.; Wildenbeest, J. G. W.; Boessenkool, H.; Abbink, D. A.
Haptic shared control can improve execution of teleoperation and driving tasks. However, shared control designs may suffer from conflicts between individual human operators and constant haptic assistance when their desired trajectories differ, leading to momentarily increased forces, discomfort or
Garrett, Stephen Francis
This research paper investigates the phenomenology of touch and its relationship to my sculptural practice. My studio research has been engaged in site-responsive interventions developed as a series of ephemeral artworks. Core to this is the relationship between vision and touch. My paper charts the evolution of this and how I consider these factors when making art. My process stems from my engagement with the notion of hapticity-how we understand the tactile experience of space and place ...
Nonverbal communication is a very important part of face to face communication. Both explicit and implicit additions to verbal communication augment the information content of communication. Before telephones did not provide any means for adding nonverbal information to the communication, but now, as the technology has advanced, it is possible to start augmenting also the communication on the phone. Adding a haptic I/O device to a regular mobile phone opens possibilities to add value to commu...
Nascimento, Leonardo Penteado; Martini, Joyce; Voos, Mariana Callil; Chien, Hsin Fen; Caromano, Fátima Aparecida
ABSTRACT Objective Hand sensory tests do not consider distinct physiological receptors, nor detect normal range variations concerning developmental or pathological changes. We developed an instrument with a set of tests with timing and scoring for assessing haptic perception, which is the interaction between sensory and motor systems, in surfaces exploration, by moving hands. Method Firstly, group meetings were set for test/manual conception and materials testing. The test/manual were sub...
Full Text Available For many applications such as tele-operational robots and interactions with virtual environments, it is better to have performance with force feedback than without. Haptic devices are force reflecting interfaces. They can also track human hand positions simultaneously. A new 6 DOF (degree-of-freedom haptic device was designed and calibrated in this study. It mainly contains a double parallel linkage, a rhombus linkage, a rotating mechanical structure and a grasping interface. Benefited from the unique design, it is a hybrid structure device with a large workspace and high output capability. Therefore, it is capable of multi-finger interactions. Moreover, with an adjustable base, operators can change different postures without interrupting haptic tasks. To investigate the performance regarding position tracking accuracy and static output forces, we conducted experiments on a three-dimensional electric sliding platform and a digital force gauge, respectively. Displacement errors and force errors are calculated and analyzed. To identify the capability and potential of the device, four application examples were programmed.
Qin, Huanhuan; Song, Aiguo; Liu, Yuqing; Jiang, Guohua; Zhou, Bohe
For many applications such as tele-operational robots and interactions with virtual environments, it is better to have performance with force feedback than without. Haptic devices are force reflecting interfaces. They can also track human hand positions simultaneously. A new 6 DOF (degree-of-freedom) haptic device was designed and calibrated in this study. It mainly contains a double parallel linkage, a rhombus linkage, a rotating mechanical structure and a grasping interface. Benefited from the unique design, it is a hybrid structure device with a large workspace and high output capability. Therefore, it is capable of multi-finger interactions. Moreover, with an adjustable base, operators can change different postures without interrupting haptic tasks. To investigate the performance regarding position tracking accuracy and static output forces, we conducted experiments on a three-dimensional electric sliding platform and a digital force gauge, respectively. Displacement errors and force errors are calculated and analyzed. To identify the capability and potential of the device, four application examples were programmed. PMID:26690449
Ehrampoosh, Shervin; Dave, Mohit; Kia, Michael A; Rablau, Corneliu; Zadeh, Mehrdad H
This paper presents an enhanced haptic-enabled master-slave teleoperation system which can be used to provide force feedback to surgeons in minimally invasive surgery (MIS). One of the research goals was to develop a combined-control architecture framework that included both direct force reflection (DFR) and position-error-based (PEB) control strategies. To achieve this goal, it was essential to measure accurately the direct contact forces between deformable bodies and a robotic tool tip. To measure the forces at a surgical tool tip and enhance the performance of the teleoperation system, an optical force sensor was designed, prototyped, and added to a robot manipulator. The enhanced teleoperation architecture was formulated by developing mathematical models for the optical force sensor, the extended slave robot manipulator, and the combined-control strategy. Human factor studies were also conducted to (a) examine experimentally the performance of the enhanced teleoperation system with the optical force sensor, and (b) study human haptic perception during the identification of remote object deformability. The first experiment was carried out to discriminate deformability of objects when human subjects were in direct contact with deformable objects by means of a laparoscopic tool. The control parameters were then tuned based on the results of this experiment using a gain-scheduling method. The second experiment was conducted to study the effectiveness of the force feedback provided through the enhanced teleoperation system. The results show that the force feedback increased the ability of subjects to correctly identify materials of different deformable types. In addition, the virtual force feedback provided by the teleoperation system comes close to the real force feedback experienced in direct MIS. The experimental results provide design guidelines for choosing and validating the control architecture and the optical force sensor.
Serafin, Stefania; Turchet, Luca; Nordahl, Rolf
We describe a system which simulates in real-time the auditory and haptic sensation of walking on different surfaces. The system is based on physical models, that drive both the haptic and audio synthesizers, and a pair of shoes enhanced with sensors and actuators. In a discrimination experiment,...
van Oosterhout, J.; Abbink, D. A.; Koning, J. F.; Boessenkool, H.; Wildenbeest, J. G. W.; Heemskerk, C. J. M.
A promising solution to improve task performance in ITER hot cell remote handling is the use of haptic shared control. Haptic shared control can assist the human operator along a safe and optimal path with continuous guiding forces from an intelligent autonomous controller. Previous research tested
Volcic, Robert; Van Rheede, Joram J.; Postma, Albert; Kappers, Astrid M L
The primary purpose of this study was to examine the effects of non-informative vision and visual interference upon haptic spatial processing, which supposedly derives from an interaction between an allocentric and egocentric reference frame. To this end, a haptic parallelity task served as baseline
Minogue, James; Borland, David
While haptics (simulated touch) represents a potential breakthrough technology for science teaching and learning, there is relatively little research into its differential impact in the context of teaching and learning. This paper describes the testing of a haptically enhanced simulation (HES) for learning about buoyancy. Despite a lifetime of everyday experiences, a scientifically sound explanation of buoyancy remains difficult to construct for many. It requires the integration of domain-specific knowledge regarding density, fluid, force, gravity, mass, weight, and buoyancy. Prior studies suggest that novices often focus on only one dimension of the sinking and floating phenomenon. Our HES was designed to promote the integration of the subconcepts of density and buoyant forces and stresses the relationship between the object itself and the surrounding fluid. The study employed a randomized pretest-posttest control group research design and a suite of measures including an open-ended prompt and objective content questions to provide insights into the influence of haptic feedback on undergraduate students' thinking about buoyancy. A convenience sample (n = 40) was drawn from a university's population of undergraduate elementary education majors. Two groups were formed from haptic feedback (n = 22) and no haptic feedback (n = 18). Through content analysis, discernible differences were seen in the posttest explanations sinking and floating across treatment groups. Learners that experienced the haptic feedback made more frequent use of "haptically grounded" terms (e.g., mass, gravity, buoyant force, pushing), leading us to begin to build a local theory of language-mediated haptic cognition.
Newman, Slater E.; And Others
The paper reports on two experiments in Braille learning which compared blind and sighted subjects on the immediate recall of haptically-examined Braille symbols. In the first study, sighted subjects (N=64) haptically examined each of a set of Braille symbols with their preferred or nonpreferred hand and immediately recalled the symbol by drawing…
Choi, Seung-Hyun; Kim, Soomin; Kim, Pyunghwa; Park, Jinhyuk; Choi, Seung-Bok
In this study, we developed a novel four-degrees-of-freedom haptic master using controllable magnetorheological (MR) fluid. We also integrated the haptic master with a vision device with image processing for robot-assisted minimally invasive surgery (RMIS). The proposed master can be used in RMIS as a haptic interface to provide the surgeon with a sense of touch by using both kinetic and kinesthetic information. The slave robot, which is manipulated with a proportional-integrative-derivative controller, uses a force sensor to obtain the desired forces from tissue contact, and these desired repulsive forces are then embodied through the MR haptic master. To verify the effectiveness of the haptic master, the desired force and actual force are compared in the time domain. In addition, a visual feedback system is implemented in the RMIS experiment to distinguish between the tumor and organ more clearly and provide better visibility to the operator. The hue-saturation-value color space is adopted for the image processing since it is often more intuitive than other color spaces. The image processing and haptic feedback are realized on surgery performance. In this work, tumor-cutting experiments are conducted under four different operating conditions: haptic feedback on, haptic feedback off, image processing on, and image processing off. The experimental realization shows that the performance index, which is a function of pixels, is different in the four operating conditions.
Choi, Seung-Hyun; Kim, Soomin; Kim, Pyunghwa; Park, Jinhyuk; Choi, Seung-Bok
In this study, we developed a novel four-degrees-of-freedom haptic master using controllable magnetorheological (MR) fluid. We also integrated the haptic master with a vision device with image processing for robot-assisted minimally invasive surgery (RMIS). The proposed master can be used in RMIS as a haptic interface to provide the surgeon with a sense of touch by using both kinetic and kinesthetic information. The slave robot, which is manipulated with a proportional-integrative-derivative controller, uses a force sensor to obtain the desired forces from tissue contact, and these desired repulsive forces are then embodied through the MR haptic master. To verify the effectiveness of the haptic master, the desired force and actual force are compared in the time domain. In addition, a visual feedback system is implemented in the RMIS experiment to distinguish between the tumor and organ more clearly and provide better visibility to the operator. The hue-saturation-value color space is adopted for the image processing since it is often more intuitive than other color spaces. The image processing and haptic feedback are realized on surgery performance. In this work, tumor-cutting experiments are conducted under four different operating conditions: haptic feedback on, haptic feedback off, image processing on, and image processing off. The experimental realization shows that the performance index, which is a function of pixels, is different in the four operating conditions. (paper)
Forner-Cordero, A.; Garcia, V.D.; Rodrigues, S.T.; Duysens, J.
Little is known about the ability of blind people to cross obstacles after they have explored haptically their size and position. Long-term absence of vision may affect spatial cognition in the blind while their extensive experience with the use of haptic information for guidance may lead to
Neimeijer, Renate A.M.; Roefs, Anne; de Jong, Peter J.
The present study was designed to test the hypothesis that anorexia nervosa (AN) patients are relatively insensitive to the attentional capture of visual food stimuli. Attentional avoidance of food might help AN patients to prevent more elaborate processing of food stimuli and the subsequent
Huang, Yang-Ming; Baddeley, Alan; Young, Andrew W.
The attentional blink paradigm was used to examine whether emotional stimuli always capture attention. The processing requirement for emotional stimuli in a rapid sequential visual presentation stream was manipulated to investigate the circumstances under which emotional distractors capture attention, as reflected in an enhanced attentional blink…
Liu, Xiaolin; Yang, Ying; Urban, Marek W
There is increasing evidence that stimuli-responsive nanomaterials have become significantly critical components of modern materials design and technological developments. Recent advances in synthesis and fabrication of stimuli-responsive polymeric nanoparticles with built-in stimuli-responsive components (Part A) and surface modifications of functional nanoparticles that facilitate responsiveness (Part B) are outlined here. The synthesis and construction of stimuli-responsive spherical, core-shell, concentric, hollow, Janus, gibbous/inverse gibbous, and cocklebur morphologies are discussed in Part A, with the focus on shape, color, or size changes resulting from external stimuli. Although inorganic/metallic nanoparticles exhibit many useful properties, including thermal or electrical conductivity, catalytic activity, or magnetic properties, their assemblies and formation of higher order constructs are often enhanced by surface modifications. Section B focuses on selected surface reactions that lead to responsiveness achieved by decorating nanoparticles with stimuli-responsive polymers. Although grafting-to and grafting-from dominate these synthetic efforts, there are opportunities for developing novel synthetic approaches facilitating controllable recognition, signaling, or sequential responses. Many nanotechnologies utilize a combination of organic and inorganic phases to produce ceramic or metallic nanoparticles. One can envision the development of new properties by combining inorganic (metals, metal oxides) and organic (polymer) phases into one nanoparticle designated as "ceramers" (inorganics) and "metamers" (metallic). © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.
Full Text Available In this work we show that haptic feedback in upper limb motor therapy improves performance and generates a lower mental workload. To demonstrate this, two groups of participants (healthy adults and elders with hand motor problems used a low-cost haptic device (Novint Falcon and a non-robotic device (Leap Motion Controller. Participants conducted the same rehabilitation task by using a non-immersive virtual environment. Results show significant differences for all participants regarding precision on the use of the haptic feedback device. Additionally, participants in the older adult group demonstrated a lower mental workload while using the haptic device (Novint Falcon. Finally, qualitative results show that participants preferred to conduct their therapy exercises by using the haptic device, as they found it more useful, easier to use and easier to learn
Yun, Gyu-young; Kim, Sang-Youn; Jang, Sang-Dong; Kim, Dong-Gu; Kim, Jaehwan
Haptic is one of well-considered device which is suitable for demanding virtual reality applications such as medical equipment, mobile devices, the online marketing and so on. Nowadays, many of concepts for haptic devices have been suggested to meet the demand of industries. Cellulose has received much attention as an emerging smart material, named as electro-active paper (EAPap). The EAPap is attractive for mobile haptic devices due to its unique characteristics in terms of low actuation power, suitability for thin devices and transparency. In this paper, we suggest a new concept of haptic actuator with the use of cellulose EAPap. Its performance is evaluated depending on various actuation conditions. As a result, cellulose electrostatic force actuator shows a large output displacement and fast response, which is suitable for mobile haptic devices.
Ansuja Pulickal Mathew
Full Text Available The physiological condition of the human body is a composite of different environments, each with its own parameters that may differ under normal, as well as diseased conditions. These environmental conditions include factors, such as pH, temperature and enzymes that are specific to a type of cell, tissue or organ or a pathological state, such as inflammation, cancer or infection. These conditions can act as specific triggers or stimuli for the efficient release of therapeutics at their destination by overcoming many physiological and biological barriers. The efficacy of conventional treatment modalities can be enhanced, side effects decreased and patient compliance improved by using stimuli-responsive material that respond to these triggers at the target site. These stimuli or triggers can be physical, chemical or biological and can be internal or external in nature. Many smart/intelligent stimuli-responsive therapeutic gene carriers have been developed that can respond to either internal stimuli, which may be normally present, overexpressed or present in decreased levels, owing to a disease, or to stimuli that are applied externally, such as magnetic fields. This review focuses on the effects of various internal stimuli, such as temperature, pH, redox potential, enzymes, osmotic activity and other biomolecules that are present in the body, on modulating gene expression by using stimuli-regulated smart polymeric carriers.
Rajanna, Vijay; Vo, Patrick; Barth, Jerry; Mjelde, Matthew; Grey, Trevor; Oduola, Cassandra; Hammond, Tracy
A carefully planned, structured, and supervised physiotherapy program, following a surgery, is crucial for the successful diagnosis of physical injuries. Nearly 50 % of the surgeries fail due to unsupervised, and erroneous physiotherapy. The demand for a physiotherapist for an extended period is expensive to afford, and sometimes inaccessible. Researchers have tried to leverage the advancements in wearable sensors and motion tracking by building affordable, automated, physio-therapeutic systems that direct a physiotherapy session by providing audio-visual feedback on patient's performance. There are many aspects of automated physiotherapy program which are yet to be addressed by the existing systems: a wide classification of patients' physiological conditions to be diagnosed, multiple demographics of the patients (blind, deaf, etc.), and the need to pursue patients to adopt the system for an extended period for self-care. In our research, we have tried to address these aspects by building a health behavior change support system called KinoHaptics, for post-surgery rehabilitation. KinoHaptics is an automated, wearable, haptic assisted, physio-therapeutic system that can be used by a wide variety of demographics and for various physiological conditions of the patients. The system provides rich and accurate vibro-haptic feedback that can be felt by the user, irrespective of the physiological limitations. KinoHaptics is built to ensure that no injuries are induced during the rehabilitation period. The persuasive nature of the system allows for personal goal-setting, progress tracking, and most importantly life-style compatibility. The system was evaluated under laboratory conditions, involving 14 users. Results show that KinoHaptics is highly convenient to use, and the vibro-haptic feedback is intuitive, accurate, and has shown to prevent accidental injuries. Also, results show that KinoHaptics is persuasive in nature as it supports behavior change and habit building
Voon, V.; Brezing, C.; Gallea, C.; Ameli, R.; Roelofs, K.; LaFrance, W.C.; Hallett, M.
Conversion disorder is characterized by neurological signs and symptoms related to an underlying psychological issue. Amygdala activity to affective stimuli is well characterized in healthy volunteers with greater amygdala activity to both negative and positive stimuli relative to neutral stimuli,
Nardelli, Mimma; Greco, Alberto; Bianchi, Matteo; Scilingo, Enzo Pasquale; Valenza, Gaetano
The hedonic attributes of cutaneous elicitation play a crucial role in everyday life, influencing our behavior and psychophysical state. However, the correlation between such a hedonic aspect of touch and the Autonomic Nervous System (ANS)-related physiological response, which is intimately connected to emotions, still needs to be deeply investigated. This study reports on caress-like stimuli conveyed to the forearm of 32 healthy subjects through different fabrics actuated by a haptic device, which can control both the strength (i.e. the normal force exerted by the fabric) and the velocity of the elicitation. The mimicked caresses were elicited with a fixed force of 6 N, two levels of velocity of 9.4 mm/sec and 65 mm/sec, and four different fabrics with different textures: burlap, hemp, velvet and silk. Participants were asked to score the caress-like stimuli in terms of arousal and valence through a self-assessment questionnaire. Heartbeat data related to the perceived most pleasant (silk) and unpleasant (burlap) fabrics were used as an input to an automatic pattern recognition procedure. Accordingly, considering gender differences, support vector machines using features extracted from linear and nonlinear heartbeat dynamics showed a recognition accuracy of 84.38% (men) and 78.13% (women) while discerning between burlap and silk elicitations at the higher velocity. Results suggest that the fabrics used for the caress-like stimulation significantly affect the nonlinear cardiovascular dynamics, also showing differences according to gender.
Gomez-Rodriguez, M.; Peters, J.; Hill, J.; Schölkopf, B.; Gharabaghi, A.; Grosse-Wentrup, M.
The combination of brain-computer interfaces (BCIs) with robot-assisted physical therapy constitutes a promising approach to neurorehabilitation of patients with severe hemiparetic syndromes caused by cerebrovascular brain damage (e.g. stroke) and other neurological conditions. In such a scenario, a key aspect is how to reestablish the disrupted sensorimotor feedback loop. However, to date it is an open question how artificially closing the sensorimotor feedback loop influences the decoding performance of a BCI. In this paper, we answer this issue by studying six healthy subjects and two stroke patients. We present empirical evidence that haptic feedback, provided by a seven degrees of freedom robotic arm, facilitates online decoding of arm movement intention. The results support the feasibility of future rehabilitative treatments based on the combination of robot-assisted physical therapy with BCIs.
Tanaka, Mami; Lévêque, Jean Luc; Tagami, Hachiro; Kikuchi, Katsuko; Chonan, Seifi
Touching the skin is of great importance for the Clinician for assessing roughness, softness, firmness, etc. This type of clinical assessment is very subjective and therefore non-reproducible from one Clinician to another one or even from time to time for the same Clinician. In order to objectively monitor skin texture, we developed a new sensor, placed directly on the Clinician's finger, which generate some electric signal when slid over the skin surface. The base of this Haptic Finger sensor is a thin stainless steel plate on which sponge rubber, PVDF foil, acetate film and gauze are layered. The signal generated by the sensor was filtered and digitally stored before processing. In a first in vitro experiment, the sensor was moved over different skin models (sponge rubber covered by silicon rubber) of varying hardness and roughness. These experiments allowed the definition of two parameters characterizing textures. The first parameter is variance of the signal processed using wavelet analysis, representing an index of roughness. The second parameter is dispersion of the power spectrum density in the frequency domain, corresponding to hardness. To validate these parameters, the Haptic Finger was used to scan skin surfaces of 30 people, 14 of whom displayed a skin disorder: xerosis (n = 5), atopic dermatitis (n = 7), and psoriasis (n = 2). The results obtained by means of the sensor were compared with subjective, clinical evaluations by a Clinician who scored both roughness and hardness of the skin. Good agreement was observed between clinical assessment of the skin and the two parameters generated using the Haptic Finger. Use of this sensor could prove extremely valuable in cosmetic research where skin surface texture (in terms of tactile properties) is difficult to measure.
Full Text Available The haptic perception of the curvature of an object is essential for adequate object manipulation and critical for our guidance of actions. This study investigated how the ability to perceive the curvature of an object is altered by Parkinson's disease (PD.Eight healthy subjects and 11 patients with mild to moderate PD had to judge, without vision, the curvature of a virtual "box" created by a robotic manipulandum. Their hands were either moved passively along a defined curved path or they actively explored the curved curvature of a virtual wall. The curvature was either concave or convex (bulging to the left or right and was judged in two locations of the hand workspace--a left workspace location, where the curved hand path was associated with curved shoulder and elbow joint paths, and a right workspace location in which these joint paths were nearly linear. After exploring the curvature of the virtual object, subjects had to judge whether the curvature was concave or convex. Based on these data, thresholds for curvature sensitivity were established. The main findings of the study are: First, 9 out 11 PD patients (82% showed elevated thresholds for detecting convex curvatures in at least one test condition. The respective median threshold for the PD group was increased by 343% when compared to the control group. Second, when distal hand paths became less associated with proximal joint paths (right workspace, haptic acuity was reduced substantially in both groups. Third, sensitivity to hand trajectory curvature was not improved during active exploration in either group.Our data demonstrate that PD is associated with a decreased acuity of the haptic sense, which may occur already at an early stage of the disease.
David Parisi offers the first full history of new computing technologies known as haptic interfaces--which use electricity, vibration, and force feedback to stimulate the sense of touch--showing how the efforts of scientists and engineers over the past 300 years have gradually remade and redefined our sense of touch. Archaeologies of Touch offers a timely and provocative engagement with the long history of touch technology that helps us confront and question the power relations underpinning the project of giving touch its own set of technical media.
Inoue, Kazuya; Sato, Nobuya
Attentional inhibition that occurs during discrimination tasks leads to the negative evaluation of distractor stimuli. This phenomenon, known as the distractor devaluation effect also occurs when go/no-go tasks require response inhibition. However, it remains unclear whether there are interactions between attention and response controls when the distractor devaluation effect occurs. The aims of this study were to investigate whether attention to stimuli in the go/no-go task plays a facilitative role in distractor devaluation through response inhibition, and to clarify whether this effect reflects a decreased preference for no-go stimuli. Participants evaluated the preference for pictures before and after a go/no-go task. In Experiments 1 and 2, they made a go or no-go response depending on the category of pictures displayed (gummy candies or rice crackers), whereas in Experiment 3 they did on the basis digit category, even or odd numbers, superimposed on such pictures. Experiments 1 and 2 demonstrated that the pictures presented as no-go stimuli in the preceding go/no-go task were evaluated as less positive than the pictures presented as go stimuli. This devaluation effect reflected an increased preference for the go stimuli but not a decreased preference for the no-go stimuli. Experiment 3 indicated that response inhibition did not affect the preference for the pictures that had not received attention in a preceding go/no-go task. These results suggest that although attention plays an important role in differential ratings for go and no-go stimuli, such differences, in fact, reflect the valuation of go stimuli.
Sennwald, Vanessa; Pool, Eva; Brosch, Tobias; Delplanque, Sylvain; Bianchi-Demicheli, Francesco; Sander, David
It has long been posited that among emotional stimuli, only negative threatening information modulates early shifts of attention. However, in the last few decades there has been an increase in research showing that attention is also involuntarily oriented toward positive rewarding stimuli such as babies, food, and erotic information. Because reproduction-related stimuli have some of the largest effects among positive stimuli on emotional attention, the present work reviews recent literature and proposes that the cognitive and cerebral mechanisms underlying the involuntarily attentional orientation toward threat-related information are also sensitive to erotic information. More specifically, the recent research suggests that both types of information involuntarily orient attention due to their concern relevance and that the amygdala plays an important role in detecting concern-relevant stimuli, thereby enhancing perceptual processing and influencing emotional attentional processes. © 2015 Wiley Periodicals, Inc.
The present study focused on gender differences in emotion identification from auditory and visual stimuli produced by two male and two female actors. Differences in emotion identification from nonsense samples, language samples and prolonged vowels were investigated. It was also studied whether auditory stimuli can convey the emotional content of speech without visual stimuli, and whether visual stimuli can convey the emotional content of speech without auditory stimuli. The aim was to get a better knowledge of vocal attributes and a more holistic understanding of the nonverbal communication of emotion. Females tended to be more accurate in emotion identification than males. Voice quality parameters played a role in emotion identification in both genders. The emotional content of the samples was best conveyed by nonsense sentences, better than by prolonged vowels or shared native language of the speakers and participants. Thus, vocal non-verbal communication tends to affect the interpretation of emotion even in the absence of language. The emotional stimuli were better recognized from visual stimuli than auditory stimuli by both genders. Visual information about speech may not be connected to the language; instead, it may be based on the human ability to understand the kinetic movements in speech production more readily than the characteristics of the acoustic cues.
Kim, Young-Suk Grace
Purpose: The primary aim of the present study was to examine whether different ways of presenting narrative stimuli (i.e., live narrative stimuli versus audio-recorded narrative stimuli) influence children's performances on narrative comprehension and oral-retell quality. Method: Children in kindergarten (n = 54), second grade (n = 74), and fourth…
Full Text Available Maintaining equilibrium is basically a sensorimotor integration task. The central nervous system continually and selectively weights and rapidly integrates sensory inputs from multiple sources, and coordinates multiple outputs. The weighting process is based on the availability and accuracy of afferent signals at a given instant, on the time-period required to process each input, and possibly on the plasticity of the relevant pathways. The likelihood that sensory inflow changes while balancing under static or dynamic conditions is high, because subjects can pass from a dark to a well-lit environment or from a tactile-guided stabilization to loss of haptic inflow. This review article presents recent data on the temporal events accompanying sensory transition, on which basic information is fragmentary. The processing time from sensory shift to reaching a new steady state includes the time to (a subtract or integrate sensory inputs, (b move from allocentric to egocentric reference or vice versa, and (c adjust the calibration of motor activity in time and amplitude to the new sensory set. We present examples of processes of integration of posture-stabilizing information, and of the respective sensorimotor time-intervals while allowing or occluding vision or adding or subtracting tactile information. These intervals are short, in the order of 1-2 s for different postural conditions, modalities and deliberate or passive shift. They are just longer for haptic than visual shift, just shorter on withdrawal than on addition of stabilizing input, and on deliberate than unexpected mode. The delays are the shortest (for haptic shift in blind subjects. Since automatic balance stabilization may be vulnerable to sensory-integration delays and to interference from concurrent cognitive tasks in patients with sensorimotor problems, insight into the processing time for balance control represents a critical step in the design of new balance- and locomotion training
Honeine, Jean-Louis; Schieppati, Marco
Maintaining equilibrium is basically a sensorimotor integration task. The central nervous system (CNS) continually and selectively weights and rapidly integrates sensory inputs from multiple sources, and coordinates multiple outputs. The weighting process is based on the availability and accuracy of afferent signals at a given instant, on the time-period required to process each input, and possibly on the plasticity of the relevant pathways. The likelihood that sensory inflow changes while balancing under static or dynamic conditions is high, because subjects can pass from a dark to a well-lit environment or from a tactile-guided stabilization to loss of haptic inflow. This review article presents recent data on the temporal events accompanying sensory transition, on which basic information is fragmentary. The processing time from sensory shift to reaching a new steady state includes the time to (a) subtract or integrate sensory inputs; (b) move from allocentric to egocentric reference or vice versa; and (c) adjust the calibration of motor activity in time and amplitude to the new sensory set. We present examples of processes of integration of posture-stabilizing information, and of the respective sensorimotor time-intervals while allowing or occluding vision or adding or subtracting tactile information. These intervals are short, in the order of 1–2 s for different postural conditions, modalities and deliberate or passive shift. They are just longer for haptic than visual shift, just shorter on withdrawal than on addition of stabilizing input, and on deliberate than unexpected mode. The delays are the shortest (for haptic shift) in blind subjects. Since automatic balance stabilization may be vulnerable to sensory-integration delays and to interference from concurrent cognitive tasks in patients with sensorimotor problems, insight into the processing time for balance control represents a critical step in the design of new balance- and locomotion training devices
Background Although common during the early stages of recovery from severe traumatic brain injury (TBI), attention deficits have been scarcely investigated. Encouraging evidence suggests beneficial effects of attention training in more chronic and higher functioning patients. Interactive technology may provide new opportunities for rehabilitation in inpatients who are earlier in their recovery. Methods We designed a “virtually minimal” approach using robot-rendered haptics in a virtual environment to train severely injured inpatients in the early stages of recovery to sustain attention to a visuo-motor task. 21 inpatients with severe TBI completed repetitive reaching toward targets that were both seen and felt. Patients were tested over two consecutive days, experiencing 3 conditions (no haptic feedback, a break-through force, and haptic nudge) in 12 successive, 4-minute blocks. Results The interactive visuo-haptic environments were well-tolerated and engaging. Patients typically remained attentive to the task. However, patients exhibited attention loss both before (prolonged initiation) and during (pauses during motion) a movement. Compared to no haptic feedback, patients benefited from haptic nudge cues but not break-through forces. As training progressed, patients increased the number of targets acquired and spontaneously improved from one day to the next. Conclusions Interactive visuo-haptic environments could be beneficial for attention training for severe TBI patients in the early stages of recovery and warrants further and more prolonged clinical testing. PMID:23938101
Katsura, Seiichiro; Irie, Kouhei; Ohishi, Kiyoshi
Artificial acquisition and reproduction of human sensations are basic technologies of communication engineering. For example, auditory information is obtained by a microphone, and a speaker reproduces it by artificial means. Furthermore, a video camera and a television make it possible to transmit visual sensation by broadcasting. On the contrary, since tactile or haptic information is subject to the Newton's “law of action and reaction” in the real world, a device which acquires, transmits, and reproduces the information has not been established. From the point of view, real-world haptics is the key technology for future haptic communication engineering. This paper proposes a novel acquisition method of haptic information named “haptograph”. The haptograph visualizes the haptic information like photograph. The proposed haptograph is applied to haptic recognition of the contact environment. A linear motor contacts to the surface of the environment and its reaction force is used to make a haptograph. A robust contact motion and sensor-less sensing of the reaction force are attained by using a disturbance observer. As a result, an encyclopedia of contact environment is attained. Since temporal and spatial analyses are conducted to represent haptic information as the haptograph, it is possible to be recognized and to be evaluated intuitively.
Cosco, Francesco; Garre, Carlos; Bruno, Fabio; Muzzupappa, Maurizio; Otaduy, Miguel A
Visuo-haptic mixed reality consists of adding to a real scene the ability to see and touch virtual objects. It requires the use of see-through display technology for visually mixing real and virtual objects, and haptic devices for adding haptic interaction with the virtual objects. Unfortunately, the use of commodity haptic devices poses obstruction and misalignment issues that complicate the correct integration of a virtual tool and the user's real hand in the mixed reality scene. In this work, we propose a novel mixed reality paradigm where it is possible to touch and see virtual objects in combination with a real scene, using commodity haptic devices, and with a visually consistent integration of the user's hand and the virtual tool. We discuss the visual obstruction and misalignment issues introduced by commodity haptic devices, and then propose a solution that relies on four simple technical steps: color-based segmentation of the hand, tracking-based segmentation of the haptic device, background repainting using image-based models, and misalignment-free compositing of the user's hand. We have developed a successful proof-of-concept implementation, where a user can touch virtual objects and interact with them in the context of a real scene, and we have evaluated the impact on user performance of obstruction and misalignment correction.
Zenner, Andre; Kruger, Antonio
We define the concept of Dynamic Passive Haptic Feedback (DPHF) for virtual reality by introducing the weight-shifting physical DPHF proxy object Shifty. This concept combines actuators known from active haptics and physical proxies known from passive haptics to construct proxies that automatically adapt their passive haptic feedback. We describe the concept behind our ungrounded weight-shifting DPHF proxy Shifty and the implementation of our prototype. We then investigate how Shifty can, by automatically changing its internal weight distribution, enhance the user's perception of virtual objects interacted with in two experiments. In a first experiment, we show that Shifty can enhance the perception of virtual objects changing in shape, especially in length and thickness. Here, Shifty was shown to increase the user's fun and perceived realism significantly, compared to an equivalent passive haptic proxy. In a second experiment, Shifty is used to pick up virtual objects of different virtual weights. The results show that Shifty enhances the perception of weight and thus the perceived realism by adapting its kinesthetic feedback to the picked-up virtual object. In the same experiment, we additionally show that specific combinations of haptic, visual and auditory feedback during the pick-up interaction help to compensate for visual-haptic mismatch perceived during the shifting process.
Dvorkin, Assaf Y; Ramaiya, Milan; Larson, Eric B; Zollman, Felise S; Hsu, Nancy; Pacini, Sonia; Shah, Amit; Patton, James L
Although common during the early stages of recovery from severe traumatic brain injury (TBI), attention deficits have been scarcely investigated. Encouraging evidence suggests beneficial effects of attention training in more chronic and higher functioning patients. Interactive technology may provide new opportunities for rehabilitation in inpatients who are earlier in their recovery. We designed a "virtually minimal" approach using robot-rendered haptics in a virtual environment to train severely injured inpatients in the early stages of recovery to sustain attention to a visuo-motor task. 21 inpatients with severe TBI completed repetitive reaching toward targets that were both seen and felt. Patients were tested over two consecutive days, experiencing 3 conditions (no haptic feedback, a break-through force, and haptic nudge) in 12 successive, 4-minute blocks. The interactive visuo-haptic environments were well-tolerated and engaging. Patients typically remained attentive to the task. However, patients exhibited attention loss both before (prolonged initiation) and during (pauses during motion) a movement. Compared to no haptic feedback, patients benefited from haptic nudge cues but not break-through forces. As training progressed, patients increased the number of targets acquired and spontaneously improved from one day to the next. Interactive visuo-haptic environments could be beneficial for attention training for severe TBI patients in the early stages of recovery and warrants further and more prolonged clinical testing.
Sterr, Annette; Green, Lisa; Elbert, Thomas
In a previous experiment, we observed that blind Braille readers produce errors when asked to identify on which finger of one hand a light tactile stimulus had occurred. With the present study, we aimed to specify the characteristics of this perceptual error in blind and sighted participants. The experiment confirmed that blind Braille readers mislocalised tactile stimuli more often than sighted controls, and that the localisation errors occurred significantly more often at the right reading hand than at the non-reading hand. Most importantly, we discovered that the reading fingers showed the smallest error frequency, but the highest rate of stimulus attribution. The dissociation of perceiving and locating tactile stimuli in the blind suggests altered tactile information processing. Neuroplasticity, changes in tactile attention mechanisms as well as the idea that blind persons may employ different strategies for tactile exploration and object localisation are discussed as possible explanations for the results obtained.
Watanuki, Shigeki; Kim, Yeon-Kyu
The specific physiological responses induced by pleasant stimuli were investigated in this study. Various physiological responses of the brain (encephaloelectrogram; EEG), autonomic nervous system (ANS), immune system and endocrine system were monitored when pleasant stimuli such as odors, emotional pictures and rakugo, a typical Japanese comical story-telling, were presented to subjects. The results revealed that (i) EEG activities of the left frontal brain region were enhanced by a pleasant odor; (ii) emotional pictures related to primitive element such as nudes and erotic couples elevated vasomotor sympathetic nervous activity; and (iii) an increase in secretory immunoglobulin A (s-IgA) and a decrease in salivary cortisol (s-cortisol) were induced by rakugo-derived linguistic pleasant emotion. Pleasant emotion is complicated state. However, by considering the evolutionary history of human being, it is possible to assess and evaluate pleasant emotion from certain physiological responses by appropriately summating various physiological parameters.
Full Text Available The structure and material properties of polymer networks can depend sensitively on changes in the environment. There is a great deal of progress in the development of stimuli-responsive hydrogels for applications like sensors, self-repairing materials or actuators. Biocompatible, smart hydrogels can be used for applications, such as controlled drug delivery and release, or for artificial muscles. Numerical studies have been performed on different length scales and levels of details. Macroscopic theories that describe the network systems with the help of continuous fields are suited to study effects like the stimuli-induced deformation of hydrogels on large scales. In this article, we discuss various macroscopic approaches and describe, in more detail, our phase field model, which allows the calculation of the hydrogel dynamics with the help of a free energy that considers physical and chemical impacts. On a mesoscopic level, polymer systems can be modeled with the help of the self-consistent field theory, which includes the interactions, connectivity, and the entropy of the polymer chains, and does not depend on constitutive equations. We present our recent extension of the method that allows the study of the formation of nano domains in reversibly crosslinked block copolymer networks. Molecular simulations of polymer networks allow the investigation of the behavior of specific systems on a microscopic scale. As an example for microscopic modeling of stimuli sensitive polymer networks, we present our Monte Carlo simulations of a filament network system with crosslinkers.
Chami, George; Ward, James W; Phillips, Roger; Sherman, Kevin P
The outcome of arthroscopic procedures is related to the surgeon's skills in arthroscopy. Currently, evaluation of such skills relies on direct observation by a surgeon trainer. This type of assessment, by its nature, is subjective and time-consuming. The aim of our study was to identify whether haptic information generated from arthroscopic tools could distinguish between skilled and less skilled surgeons. A standard arthroscopic probe was fitted with a force/torque sensor. The probe was used by five surgeons with different levels of experience in knee arthroscopy performing 11 different tasks in 10 standard knee arthroscopies. The force/torque data from the hand and tool interface were recorded and synchronized with a video recording of the procedure. The torque magnitude and patterns generated were analyzed and compared. A computerized system was used to analyze the force/torque signature based on general principles for quality of performance using such measures as economy in movement, time efficiency, and consistency in performance. The results showed a considerable correlation between three haptic parameters and the surgeon's experience, which could be used in an automated objective assessment system for arthroscopic surgery. Level II, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.
Moix, Thomas; Ilic, Dejan; Fracheboud, Blaise; Zoethout, Jurjen; Bleuler, Hannes
Interventional Radiology (IR) is a minimally-invasive surgery technique (MIS) where guidewires and catheters are steered in the vascular system under X-ray imaging. In order to perform these procedures, a radiologist has to be correctly trained to master hand-eye coordination, instrument manipulation and procedure protocols. This paper proposes a computer-assisted training environment dedicated to IR. The system is composed of a virtual reality (VR) simulation of the anatomy of the patient linked to a robotic interface providing haptic force feedback.The paper focuses on the requirements, design and prototyping of a specific part of the haptic interface dedicated to catheters. Translational tracking and force feedback on the catheter is provided by two cylinders forming a friction drive arrangement. The whole friction can be set in rotation with an additional motor providing torque feedback. A force and a torque sensor are integrated in the cylinders for direct measurement on the catheter enabling disturbance cancellation with a close-loop force control strategy.
Andualem Tadesse Maereg
Full Text Available In this paper, we discuss the development of cost effective, wireless, and wearable vibrotactile haptic device for stiffness perception during an interaction with virtual objects. Our experimental setup consists of haptic device with five vibrotactile actuators, virtual reality environment tailored in Unity 3D integrating the Oculus Rift Head Mounted Display (HMD and the Leap Motion controller. The virtual environment is able to capture touch inputs from users. Interaction forces are then rendered at 500 Hz and fed back to the wearable setup stimulating fingertips with ERM vibrotactile actuators. Amplitude and frequency of vibrations are modulated proportionally to the interaction force to simulate the stiffness of a virtual object. A quantitative and qualitative study is done to compare the discrimination of stiffness on virtual linear spring in three sensory modalities: visual only feedback, tactile only feedback, and their combination. A common psychophysics method called the Two Alternative Forced Choice (2AFC approach is used for quantitative analysis using Just Noticeable Difference (JND and Weber Fractions (WF. According to the psychometric experiment result, average Weber fraction values of 0.39 for visual only feedback was improved to 0.25 by adding the tactile feedback.
Munoz Bonilla, Sandra; Herk, van A.M.; Heuts, J.P.A.
The use of living block copolymers as stabilisers in emulsion polymerisation allowed preparation of multilayer functional hairy particles via surface-initiated ATRP. Polymer films prepared from the obtained particles present antifouling properties along with stimuli-responsive behaviour.
[Abstract] This paper is described about an assignment of haptic interface. We have made a proposal for a music baton system for visually disabled persons. The system is constituted by an acceleration sensor, a radio module, and a haptic interface device. We have carried out an experiment of comparing the visual and the haptic interface. The assignments are declared by the results that are rise-time of a motor and pre-motion. In the paper, we make a proposal for new method of the voltage cont...
[Abstract] We have made a proposal for a music baton system for visual disabled persons. The system is constituted by an acceleration sensor, a radio module, and a haptic interface device. When a conductor moves the baton, Players are able to acknowledge the action using the haptic interface device. We have carried out an experiment of comparing the visual and the haptic interface. The result declared that a pre-motion is important for the visual interface. In the paper, we make a proposal fo...
Once the domain of purely physical controls such as knobs, : levers, buttons, and sliders, the vehicle dash is rapidly : transforming into a computer interface. This presents a : challenge for drivers, because the physics-based cues which : make trad...
Alexandra L. Borstad
Full Text Available Frontoparietal white matter supports information transfer between brain areas involved in complex haptic tasks such as somatosensory discrimination. The purpose of this study was to gain an understanding of the relationship between microstructural integrity of frontoparietal network white matter and haptic performance in persons with chronic stroke and to compare frontoparietal network integrity in participants with stroke and age matched control participants. Nineteen individuals with stroke and 16 controls participated. Haptic performance was quantified using the Hand Active Sensation Test (HASTe, an 18-item match-to-sample test of weight and texture discrimination. Three tesla MRI was used to obtain diffusion-weighted and high-resolution anatomical images of the whole brain. Probabilistic tractography was used to define 10 frontoparietal tracts total; Four intrahemispheric tracts measured bilaterally 1 thalamus to primary somatosensory cortex (T–S1, 2 thalamus to primary motor cortex (T–M1, 3 primary to secondary somatosensory cortex (S1 to SII and 4 primary somatosensory cortex to middle frontal gyrus (S1 to MFG and, 2 interhemispheric tracts; S1–S1 and precuneus interhemispheric. A control tract outside the network, the cuneus interhemispheric tract, was also examined. The diffusion metrics fractional anisotropy (FA, mean diffusivity (MD, axial (AD and radial diffusivity (RD were quantified for each tract. Diminished FA and elevated MD values are associated with poorer white matter integrity in chronic stroke. Nine of 10 tracts quantified in the frontoparietal network had diminished structural integrity poststroke compared to the controls. The precuneus interhemispheric tract was not significantly different between groups. Principle component analysis across all frontoparietal white matter tract MD values indicated a single factor explained 47% and 57% of the variance in tract mean diffusivity in stroke and control groups respectively
Borstad, Alexandra L; Choi, Seongjin; Schmalbrock, Petra; Nichols-Larsen, Deborah S
Frontoparietal white matter supports information transfer between brain areas involved in complex haptic tasks such as somatosensory discrimination. The purpose of this study was to gain an understanding of the relationship between microstructural integrity of frontoparietal network white matter and haptic performance in persons with chronic stroke and to compare frontoparietal network integrity in participants with stroke and age matched control participants. Nineteen individuals with stroke and 16 controls participated. Haptic performance was quantified using the Hand Active Sensation Test (HASTe), an 18-item match-to-sample test of weight and texture discrimination. Three tesla MRI was used to obtain diffusion-weighted and high-resolution anatomical images of the whole brain. Probabilistic tractography was used to define 10 frontoparietal tracts total; Four intrahemispheric tracts measured bilaterally 1) thalamus to primary somatosensory cortex (T-S1), 2) thalamus to primary motor cortex (T-M1), 3) primary to secondary somatosensory cortex (S1 to SII) and 4) primary somatosensory cortex to middle frontal gyrus (S1 to MFG) and, 2 interhemispheric tracts; S1-S1 and precuneus interhemispheric. A control tract outside the network, the cuneus interhemispheric tract, was also examined. The diffusion metrics fractional anisotropy (FA), mean diffusivity (MD), axial (AD) and radial diffusivity (RD) were quantified for each tract. Diminished FA and elevated MD values are associated with poorer white matter integrity in chronic stroke. Nine of 10 tracts quantified in the frontoparietal network had diminished structural integrity poststroke compared to the controls. The precuneus interhemispheric tract was not significantly different between groups. Principle component analysis across all frontoparietal white matter tract MD values indicated a single factor explained 47% and 57% of the variance in tract mean diffusivity in stroke and control groups respectively. Age
Sandra dePedro; Xavier Munoz-Berbel; Rosalia Rodríguez-Rodríguez; Jordi Sort; Jose Antonio Plaza; Juergen Brugger; Andreu Llobera; Victor J Cadarso
Stimuli-responsive materials undergo physicochemical and/or structural changes when a specific actuation is applied. They are heterogeneous composites, consisting of a non-responsive matrix where functionality is provided by the filler. Surprisingly, the synthesis of polydimethylsiloxane (PDMS)-based stimuli-responsive elastomers (SRE) has seldomly been presented. Here, we present the structural, biological, optical, magnetic, and mechanical properties of several magnetic SRE (M-SRE) obtained...
de Ruiter, M.B.; Kok, A.; van der Schoot, M.
Event-related potentials (ERPs) were recorded to trains of rapidly presented auditory and visual stimuli. ERPs in conditions in which Ss attended to different features of visual stimuli were compared with ERPs to the same type of stimuli when Ss attended to different features of auditory stimuli,
Schomaker, J; Meeter, M
Novel stimuli reliably attract attention, suggesting that novelty may disrupt performance when it is task-irrelevant. However, under certain circumstances novel stimuli can also elicit a general alerting response having beneficial effects on performance. In a series of experiments we investigated whether different aspects of novelty--stimulus novelty, contextual novelty, surprise, deviance, and relative complexity--lead to distraction or facilitation. We used a version of the visual oddball paradigm in which participants responded to an occasional auditory target. Participants responded faster to this auditory target when it occurred during the presentation of novel visual stimuli than of standard stimuli, especially at SOAs of 0 and 200 ms (Experiment 1). Facilitation was absent for both infrequent simple deviants and frequent complex images (Experiment 2). However, repeated complex deviant images did facilitate responses to the auditory target at the 200 ms SOA (Experiment 3). These findings suggest that task-irrelevant deviant visual stimuli can facilitate responses to an unrelated auditory target in a short 0-200 millisecond time-window after presentation. This only occurs when the deviant stimuli are complex relative to standard stimuli. We link our findings to the novelty P3, which is generated under the same circumstances, and to the adaptive gain theory of the locus coeruleus-norepinephrine system (Aston-Jones and Cohen, 2005), which may explain the timing of the effects. Copyright © 2014 Elsevier B.V. All rights reserved.
Marangon, Mattia; Kubiak, Agnieszka; Króliczak, Gregory
The neural bases of haptically-guided grasp planning and execution are largely unknown, especially for stimuli having no visual representations. Therefore, we used functional magnetic resonance imaging (fMRI) to monitor brain activity during haptic exploration of novel 3D complex objects, subsequent grasp planning, and the execution of the pre-planned grasps. Haptic object exploration, involving extraction of shape, orientation, and length of the to-be-grasped targets, was associated with the fronto-parietal, temporo-occipital, and insular cortex activity. Yet, only the anterior divisions of the posterior parietal cortex (PPC) of the right hemisphere were significantly more engaged in exploration of complex objects (vs. simple control disks). None of these regions were re-recruited during the planning phase. Even more surprisingly, the left-hemisphere intraparietal, temporal, and occipital areas that were significantly invoked for grasp planning did not show sensitivity to object features. Finally, grasp execution, involving the re-recruitment of the critical right-hemisphere PPC clusters, was also significantly associated with two kinds of bilateral parieto-frontal processes. The first represents transformations of grasp-relevant target features and is linked to the dorso-dorsal (lateral and medial) parieto-frontal networks. The second monitors grasp kinematics and belongs to the ventro-dorsal networks. Indeed, signal modulations associated with these distinct functions follow dorso-ventral gradients, with left aIPS showing significant sensitivity to both target features and the characteristics of the required grasp. Thus, our results from the haptic domain are consistent with the notion that the parietal processing for action guidance reflects primarily transformations from object-related to effector-related coding, and these mechanisms are rather independent of sensory input modality.
Full Text Available Anagrus breviphragma Soyka (Hymenoptera: Mymaridae successfully parasitises eggs of Cicadella viridis (L. (Homoptera: Cicadellidae, embedded in vegetal tissues, suggesting the idea of possible chemical and physical cues, revealing the eggs presence. In this research, three treatments were considered in order to establish which types of cue are involved: eggs extracted from leaf, used as a control, eggs extracted from leaf and cleaned in water and ethanol, used to evaluate the presence of chemicals soluble in polar solvents, and eggs extracted from leaf and covered with Parafilm (M, used to avoid physical stimuli due to the bump on the leaf surface. The results show that eggs covered with Parafilm present a higher number of parasitised eggs and a lower probing starting time with respect to eggs washed with polar solvents or eggs extracted and untreated, both when the treatments were singly tested or when offered in sequence, independently of the treatment position. These results suggest that the exploited stimuli are not physical due to the bump but chemicals that can spread in the Parafilm, circulating the signal on the whole surface, and that the stimuli that elicit probing and oviposition are not subjected to learning.
... INTERNATIONAL TRADE COMMISSION [DN 2875] Certain Mobile Electronic Devices Incorporating Haptics.... International Trade Commission. ACTION: Notice. SUMMARY: Notice is hereby given that the U.S. International Trade Commission has received an amended complaint entitled Certain Mobile Electronic Devices...
Bode, Dyon; Mugge, Winfred; Schouten, Alfred C.; van Rootselaar, Anne-Fleur; Bour, Lo J.; van der Helm, Frans C. T.; Lammertse, Piet
Tremor, characterized by involuntary and rhythmical movements, is the most common movement disorder. Tremor can have peripheral and central oscillatory components which properly assessed may improve diagnostics. A magnetic resonance (MR)-safe haptic wrist manipulator enables simultaneous measurement
Bernstein, Nicholas; Lawrence, Dale; Pao, Lucy
Closed-loop force control can be used on haptic interfaces (HIs) to mitigate the effects of mechanism dynamics. A single multidimensional force-torque sensor is often employed to measure the interaction force between the haptic device and the user's hand. The parallel haptic interface at the University of Colorado (CU) instead employs smaller 1D force sensors oriented along each of the five actuating rods to build up a 5D force vector. This paper shows that a particular manipulandum/hand partition in the system dynamics is induced by the placement and type of force sensing, and discusses the implications on force and impedance control for parallel haptic interfaces. The details of a "squaring down" process are also discussed, showing how to obtain reduced degree-of-freedom models from the general six degree-of-freedom dynamics formulation.
The workload implications of haptic displays in multi-display environments such as the cockpit: Dual-task interference of within-sense haptic inputs (tactile/proprioceptive) and between-sense inputs (tactile/proprioceptive/auditory/visual)
Visual workload demand within the cockpit is reaching saturation, whereas the haptic sense (proprioceptive and tactile sensation) is relatively untapped, despite studies suggesting the benefits of haptic displays. MRT suggests that inputs from haptic displays will not interfere with inputs from visual or auditory displays. MRT is based on the premise that multisensory integration occurs only after unisensory processing. However, recent neuroscientific findings suggest that t...
Anthony L. Crawford
Natural movements and force feedback are important elements in using teleoperated equipment if complex and speedy manipulation tasks are to be accomplished in remote and/or hazardous environments, such as hot cells, glove boxes, decommissioning, explosives disarmament, and space to name a few. In order to achieve this end the research presented in this paper has developed an admittance type exoskeleton like multi-fingered haptic hand user interface that secures the user’s palm and provides 3-dimensional force feedback to the user’s fingertips. Atypical to conventional haptic hand user interfaces that limit themselves to integrating the human hand’s characteristics just into the system’s mechanical design this system also perpetuates that inspiration into the designed user interface’s controller. This is achieved by manifesting the property differences of manipulation and grasping activities as they pertain to the human hand into a nonlinear master-slave force relationship. The results presented in this paper show that the admittance-type system has sufficient bandwidth that it appears nearly transparent to the user when the user is in free motion and when the system is subjected to a manipulation task, increased performance is achieved using the nonlinear force relationship compared to the traditional linear scaling techniques implemented in the vast majority of systems.
Full Text Available By applying our developed intelligent fluid, magnetic compound fluid (MCF, to silicon oil rubber, we have made the MCF rubber highly sensitive to temperature and electric conduction. MCF is useful as the element material in haptic robot sensors and other related devices. In the present paper, we clarified the relationship between the electric current and the voltage under a tensile strain by utilizing the quantum mechanics theory on the multibarrier potential problem. The experimental results could be qualitatively explained by our proposed theory. The electrons can be moved between the solid materials by the tunnel effect. The relation between voltage and electric current is affected by the formation of the clusters, and it is changed by the application of heat. We also clarified experimentally the present MCF rubber useful in haptic sensors. Because the motions of humans and robots are different, the sensing of the rubber is different, depending on the placement. However, as for both motions of human and robot, there is no quantitative difference in the electric resistance among kinetic energy, momentum, and force. The sensing is also different based on the stiffness of the surface to which the sensor is adhered.
Erickson, David; Lacheray, Hervé; Lai, Gilbert; Haddadi, Amir
This paper presents the latest advancements of the Haptics-based Immersive Tele-robotic System (HITS) project, a next generation Improvised Explosive Device (IED) disposal (IEDD) robotic interface containing an immersive telepresence environment for a remotely-controlled three-articulated-robotic-arm system. While the haptic feedback enhances the operator's perception of the remote environment, a third teleoperated dexterous arm, equipped with multiple vision sensors and cameras, provides stereo vision with proper visual cues, and a 3D photo-realistic model of the potential IED. This decentralized system combines various capabilities including stable and scaled motion, singularity avoidance, cross-coupled hybrid control, active collision detection and avoidance, compliance control and constrained motion to provide a safe and intuitive control environment for the operators. Experimental results and validation of the current system are presented through various essential IEDD tasks. This project demonstrates that a two-armed anthropomorphic Explosive Ordnance Disposal (EOD) robot interface can achieve complex neutralization techniques against realistic IEDs without the operator approaching at any time.
Full Text Available This paper proposes a pseudo-haptic feedback method conveying simulated soft surface stiffness information through a visual interface. The method exploits a combination of two feedback techniques, namely visual feedback of soft surface deformation and control of the indenter avatar speed, to convey stiffness information of a simulated surface of a soft object in virtual environments. The proposed method was effective in distinguishing different sizes of virtual hard nodules integrated into the simulated soft bodies. To further improve the interactive experience, the approach was extended creating a multi-point pseudo-haptic feedback system. A comparison with regards to (a nodule detection sensitivity and (b elapsed time as performance indicators in hard nodule detection experiments to a tablet computer incorporating vibration feedback was conducted. The multi-point pseudo-haptic interaction is shown to be more time-efficient than the single-point pseudo-haptic interaction. It is noted that multi-point pseudo-haptic feedback performs similarly well when compared to a vibration-based feedback method based on both performance measures elapsed time and nodule detection sensitivity. This proves that the proposed method can be used to convey detailed haptic information for virtual environmental tasks, even subtle ones, using either a computer mouse or a pressure sensitive device as an input device. This pseudo-haptic feedback method provides an opportunity for low-cost simulation of objects with soft surfaces and hard inclusions, as, for example, occurring in ever more realistic video games with increasing emphasis on interaction with the physical environment and minimally invasive surgery in the form of soft tissue organs with embedded cancer nodules. Hence, the method can be used in many low-budget applications where haptic sensation is required, such as surgeon training or video games, either using desktop computers or portable devices, showing
Ito, Tatsuya; Tsuji, Toshiaki
The authors have developed “haptic armor”, a whole-body haptic sensor that has an ability to estimate contact position. Although it is developed for safety assurance of robots in human environment, it can also be used as an interface. This paper proposes a command recognition method based on finger trace information. This paper also discusses some technical issues for improving recognition accuracy of this system.
曽根, 順治; 岩井, 秀樹; 山田, 勝実; 陳, 軍; 徳山, 喜政; 今野, 晃市; Sone, Junji; Iwai, Hideki; Yamada, Katsumi; Chen, Jun; Tokuyama, Yoshimasa; Konno, Kouichi
We have developed a haptic display for rotational tasks that involve functions of the human wrist. We represent the torque using a motor and a brake. Reference torque curves are obtained by the measuring torque required for each actual task using a torque sensor. The brake represents the stop condition. We have confirmed the effectiveness of the display by comparing the actual tasks with the haptic display experiment.
Full Text Available BACKGROUND: Vision and haptics are the key modalities by which humans perceive objects and interact with their environment in a target-oriented manner. Both modalities share higher-order neural resources and the mechanisms required for object exploration. Compared to vision, the understanding of haptic information processing is still rudimentary. Although it is known that haptic performance, similar to many other skills, decreases in old age, the underlying mechanisms are not clear. It is yet to be determined to what extent this decrease is related to the age-related loss of tactile acuity or cognitive capacity. METHODOLOGY/PRINCIPAL FINDINGS: We investigated the haptic performance of 81 older adults by means of a cross-modal object recognition test. Additionally, we assessed the subjects' tactile acuity with an apparatus-based two-point discrimination paradigm, and their cognitive performance by means of the non-verbal Raven-Standard-Progressive matrices test. As expected, there was a significant age-related decline in performance on all 3 tests. With the exception of tactile acuity, this decline was found to be more distinct in female subjects. Correlation analyses revealed a strong relationship between haptic and cognitive performance for all subjects. Tactile performance, on the contrary, was only significantly correlated with male subjects' haptic performance. CONCLUSIONS: Haptic object recognition is a demanding task in old age, especially when it comes to the exploration of complex, unfamiliar objects. Our data support a disproportionately higher impact of cognition on haptic performance as compared to the impact of tactile acuity. Our findings are in agreement with studies reporting an increase in co-variation between individual sensory performance and general cognitive functioning in old age.
Zhu, Bowen; Wang, Hong; Liu, Yaqing; Qi, Dianpeng; Liu, Zhiyuan; Wang, Hua; Yu, Jiancan; Sherburne, Matthew; Wang, Zhaohui; Chen, Xiaodong
Skin-inspired haptic-memory devices, which can retain pressure information after the removel of external pressure by virtue of the nonvolatile nature of the memory devices, are achieved. The rise of haptic-memory devices will allow for mimicry of human sensory memory, opening new avenues for the design of next-generation high-performance sensing devices and systems. © 2015 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.
Kim, Mingyu; Jeon, Changyu; Kim, Jinmo
This paper proposes a portable hand haptic system using Leap Motion as a haptic interface that can be used in various virtual reality (VR) applications. The proposed hand haptic system was designed as an Arduino-based sensor architecture to enable a variety of tactile senses at low cost, and is also equipped with a portable wristband. As a haptic system designed for tactile feedback, the proposed system first identifies the left and right hands and then sends tactile senses (vibration and heat) to each fingertip (thumb and index finger). It is incorporated into a wearable band-type system, making its use easy and convenient. Next, hand motion is accurately captured using the sensor of the hand tracking system and is used for virtual object control, thus achieving interaction that enhances immersion. A VR application was designed with the purpose of testing the immersion and presence aspects of the proposed system. Lastly, technical and statistical tests were carried out to assess whether the proposed haptic system can provide a new immersive presence to users. According to the results of the presence questionnaire and the simulator sickness questionnaire, we confirmed that the proposed hand haptic system, in comparison to the existing interaction that uses only the hand tracking system, provided greater presence and a more immersive environment in the virtual reality.
Ponce Wong, Ruben D.; Hellman, Randall B.; Santos, Veronica J.
Haptic perception remains a grand challenge for artificial hands. Dexterous manipulators could be enhanced by "haptic intelligence" that enables identification of objects and their features via touch alone. Haptic perception of local shape would be useful when vision is obstructed or when proprioceptive feedback is inadequate, as observed in this study. In this work, a robot hand outfitted with a deformable, bladder-type, multimodal tactile sensor was used to replay four human-inspired haptic "exploratory procedures" on fingertip-sized geometric features. The geometric features varied by type (bump, pit), curvature (planar, conical, spherical), and footprint dimension (1.25 - 20 mm). Tactile signals generated by active fingertip motions were used to extract key parameters for use as inputs to supervised learning models. A support vector classifier estimated order of curvature while support vector regression models estimated footprint dimension once curvature had been estimated. A distal-proximal stroke (along the long axis of the finger) enabled estimation of order of curvature with an accuracy of 97%. Best-performing, curvature-specific, support vector regression models yielded R2 values of at least 0.95. While a radial-ulnar stroke (along the short axis of the finger) was most helpful for estimating feature type and size for planar features, a rolling motion was most helpful for conical and spherical features. The ability to haptically perceive local shape could be used to advance robot autonomy and provide haptic feedback to human teleoperators of devices ranging from bomb defusal robots to neuroprostheses.
Hwang, Yong-Hoon; Cha, Seung-Woo; Kang, Seok-Rae; Choi, Seung-Bok
In this study, a 7-DOF slave robot integrated with the haptic master is designed and its dynamic motion is controlled. The haptic master is made using a controllable magneto-rheological (MR) clutch and brake and it provides the surgeon with a sense of touch by using both kinetic and kinesthetic information. Due to the size constraint of the slave robot, a wire actuating is adopted to make the desired motion of the end-effector which has 3-DOF instead of a conventional direct-driven motor. Another motions of the link parts that have 4-DOF use direct-driven motor. In total system, for working as a haptic device, the haptic master need to receive the information of repulsive forces applied on the slave robot. Therefore, repulsive forces on the end-effector are sensed by using three uniaxial torque transducer inserted in the wire actuating system and another repulsive forces applied on link part are sensed by using 6-axis transducer that is able to sense forces and torques. Using another 6-axis transducer, verify the reliability of force information on final end of slave robot. Lastly, integrated with a MR haptic master, psycho-physical test is conducted by different operators who can feel the different repulsive force or torque generated from the haptic master which is equivalent to the force or torque occurred on the end-effector to demonstrate the effectiveness of the proposed system.
Kim, Mingyu; Jeon, Changyu; Kim, Jinmo
This paper proposes a portable hand haptic system using Leap Motion as a haptic interface that can be used in various virtual reality (VR) applications. The proposed hand haptic system was designed as an Arduino-based sensor architecture to enable a variety of tactile senses at low cost, and is also equipped with a portable wristband. As a haptic system designed for tactile feedback, the proposed system first identifies the left and right hands and then sends tactile senses (vibration and heat) to each fingertip (thumb and index finger). It is incorporated into a wearable band-type system, making its use easy and convenient. Next, hand motion is accurately captured using the sensor of the hand tracking system and is used for virtual object control, thus achieving interaction that enhances immersion. A VR application was designed with the purpose of testing the immersion and presence aspects of the proposed system. Lastly, technical and statistical tests were carried out to assess whether the proposed haptic system can provide a new immersive presence to users. According to the results of the presence questionnaire and the simulator sickness questionnaire, we confirmed that the proposed hand haptic system, in comparison to the existing interaction that uses only the hand tracking system, provided greater presence and a more immersive environment in the virtual reality. PMID:28513545
Lorenzo-Romero, Carlota; Alarcón-del-Amo, María-del-Carmen; Gómez-Borja, Miguel-Ángel
Based on the Stimulus-Organism-Response paradigm this research analyzes the main differences between the effects of two types of web technologies: Verbal web technology (i.e., navigational structure as utilitarian stimulus) versus non-verbal web technology (music and presentation of products as hedonic stimuli). Specific webmosphere stimuli have not been examined yet as separate variables and their impact on internal and behavioral responses seems unknown. Therefore, the objective of this res...
Carlota Lorenzo-Romero; María-del-Carmen Alarcón-del-Amo
Based on the Stimulus-Organism-Response paradigm this research analyzes the main differences between the effects of two types of web technologies: Verbal web technology (i.e. navigational structure as utilitarian stimulus) versus nonverbal web technology (music and presentation of products as hedonic stimuli). Specific webmosphere stimuli have not been examined yet as separate variables and their impact on internal and behavioral responses seems unknown. Therefore, the objective of this resea...
Rebecca J Lepping
Full Text Available Anterior cingulate cortex (ACC and striatum are part of the emotional neural circuitry implicated in major depressive disorder (MDD. Music is often used for emotion regulation, and pleasurable music listening activates the dopaminergic system in the brain, including the ACC. The present study uses functional MRI (fMRI and an emotional nonmusical and musical stimuli paradigm to examine how neural processing of emotionally provocative auditory stimuli is altered within the ACC and striatum in depression.Nineteen MDD and 20 never-depressed (ND control participants listened to standardized positive and negative emotional musical and nonmusical stimuli during fMRI scanning and gave subjective ratings of valence and arousal following scanning.ND participants exhibited greater activation to positive versus negative stimuli in ventral ACC. When compared with ND participants, MDD participants showed a different pattern of activation in ACC. In the rostral part of the ACC, ND participants showed greater activation for positive information, while MDD participants showed greater activation to negative information. In dorsal ACC, the pattern of activation distinguished between the types of stimuli, with ND participants showing greater activation to music compared to nonmusical stimuli, while MDD participants showed greater activation to nonmusical stimuli, with the greatest response to negative nonmusical stimuli. No group differences were found in striatum.These results suggest that people with depression may process emotional auditory stimuli differently based on both the type of stimulation and the emotional content of that stimulation. This raises the possibility that music may be useful in retraining ACC function, potentially leading to more effective and targeted treatments.
Full Text Available When two robot systems can share understanding using any agreed knowledge, within the constraints of the system’s communication protocol, the approach may lead to a common improvement. This has persuaded numerous new research inquiries in human-robot collaboration. We have built up a framework prepared to do independent following and performing table-best protest object manipulation with humans and we have actualized two different activity models to trigger robot activities. The idea here is to explore collaborative systems and to build up a plan for them to work in a collaborative environment which has many benefits to a single more complex system. In the paper, two robots that cooperate among themselves are constructed. The participation linking the two robotic arms, the torque required and parameters are analyzed. Thus the purpose of this paper is to demonstrate a modular robot system which can serve as a base on aspects of robotics in collaborative robots using haptics.
Zheng Yaoyang; Shimada, Kunio
To provide a new composite material having a high electrical sensitivity in the fields of robotics and sensing, a magnetic rubber having network-like magnetic clusters was developed by utilizing a magnetic compound fluid (MCF). MCF rubber with small deformations can provide an effective sensor. In this paper, we report many experiments in which changes of the MCF rubber's resistance were observed when the rubber was compressed and a deformation was generated; we then made a trial haptic sensor using the MCF conductive rubber and performed many experiments to observe changes of the electrical resistance of the sensor. The results of experiments showed that the proposed sensor made with MCF conductive rubber is useful for sensing small amounts of pressure or small deformations
Zheng Yaoyang; Shimada, Kunio [Faculty of Symbiotic Systems Science Fukushima University, 1 Kanayakawa, Fukushima 960-1296 (Japan)], E-mail: email@example.com, E-mail: firstname.lastname@example.org
To provide a new composite material having a high electrical sensitivity in the fields of robotics and sensing, a magnetic rubber having network-like magnetic clusters was developed by utilizing a magnetic compound fluid (MCF). MCF rubber with small deformations can provide an effective sensor. In this paper, we report many experiments in which changes of the MCF rubber's resistance were observed when the rubber was compressed and a deformation was generated; we then made a trial haptic sensor using the MCF conductive rubber and performed many experiments to observe changes of the electrical resistance of the sensor. The results of experiments showed that the proposed sensor made with MCF conductive rubber is useful for sensing small amounts of pressure or small deformations.
Zheng, Yaoyang; Shimada, Kunio
To provide a new composite material having a high electrical sensitivity in the fields of robotics and sensing, a magnetic rubber having network-like magnetic clusters was developed by utilizing a magnetic compound fluid (MCF). MCF rubber with small deformations can provide an effective sensor. In this paper, we report many experiments in which changes of the MCF rubber's resistance were observed when the rubber was compressed and a deformation was generated; we then made a trial haptic sensor using the MCF conductive rubber and performed many experiments to observe changes of the electrical resistance of the sensor. The results of experiments showed that the proposed sensor made with MCF conductive rubber is useful for sensing small amounts of pressure or small deformations.
Tsuchimi, Daisuke; Okuyama, Takeshi; Tanaka, Mami
This paper is concerned with the development of a tactile sensor using PVDF (Polyvinylidene Fluoride) film as a sensory receptor of the sensor to evaluate softness, smoothness, and stickiness of human skin. Tactile sense is the most important sense in the sensation receptor of the human body along with eyesight, and we can examine skin condition quickly using these sense. But, its subjectivity and ambiguity make it difficult to quantify skin conditions. Therefore, development of measurement device which can evaluate skin conditions easily and objectively is demanded by dermatologists, cosmetic industries, and so on. In this paper, an advanced haptic sensor system that can measure multiple information of skin condition in various parts of human body is developed. The applications of the sensor system to evaluate softness, smoothness, and stickiness of skin are investigated through two experiments.
Cannella, F; Olivieri, E; Caldwell, D G; Scalise, L; Memeo, M
Research on tactile sensitivity has been conducted since the last century and many devices have been proposed to study in detail this sense through experimental tests. The sense of touch is essential in every-day life of human beings, but it can also play a fundamental role for the assessment of some neurological disabilities and pathologies. In fact, the level of tactile perception can provide information on the health state of the nervous system. In this paper, authors propose the design and development of a novel test apparatus, named DITA (Dynamic Investigation Test-rig on hAptics), aiming to provide the measurement of the tactile sensitivity trough the determination of the Just Noticeable Difference (JND) curve of a subject. The paper reports the solution adopted for the system design and the results obtained on the set of experiments carried out on volunteers
Wood, Claudia; Sugiharto, Albert Budiman; Max, Eva; Fery, Andreas
Shampoo treatment and hair conditioning have a direct impact on our wellbeing via properties like combability and haptic perception of hair. Therefore, systematic investigations leading to quality improvement of hair care products are of major interest. The aim of our work is a better understanding of complex testing and the correlation with quantitative parameters. The motivation for the development of physical testing methods for hair feel relates to the fact that an ingredient supplier like BASF can only find new, so far not yet toxicologically approved chemistries for hair cosmetics, if an in-vitro method exists.In this work, the effects of different shampoo treatments with conditioning polymers are investigated. The employed physical test method, dry friction measurements and AFM observe friction phenomena on a macroscopic as well as on a nanoscale directly on hair. They are an approach to complement sensoric evaluation with an objective in-vitro method.
Fenz, Wolfgang; Dirnberger, Johannes
Providing suitable training for aspiring neurosurgeons is becoming more and more problematic. The increasing popularity of the endovascular treatment of intracranial aneurysms leads to a lack of simple surgical situations for clipping operations, leaving mainly the complex cases, which present even experienced surgeons with a challenge. To alleviate this situation, we have developed a training simulator with haptic interaction allowing trainees to practice virtual clipping surgeries on real patient-specific vessel geometries. By using specialized finite element (FEM) algorithms (fast finite element method, matrix condensation) combined with GPU acceleration, we can achieve the necessary frame rate for smooth real-time interaction with the detailed models needed for a realistic simulation of the vessel wall deformation caused by the clamping with surgical clips. Vessel wall geometries for typical training scenarios were obtained from 3D-reconstructed medical image data, while for the instruments (clipping forceps, various types of clips, suction tubes) we use models provided by manufacturer Aesculap AG. Collisions between vessel and instruments have to be continuously detected and transformed into corresponding boundary conditions and feedback forces, calculated using a contact plane method. After a training, the achieved result can be assessed based on various criteria, including a simulation of the residual blood flow into the aneurysm. Rigid models of the surgical access and surrounding brain tissue, plus coupling a real forceps to the haptic input device further increase the realism of the simulation.
Fortmeier, Dirk; Mastmeyer, Andre; Schröder, Julian; Handels, Heinz
This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.
Couperus, J W
This study explored effects of perceptual load on stimulus processing in the presence and absence of an attended stimulus. Participants were presented with a bilateral or unilateral display and asked to perform a discrimination task at either low or high perceptual load. Electrophysiological responses to stimuli were then compared at the P100 and N100. As in previous studies, perceptual load modified processing of attended and unattended stimuli seen at occipital scalp sites. Moreover, perceptual load modulated attention effects when the attended stimulus was presented at high perceptual load for unilateral displays. However, this was not true when the attended and unattended stimulus appeared simultaneously in bilateral displays. Instead, only a main effect of perceptual load was found. Reductions in processing contralateral to the unattended stimulus at the N100 provide support for Lavie's (1995) theory of selective attention. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.
Gori, Simone; Giora, Enrico; Pedersini, Riccardo
In a series of experiments using ambiguous stimuli, we investigate the effects of displaying ordered, discrete series of images on the dynamics of figure-ground segregation. For low frame presentation speeds, the series were perceived as a sequence of discontinuous, static images, while for high speeds they were perceived as continuous. We conclude that using stimuli varying continuously along one parameter results in stronger hysteresis and reduces spontaneous switching compared to matched static stimuli with discontinuous parameter changes. The additional evidence that the size of the hysteresis effects depended on trial duration is consistent with the stochastic nature of the dynamics governing figure-ground segregation. The results showed that for continuously changing stimuli, alternative figure-ground organizations are resolved via low-level, dynamical competition. A second series of experiments confirmed these results with an ambiguous stimulus based on Petter's effect.
Afzal, Muhammad Raheel; Byun, Ha-Young; Oh, Min-Kyun; Yoon, Jungwon
Haptic control is a useful therapeutic option in rehabilitation featuring virtual reality interaction. As with visual and vibrotactile biofeedback, kinesthetic haptic feedback may assist in postural control, and can achieve balance control. Kinesthetic haptic feedback in terms of body sway can be delivered via a commercially available haptic device and can enhance the balance stability of both young healthy subjects and stroke patients. Our system features a waist-attached smartphone, software running on a computer (PC), and a dedicated Phantom Omni® device. Young healthy participants performed balance tasks after assumption of each of four distinct postures for 30 s (one foot on the ground; the Tandem Romberg stance; one foot on foam; and the Tandem Romberg stance on foam) with eyes closed. Patient eyes were not closed and assumption of the Romberg stance (only) was tested during a balance task 25 s in duration. An Android application running continuously on the smartphone sent mediolateral (ML) and anteroposterior (AP) tilt angles to a PC, which generated kinesthetic haptic feedback via Phantom Omni®. A total of 16 subjects, 8 of whom were young healthy and 8 of whom had suffered stroke, participated in the study. Post-experiment data analysis was performed using MATLAB®. Mean Velocity Displacement (MVD), Planar Deviation (PD), Mediolateral Trajectory (MLT) and Anteroposterior Trajectory (APT) parameters were analyzed to measure reduction in body sway. Our kinesthetic haptic feedback system was effective to reduce postural sway in young healthy subjects regardless of posture and the condition of the substrate (the ground) and to improve MVD and PD in stroke patients who assumed the Romberg stance. Analysis of Variance (ANOVA) revealed that kinesthetic haptic feedback significantly reduced body sway in both categories of subjects. Kinesthetic haptic feedback can be implemented using a commercial haptic device and a smartphone. Intuitive balance cues were
Bizley, Jennifer; Wood, Katherine; Freeman, Laura
Observers performed a relative localisation task in which they reported whether the second of two sequentially presented signals occurred to the left or right of the first. Stimuli were detectability-matched auditory, visual, or auditory-visual signals and the goal was to compare changes in performance with eccentricity across modalities. Visual performance was superior to auditory at the midline, but inferior in the periphery, while auditory-visual performance exceeded both at all locations....
Full Text Available We investigated the effects of auditory stimuli on the perceived velocity of a moving visual stimulus. Previous studies have reported that the duration of visual events is perceived as being longer for events filled with auditory stimuli than for events not filled with auditory stimuli, ie, the so-called “filled-duration illusion.” In this study, we have shown that auditory stimuli also affect the perceived velocity of a moving visual stimulus. In Experiment 1, a moving comparison stimulus (4.2∼5.8 deg/s was presented together with filled (or unfilled white-noise bursts or with no sound. The standard stimulus was a moving visual stimulus (5 deg/s presented before or after the comparison stimulus. The participants had to judge which stimulus was moving faster. The results showed that the perceived velocity in the auditory-filled condition was lower than that in the auditory-unfilled and no-sound conditions. In Experiment 2, we investigated the effects of auditory stimuli on velocity adaptation. The results showed that the effects of velocity adaptation in the auditory-filled condition were weaker than those in the no-sound condition. These results indicate that auditory stimuli tend to decrease the perceived velocity of a moving visual stimulus.
Voon, Valerie; Brezing, Christina; Gallea, Cecile; Ameli, Rezvan; Roelofs, Karin; LaFrance, W. Curt, Jr.; Hallett, Mark
Conversion disorder is characterized by neurological signs and symptoms related to an underlying psychological issue. Amygdala activity to affective stimuli is well characterized in healthy volunteers with greater amygdala activity to both negative and positive stimuli relative to neutral stimuli, and greater activity to negative relative to…
Schieppati, Marco; Schmid, Monica; Sozzi, Stefania
Vision and touch rapidly lead to postural stabilization in sighted subjects. Is touch-induced stabilization more rapid in blind than in sighted subjects, owing to cross-modal reorganization of function in the blind? We estimated the time-period elapsing from onset of availability of haptic support to onset of lateral stabilization in a group of early- and late-onset blinds. Eleven blind (age 39.4 years±11.7SD) and eleven sighted subjects (age 30.0 years±10.0SD), standing eyes closed with feet in tandem position, touched a pad with their index finger and withdrew the finger from the pad in sequence. EMG of postural muscles and displacement of centre of foot pressure were recorded. The task was repeated fifty times, to allow statistical evaluation of the latency of EMG and sway changes following the haptic shift. Steady-state sway (with or without contact with pad, no haptic shift) did not differ between blind and sighted. On adding the haptic stimulus, EMG and sway diminished in both groups, but at an earlier latency (by about 0.5 s) in the blinds (p blinds. When the haptic stimulus was withdrawn, both groups increased EMG and sway at equally short delays. Blinds are rapid in implementing adaptive postural modifications when granted an external haptic reference. Fast processing of the stabilizing haptic spatial-orientation cues may be favoured by cortical plasticity in blinds. These findings add new information to the field of sensory-guided dynamic control of equilibrium in man. Copyright © 2013 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.
Teodorescu, Kinneret; Bouchigny, Sylvain; Korman, Maria
In this study, we explored the time course of haptic stiffness discrimination learning and how it was affected by two experimental factors, the addition of visual information and/or knowledge of results (KR) during training. Stiffness perception may integrate both haptic and visual modalities. However, in many tasks, the visual field is typically occluded, forcing stiffness perception to be dependent exclusively on haptic information. No studies to date addressed the time course of haptic stiffness perceptual learning. Using a virtual environment (VE) haptic interface and a two-alternative forced-choice discrimination task, the haptic stiffness discrimination ability of 48 participants was tested across 2 days. Each day included two haptic test blocks separated by a training block Additional visual information and/or KR were manipulated between participants during training blocks. Practice repetitions alone induced significant improvement in haptic stiffness discrimination. Between days, accuracy was slightly improved, but decision time performance was deteriorated. The addition of visual information and/or KR had only temporary effects on decision time, without affecting the time course of haptic discrimination learning. Learning in haptic stiffness discrimination appears to evolve through at least two distinctive phases: A single training session resulted in both immediate and latent learning. This learning was not affected by the training manipulations inspected. Training skills in VE in spaced sessions can be beneficial for tasks in which haptic perception is critical, such as surgery procedures, when the visual field is occluded. However, training protocols for such tasks should account for low impact of multisensory information and KR.
Zheng, Yaoyang; Shimada, Kunio
The present paper describes the application of magnetic compound fluid (MCF) rubber as a haptic sensor for use as a material for robot sensors, artificial skin, and so on. MCF rubber is one of several new composite materials utilizing the MCF magnetic responsive fluid developed by Shimada. By applying MCF to silicon oil rubber, we can make MCF rubber highly sensitive to temperature and electric conduction. By mixing Cu and Ni particles in the silicon oil rubber and then applying a strong magnetic field, we can produce magnetic clusters at high density. The clusters form a network, as confirmed by optical observation. The MCF rubber with small deformations can act as an effective sensor. We report herein several experiments in which changes in the MCF rubber's resistance were observed when the rubber was compressed and a deformation was generated. We then made a trial haptic sensor using the MCF conductive rubber and performed many experiments to observe changes in the electrical resistance of the sensor. The experimental results showed that the proposed sensor made with MCF conductive rubber is useful for sensing small amounts of pressure or small deformations. Sometimes, however, the sensor rubber will be extended when we apply this sensor to the finger of the robot or an elbow. In these cases, it is necessary to understand the changes in sensor's conductivity. We therefore carried out some experiments to demonstrate how, under tensile conditions, the sensor's conductivity changes to a small value easier than the sensor in free condition. The results show that the sensors became more sensitive to the same pressure under extended conditions. In the present paper, we first describe the new type of functional fluid MCF rubber and a new composite material based on this MCF fluid. We then explain the production method for MCF conductive rubber and its conductive algorithm. Finally, we report our results regarding the MCF sensitivity when the MCF rubber was pulled
David M Wilson
Full Text Available A growing literature suggests taste stimuli commonly classified as "bitter" induce heterogeneous neural and perceptual responses. Here, the central processing of bitter stimuli was studied in mice with genetically controlled bitter taste profiles. Using these mice removed genetic heterogeneity as a factor influencing gustatory neural codes for bitter stimuli. Electrophysiological activity (spikes was recorded from single neurons in the nucleus tractus solitarius during oral delivery of taste solutions (26 total, including concentration series of the bitter tastants quinine, denatonium benzoate, cycloheximide, and sucrose octaacetate (SOA, presented to the whole mouth for 5 s. Seventy-nine neurons were sampled; in many cases multiple cells (2 to 5 were recorded from a mouse. Results showed bitter stimuli induced variable gustatory activity. For example, although some neurons responded robustly to quinine and cycloheximide, others displayed concentration-dependent activity (p<0.05 to quinine but not cycloheximide. Differential activity to bitter stimuli was observed across multiple neurons recorded from one animal in several mice. Across all cells, quinine and denatonium induced correlated spatial responses that differed (p<0.05 from those to cycloheximide and SOA. Modeling spatiotemporal neural ensemble activity revealed responses to quinine/denatonium and cycloheximide/SOA diverged during only an early, at least 1 s wide period of the taste response. Our findings highlight how temporal features of sensory processing contribute differences among bitter taste codes and build on data suggesting heterogeneity among "bitter" stimuli, data that challenge a strict monoguesia model for the bitter quality.
Postma, Albert; Zuidhoek, Sander; Noordzij, Matthijs L.; Kappers, Astrid M L
The roles of visual and haptic experience in different aspects of haptic processing of objects in peripersonal space are examined. In three trials, early-blind, late-blind, and blindfoldedsighted individuals had to match ten shapes haptically to the cut-outs in a board as fast as possible. Both
Kawai, Takeshi; Watanabe, Yutaka; Tonogi, Morio; Yamane, Gen-yuki; Abe, Shinichi; Yamada, Yoshiaki; Callan, Akiko
We focused on brain areas activated by audiovisual stimuli related to swallowing motions. In this study, three kinds of stimuli related to human swallowing movement (auditory stimuli alone, visual stimuli alone, or audiovisual stimuli) were presented to the subjects, and activated brain areas were measured using functional MRI (fMRI) and analyzed. When auditory stimuli alone were presented, the supplementary motor area was activated. When visual stimuli alone were presented, the premotor and primary motor areas of the left and right hemispheres and prefrontal area of the left hemisphere were activated. When audiovisual stimuli were presented, the prefrontal and premotor areas of the left and right hemispheres were activated. Activation of Broca's area, which would have been characteristic of mirror neuron system activation on presentation of motion images, was not observed; however, activation of brain areas related to swallowing motion programming and performance was verified for auditory, visual and audiovisual stimuli related to swallowing motion. These results suggest that audiovisual stimuli related to swallowing motion could be applied to the treatment of patients with dysphagia. (author)
Full Text Available An important feature of addiction is the high drug craving that may promote the continuation of consumption. Environmental stimuli classically conditioned to drug-intake have a strong motivational power for addicts and can elicit craving. However, addicts differ in the attitudes towards their own consumption behavior: some are content with drug taking (consonant users whereas others are discontent (dissonant users. Such differences may be important for clinical practice because the experience of dissonance might enhance the likelihood to consider treatment. This fMRI study investigated in smokers whether these different attitudes influence subjective and neural responses to smoking stimuli. Based on self-characterization, smokers were divided into consonant and dissonant smokers. These two groups were presented smoking stimuli and neutral stimuli. Former studies have suggested differences in the impact of smoking stimuli depending on the temporal stage of the smoking ritual they are associated with. Therefore, we used stimuli associated with the beginning (BEGIN-smoking-stimuli and stimuli associated with the terminal stage (END-smoking-stimuli of the smoking ritual as distinct stimulus categories. Stimulus ratings did not differ between both groups. Brain data showed that BEGIN-smoking-stimuli led to enhanced mesolimbic responses (amygdala, hippocampus, insula in dissonant compared to consonant smokers. In response to END-smoking-stimuli, dissonant smokers showed reduced mesocortical responses (orbitofrontal cortex, subcallosal cortex compared to consonant smokers. These results suggest that smoking stimuli with a high incentive value (BEGIN-smoking-stimuli are more appetitive for dissonant than consonant smokers at least on the neural level. To the contrary, smoking stimuli with low incentive value (END-smoking-stimuli seem to be less appetitive for dissonant smokers than consonant smokers. These differences might be one reason why dissonant
Stippekohl, Bastian; Winkler, Markus H; Walter, Bertram; Kagerer, Sabine; Mucha, Ronald F; Pauli, Paul; Vaitl, Dieter; Stark, Rudolf
An important feature of addiction is the high drug craving that may promote the continuation of consumption. Environmental stimuli classically conditioned to drug-intake have a strong motivational power for addicts and can elicit craving. However, addicts differ in the attitudes towards their own consumption behavior: some are content with drug taking (consonant users) whereas others are discontent (dissonant users). Such differences may be important for clinical practice because the experience of dissonance might enhance the likelihood to consider treatment. This fMRI study investigated in smokers whether these different attitudes influence subjective and neural responses to smoking stimuli. Based on self-characterization, smokers were divided into consonant and dissonant smokers. These two groups were presented smoking stimuli and neutral stimuli. Former studies have suggested differences in the impact of smoking stimuli depending on the temporal stage of the smoking ritual they are associated with. Therefore, we used stimuli associated with the beginning (BEGIN-smoking-stimuli) and stimuli associated with the terminal stage (END-smoking-stimuli) of the smoking ritual as distinct stimulus categories. Stimulus ratings did not differ between both groups. Brain data showed that BEGIN-smoking-stimuli led to enhanced mesolimbic responses (amygdala, hippocampus, insula) in dissonant compared to consonant smokers. In response to END-smoking-stimuli, dissonant smokers showed reduced mesocortical responses (orbitofrontal cortex, subcallosal cortex) compared to consonant smokers. These results suggest that smoking stimuli with a high incentive value (BEGIN-smoking-stimuli) are more appetitive for dissonant than consonant smokers at least on the neural level. To the contrary, smoking stimuli with low incentive value (END-smoking-stimuli) seem to be less appetitive for dissonant smokers than consonant smokers. These differences might be one reason why dissonant smokers
Nakano, Tamami; Kato, Nobumasa; Kitazawa, Shigeru
A weak central coherence theory in autism spectrum disorder (ASD) proposes that a cognitive bias toward local processing in ASD derives from a weakness in integrating local elements into a coherent whole. Using this theory, we hypothesized that shape perception through active touch, which requires sequential integration of sensorimotor traces of exploratory finger movements into a shape representation, would be impaired in ASD. Contrary to our expectation, adults with ASD showed superior performance in a haptic-to-visual delayed shape-matching task compared to adults without ASD. Accuracy in discriminating haptic lengths or haptic orientations, which lies within the somatosensory modality, did not differ between adults with ASD and adults without ASD. Moreover, this superior ability in inter-modal haptic-to-visual shape matching was not explained by the score in a unimodal visuospatial rotation task. These results suggest that individuals with ASD are not impaired in integrating sensorimotor traces into a global visual shape and that their multimodal shape representations and haptic-to-visual information transfer are more accurate than those of individuals without ASD. Copyright © 2012 Elsevier Ltd. All rights reserved.
Fu, Michael C; DeLuke, Levi; Buerba, Rafael A; Fan, Richard E; Zheng, Ying Jean; Leslie, Michael P; Baumgaertner, Michael R; Grauer, Jonathan N
After lower-extremity orthopedic trauma and surgery, patients are often advised to restrict weight bearing on the affected limb. Conventional training methods are not effective at enabling patients to comply with recommendations for partial weight bearing. The current study assessed a novel method of using real-time haptic (vibratory/vibrotactile) biofeedback to improve compliance with instructions for partial weight bearing. Thirty healthy, asymptomatic participants were randomized into 1 of 3 groups: verbal instruction, bathroom scale training, and haptic biofeedback. Participants were instructed to restrict lower-extremity weight bearing in a walking boot with crutches to 25 lb, with an acceptable range of 15 to 35 lb. A custom weight bearing sensor and biofeedback system was attached to all participants, but only those in the haptic biofeedback group were given a vibrotactile signal if they exceeded the acceptable range. Weight bearing in all groups was measured with a separate validated commercial system. The verbal instruction group bore an average of 60.3±30.5 lb (mean±standard deviation). The bathroom scale group averaged 43.8±17.2 lb, whereas the haptic biofeedback group averaged 22.4±9.1 lb (Phaptic biofeedback group averaged 14.5±6.3% (Phaptic biofeedback to improve compliance with lower-extremity partial weight bearing, haptic biofeedback was superior to conventional physical therapy methods. Further studies in patients with clinical orthopedic trauma are warranted. Copyright 2014, SLACK Incorporated.
Stoycheva, Polina; Tiippana, Kaisa
The brain's left hemisphere often displays advantages in processing verbal information, while the right hemisphere favours processing non-verbal information. In the haptic domain due to contra-lateral innervations, this functional lateralization is reflected in a hand advantage during certain functions. Findings regarding the hand-hemisphere advantage for haptic information remain contradictory, however. This study addressed these laterality effects and their interaction with memory retention times in the haptic modality. Participants performed haptic discrimination of letters, geometric shapes and nonsense shapes at memory retention times of 5, 15 and 30 s with the left and right hand separately, and we measured the discriminability index d'. The d' values were significantly higher for letters and geometric shapes than for nonsense shapes. This might result from dual coding (naming + spatial) or/and from a low stimulus complexity. There was no stimulus-specific laterality effect. However, we found a time-dependent laterality effect, which revealed that the performance of the left hand-right hemisphere was sustained up to 15 s, while the performance of the right-hand-left hemisphere decreased progressively throughout all retention times. This suggests that haptic memory traces are more robust to decay when they are processed by the left hand-right hemisphere.
Beyl, T; Nicolai, P; Mönnich, H; Raczkowksy, J; Wörn, H
In current research, haptic feedback in robot assisted interventions plays an important role. However most approaches to haptic feedback only regard the mapping of the current forces at the surgical instrument to the haptic input devices, whereas surgeons demand a combination of medical imaging and telemanipulated robotic setups. In this paper we describe how this feature is integrated in our robotic research platform OP:Sense. The proposed method allows the automatic transfer of segmented imaging data to the haptic renderer and therefore allows enriching the haptic feedback with virtual fixtures based on imaging data. Anatomical structures are extracted from pre-operative generated medical images or virtual walls are defined by the surgeon inside the imaging data. Combining real forces with virtual fixtures can guide the surgeon to the regions of interest as well as helps to prevent the risk of damage to critical structures inside the patient. We believe that the combination of medical imaging and telemanipulation is a crucial step for the next generation of MIRS-systems.
Viinikainen, Mikko; Tuominen, Janne; Alho, Pekka; Mattila, Jouni
Highlights: •An experimental haptic shared control system, called CAT developed at the DTP2. •We investigate how the system integrates with the ITER compliant DTP2 RHCS. •The effect of CAT experimentally assessed in an ITER relevant maintenance scenario. -- Abstract: The remote maintenance of the ITER divertor is largely dependent on the usage of haptically teleoperated manipulators and man-in-the-loop operations. These maintenance operations are very demanding for the manipulator operators, yet vital for the success of the whole ITER experiment. Haptic shared control of the maintenance manipulators offers a promising solution for assisting the teleoperators in the maintenance tasks. A shared control system assists the operator by generating artificial guiding force effects and overlaying them on top of the haptic feedback from the teleoperation environment. An experimental haptic shared control system, called the Computer Assisted Teleoperation (CAT) has been developed at the Divertor Test Platform 2 (DTP2). In this paper, we investigate the design of the system and how the system integrates with the ITER compliant DTP2 prototype Remote Handling Control System (RHCS). We also experimentally assess the effect of the guidance to the operator performance in an ITER-relevant maintenance scenario using the Water Hydraulic MANipulator (WHMAN), which is specially designed for the divertor maintenance. The result of the experiment gives suggestive indication that the CAT system improves the performance of the operators of the system
Girod, Sabine; Schvartzman, Sara C; Gaudilliere, Dyani; Salisbury, Kenneth; Silva, Rebeka
Computer-assisted surgical (CAS) planning tools are available for craniofacial surgery, but are usually based on computer-aided design (CAD) tools that lack the ability to detect the collision of virtual objects (i.e., fractured bone segments). We developed a CAS system featuring a sense of touch (haptic) that enables surgeons to physically interact with individual, patient-specific anatomy and immerse in a three-dimensional virtual environment. In this study, we evaluated initial user experience with our novel system compared to an existing CAD system. Ten surgery resident trainees received a brief verbal introduction to both the haptic and CAD systems. Users simulated mandibular fracture reduction in three clinical cases within a 15 min time limit for each system and completed a questionnaire to assess their subjective experience. We compared standard landmarks and linear and angular measurements between the simulated results and the actual surgical outcome and found that haptic simulation results were not significantly different from actual postoperative outcomes. In contrast, CAD results significantly differed from both the haptic simulation and actual postoperative results. In addition to enabling a more accurate fracture repair, the haptic system provided a better user experience than the CAD system in terms of intuitiveness and self-reported quality of repair.
Holland, S.; Bouwer, A.J.; Dalgleish, M.; Hurtig, T.M.
This paper introduces a tool known as the Haptic Drum Kit, which employs four computer-controlled vibrotactile devices, one attached to each wrist and ankle. In the applications discussed here, haptic pulses are used to guide the playing, on a drum kit, of rhythmic patterns that require multi-limb
Rauter, Georg; Sigrist, Roland; Riener, Robert; Wolf, Peter
In literature, the effectiveness of haptics for motor learning is controversially discussed. Haptics is believed to be effective for motor learning in general; however, different types of haptic control enhance different movement aspects. Thus, in dependence on the movement aspects of interest, one type of haptic control may be effective whereas another one is not. Therefore, in the current work, it was investigated if and how different types of haptic controllers affect learning of spatial and temporal movement aspects. In particular, haptic controllers that enforce active participation of the participants were expected to improve spatial aspects. Only haptic controllers that provide feedback about the task's velocity profile were expected to improve temporal aspects. In a study on learning a complex trunk-arm rowing task, the effect of training with four different types of haptic control was investigated: position control, path control, adaptive path control, and reactive path control. A fifth group (control) trained with visual concurrent augmented feedback. As hypothesized, the position controller was most effective for learning of temporal movement aspects, while the path controller was most effective in teaching spatial movement aspects of the rowing task. Visual feedback was also effective for learning temporal and spatial movement aspects.
Beckers, Niek; Keemink, Arvid; van Asseldonk, Edwin; van der Kooij, Herman; Prattichizzo, Domenico; Shinoda, Hiroyuki; Tan, Hong Z.; Ruffaldi, Emanuele; Frisoli, Antonio
Humans have a natural ability to haptically interact with other humans, for instance during physically assisting a child to learn how to ride a bicycle. A recent study has shown that haptic human-human interaction can improve individual motor performance and motor learning rate while learning to
Purpura, Giulia; Cioni, Giovanni; Tinelli, Francesca
Object recognition is a long and complex adaptive process and its full maturation requires combination of many different sensory experiences as well as cognitive abilities to manipulate previous experiences in order to develop new percepts and subsequently to learn from the environment. It is well recognized that the transfer of visual and haptic information facilitates object recognition in adults, but less is known about development of this ability. In this study, we explored the developmental course of object recognition capacity in children using unimodal visual information, unimodal haptic information, and visuo-haptic information transfer in children from 4 years to 10 years and 11 months of age. Participants were tested through a clinical protocol, involving visual exploration of black-and-white photographs of common objects, haptic exploration of real objects, and visuo-haptic transfer of these two types of information. Results show an age-dependent development of object recognition abilities for visual, haptic, and visuo-haptic modalities. A significant effect of time on development of unimodal and crossmodal recognition skills was found. Moreover, our data suggest that multisensory processes for common object recognition are active at 4 years of age. They facilitate recognition of common objects, and, although not fully mature, are significant in adaptive behavior from the first years of age. The study of typical development of visuo-haptic processes in childhood is a starting point for future studies regarding object recognition in impaired populations.
Full Text Available Recent studies have evidenced an increasing interest in sex-related brain mechanisms and cerebral lateralization subserving emotional memory, language processing, and conversational behavior. We used event related potentials (ERP to examine the influence of sex and hemisphere on brain responses to emotional stimuli. Given that the P300 component of ERP is considered a cognitive neuroelectric phenomenon, we compared left and right hemisphere P300 responses to emotional stimuli in men and women. As indexed by both amplitude and latency measures, emotional stimuli elicited more robust P300 effects in the left hemisphere in women than in men, while a stronger P300 component was elicited in the right hemisphere in men compared to women. Our findings show that the variables of sex and hemisphere interacted significantly to influence the strength of the P300 component to the emotional stimuli. Emotional stimuli were also best recalled when given a long-term, incidental memory test, a fact potentially related to the differential P300 waves at encoding. Moreover, taking into account the sex-related differences in language processing and conversational behaviour, in the present study we evaluated possible talkativeness differences between the two genders in the recollection of emotional stimuli. Our data showed that women used a higher number of words, compared to men, to describe both arousal and neutral stories. Moreover, the present results support the view that sex differences in lateralization may not be a general feature of language processing but may be related to the specific condition, such as the emotional content of stimuli.
Fryer, Louise; Freeman, Jonathan; Pring, Linda
Since Köhler's experiments in the 1920s, researchers have demonstrated a correspondence between words and shapes. Dubbed the "Bouba-Kiki" effect, these auditory-visual associations extend across cultures and are thought to be universal. More recently the effect has been shown in other modalities including taste, suggesting the effect is independent of vision. The study presented here tested the "Bouba-Kiki" effect in the auditory-haptic modalities, using 2D cut-outs and 3D models based on Köhler's original drawings. Presented with shapes they could feel but not see, sighted participants showed a robust "Bouba-Kiki" effect. However, in a sample of people with a range of visual impairments, from congenital total blindness to partial sight, the effect was significantly less pronounced. The findings suggest that, in the absence of a direct visual stimulus, visual imagery plays a role in crossmodal integration. Copyright © 2014 Elsevier B.V. All rights reserved.
Kim, Young-Suk Grace
Purpose: The primary aim of the present study was to examine whether different ways of presenting narrative stimuli (i.e., live narrative stimuli versus audio-recorded narrative stimuli) influence children's performances on narrative comprehension and oral-retell quality. Method: Children in kindergarten (n = 54), second grade (n = 74), and fourth…
Yau, Jeffrey M; Kim, Sung Soo; Thakur, Pramodsingh H; Bensmaia, Sliman J
The tactile perception of the shape of objects critically guides our ability to interact with them. In this review, we describe how shape information is processed as it ascends the somatosensory neuraxis of primates. At the somatosensory periphery, spatial form is represented in the spatial patterns of activation evoked across populations of mechanoreceptive afferents. In the cerebral cortex, neurons respond selectively to particular spatial features, like orientation and curvature. While feature selectivity of neurons in the earlier processing stages can be understood in terms of linear receptive field models, higher order somatosensory neurons exhibit nonlinear response properties that result in tuning for more complex geometrical features. In fact, tactile shape processing bears remarkable analogies to its visual counterpart and the two may rely on shared neural circuitry. Furthermore, one of the unique aspects of primate somatosensation is that it contains a deformable sensory sheet. Because the relative positions of cutaneous mechanoreceptors depend on the conformation of the hand, the haptic perception of three-dimensional objects requires the integration of cutaneous and proprioceptive signals, an integration that is observed throughout somatosensory cortex. Copyright © 2016 the American Physiological Society.
Cabuk, Burak; Ceylan, Savas; Anik, Ihsan; Tugasaygi, Mehtap; Kizir, Selcuk
To determine the feasibility, advantages, and disadvantages of using a robot for holding and maneuvering the endoscope in transnasal transsphenoidal surgery. The system used in this study was a Stewart Platform based robotic system that was developed by Kocaeli University Department of Mechatronics Engineering for positioning and holding of endoscope. After the first use on an artificial head model, the system was used on six fresh postmortem bodies that were provided by the Morgue Specialization Department of the Forensic Medicine Institute (Istanbul, Turkey). The setup required for robotic system was easy, the time for registration procedure and setup of the robot takes 15 minutes. The resistance was felt on haptic arm in case of contact or friction with adjacent tissues. The adaptation process was shorter with the mouse to manipulate the endoscope. The endoscopic transsphenoidal approach was achieved with the robotic system. The endoscope was guided to the sphenoid ostium with the help of the robotic arm. This robotic system can be used in endoscopic transsphenoidal surgery as an endoscope positioner and holder. The robot is able to change the position easily with the help of an assistant and prevents tremor, and provides a better field of vision for work.
Erickson, David; Lacheray, Hervé; Daly, John
Of great interest to police and military organizations is the development of effective improvised explosive device (IED) disposal (IEDD) technology to aid in activities such as mine field clearing, and bomb disposal. At the same time minimizing risk to personnel. This paper presents new results in the research and development of a next generation mobile immersive teleoperated explosive ordnance disposal system. This system incorporates elements of 3D vision, multilateral teleoperation for high transparency haptic feedback, immersive augmented reality operator control interfaces, and a realistic hardware-in-the-loop (HIL) 3D simulation environment incorporating vehicle and manipulator dynamics for both operator training and algorithm development. In the past year, new algorithms have been developed to facilitate incorporating commercial off-the-shelf (COTS) robotic hardware into the teleoperation system. In particular, a real-time numerical inverse position kinematics algorithm that can be applied to a wide range of manipulators has been implemented, an inertial measurement unit (IMU) attitude stabilization system for manipulators has been developed and experimentally validated, and a voiceoperated manipulator control system has been developed and integrated into the operator control station. The integration of these components into a vehicle simulation environment with half-car vehicle dynamics has also been successfully carried out. A physical half-car plant is currently being constructed for HIL integration with the simulation environment.
Besse, Nadine; Rosset, Samuel; Zarate, Juan Jose; Ferrari, Elisabetta; Brayda, Luca; Shea, Herbert
We present a fully latching and scalable 4 × 4 haptic display with 4 mm pitch, 5 s refresh time, 400 mN holding force, and 650 μm displacement per taxel. The display serves to convey dynamic graphical information to blind and visually impaired users. Combining significant holding force with high taxel density and large amplitude motion in a very compact overall form factor was made possible by exploiting the reversible, fast, hundred-fold change in the stiffness of a thin shape memory polymer (SMP) membrane when heated above its glass transition temperature. Local heating is produced using an addressable array of 3 mm in diameter stretchable microheaters patterned on the SMP. Each taxel is selectively and independently actuated by synchronizing the local Joule heating with a single pressure supply. Switching off the heating locks each taxel into its position (up or down), enabling holding any array configuration with zero power consumption. A 3D-printed pin array is mounted over the SMP membrane, providing the user with a smooth and room temperature array of movable pins to explore by touch. Perception tests were carried out with 24 blind users resulting in 70 percent correct pattern recognition over a 12-word tactile dictionary.
Chan, Sonny; Li, Peter; Locketz, Garrett; Salisbury, Kenneth; Blevins, Nikolas H
Medical imaging techniques provide a wealth of information for surgical preparation, but it is still often the case that surgeons are examining three-dimensional pre-operative image data as a series of two-dimensional images. With recent advances in visual computing and interactive technologies, there is much opportunity to provide surgeons an ability to actively manipulate and interpret digital image data in a surgically meaningful way. This article describes the design and initial evaluation of a virtual surgical environment that supports patient-specific simulation of temporal bone surgery using pre-operative medical image data. Computational methods are presented that enable six degree-of-freedom haptic feedback during manipulation, and that simulate virtual dissection according to the mechanical principles of orthogonal cutting and abrasive wear. A highly efficient direct volume renderer simultaneously provides high-fidelity visual feedback during surgical manipulation of the virtual anatomy. The resulting virtual surgical environment was assessed by evaluating its ability to replicate findings in the operating room, using pre-operative imaging of the same patient. Correspondences between surgical exposure, anatomical features, and the locations of pathology were readily observed when comparing intra-operative video with the simulation, indicating the predictive ability of the virtual surgical environment.
Punpongsanon, Parinya; Iwai, Daisuke; Sato, Kosuke
We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects, i.e., surface deformation effect (SDE) and body appearance effect (BAE), on the basis of the observations of humans pushing physical objects. The SDE visualizes a two-dimensional deformation of the object surface with a controlled softness parameter, and BAE changes the color of the pushing hand. Through psychophysical experiments, we confirm that the SDE can manipulate softness perception such that the participant perceives significantly greater softness than the actual softness. Furthermore, fBAE, in which BAE is applied only for the finger area, significantly enhances manipulation of the perception of softness. We create a computational model that estimates perceived softness when SDE+fBAE is applied. We construct a prototype SoftAR system in which two application frameworks are implemented. The softness adjustment allows a user to adjust the softness parameter of a physical object, and the softness transfer allows the user to replace the softness with that of another object.
Yovanoff, Mary; Pepley, David; Mirkin, Katelin; Moore, Jason; Han, David; Miller, Scarlett
Virtual simulation is an emerging field in medical education. Research suggests that simulation reduces complication rates and improves learning gains for medical residents. One benefit of simulators is their allowance for more realistic and dynamic patient anatomies. While potentially useful throughout medical education, few studies have explored the impact of dynamic haptic simulators on medical training. In light of this research void, this study was developed to examine how a Dynamic-Haptic Robotic Trainer (DHRT) impacts medical student self-efficacy and skill gains compared to traditional simulators developed to train students in Internal Jugular Central Venous Catheter (IJ CVC) placement. The study was conducted with 18 third year medical students with no prior CVC insertion experience who underwent a pre-test, simulator training (manikin, robotic, or mixed) and post-test. The results revealed the DHRT as a useful method for training CVC skills and supports further research on dynamic haptic trainers in medical education.
Tossavainen, Timo; Juhola, Martti; Ilmari, Pyykö; Aalto, Heikki; Toppila, Esko
People relying much on vision in the control of posture are known to have an elevated risk of falling. Dependence on visual control is an important parameter in the diagnosis of balance disorders. We have previously shown that virtual reality methods can be used to produce visual stimuli that affect balance, but suitable stimuli need to be found. In this study the effect of six different virtual reality stimuli on the balance of 22 healthy test subjects was evaluated using force platform posturography. According to the tests two of the stimuli have a significant effect on balance.
Bernardi, L; Porta, C; Spicuzza, L; Sleight, P
Respiration is a powerful modulator of heart rate variability, and of baro- or chemo-reflex sensitivity. This occurs via a mechanical effect of breathing that synchronizes all cardiovascular variables at the respiratory rhythm, particularly when this occurs at a particular slow rate coincident with the Mayer waves in arterial pressure (approximately 6 cycles/min). Recitation of the rosary prayer (or of most mantras), induces a marked enhancement of these slow rhythms, whereas random verbalization or random breathing does not. This phenomenon in turn increases baroreflex sensitivity and reduces chemoreflex sensitivity, leading to increases in parasympathetic and reductions in sympathetic activity. The opposite can be seen during either verbalization or mental stress tests. Qualitatively similar effects can be obtained even by passive listening to more or less rhythmic auditory stimuli, such as music, and the speed of the rhythm (rather than the style) appears to be one of the main determinants of the cardiovascular and respiratory responses. These findings have clinical relevance. Appropriate modulation of breathing, can improve/restore autonomic control of cardiovascular and respiratory systems in relevant diseases such as hypertension and heart failure, and might therefore help improving exercise tolerance, quality of life, and ultimately, survival.
Robinson, Brent M; Elias, Lorin J
Repeated exposure of a nonreinforced stimulus results in an increased preference for that stimulus, the mere exposure effect. The present study repeatedly presented positive, negative, and neutrally affective faces to 48 participants while they made judgments about the emotional expression. Participants then rated the likeability of novel neutrally expressive faces and some of these previously presented faces, this time in their neutral expression. Faces originally presented as happy were rated as the most likeable, followed by faces originally presented as neutral. Negative and novel faces were not rated significantly differently from each other. These findings support the notion that the increase in preference towards repeatedly presented stimuli is the result of the reduction in negative affect, consistent with the modified two-factor uncertainty-reduction model and classical conditioning model of the mere exposure effect.
Sánchez, Jaime; de Borba Campos, Marcia; Espinoza, Matías; Merabet, Lotfi B
Interactive digital technologies are currently being developed as a novel tool for education and skill development. Audiopolis is an audio and haptic based videogame designed for developing orientation and mobility (O&M) skills in people who are blind. We have evaluated the cognitive impact of videogame play on O&M skills by assessing performance on a series of behavioral tasks carried out in both indoor and outdoor virtual spaces. Our results demonstrate that the use of Audiopolis had a positive impact on the development and use of O&M skills in school-aged learners who are blind. The impact of audio and haptic information on learning is also discussed.
Mazzoli, Alida; Germani, Michele; Raffaeli, Roberto
Repairing critical human skull injuries requires the production and use of customized cranial implants and involves the integration of computer aided design and manufacturing (CAD and CAM). The main causes for large cranial defects are trauma, cranial tumors, infected craniotomy bone flaps and external neurosurgical decompression. The success of reconstructive cranial surgery depends upon: the preoperative evaluation of the defect, the design and manufacturing of the implant, and the skill of the operating surgeon. Cranial implant design is usually carried out manually using CAD although this process is very time-consuming and the quality of the end product depends wholly upon the skill of the operator. This paper presents an alternative automated method for the design of custom-made cranial plates in a PHANToM ® -based haptic environment, and their direct fabrication in biocompatible metal using electron beam melting (EBM) technology.
Full Text Available Robot based therapy is one of the prevalent therapeutic approaches in motor stroke rehabilitation. It is often used in hospitals in combination with conventional therapy. In order to optimize human-robot interaction, we aim to investigate how a therapist physically supports patients during motor training of the upper extremities. This paper presents the design of a flexible textile sensor matrix, which measures the pressure exerted between therapist and patient during direct haptic interaction as well as the hand position and orientation in space. The matrix contains 144 sensors which enables measuring pressure intensity and localization of areas where the pressure is applied. The measurement matrix was evaluated with four healthy participants.
Simonnet, Mathieu; Jacobson, Dan; Vieilledent, Stephane; Tisseau, Jacques
Navigating consists of coordinating egocentric and allocentric spatial frames of reference. Virtual environments have afforded researchers in the spatial community with tools to investigate the learning of space. The issue of the transfer between virtual and real situations is not trivial. A central question is the role of frames of reference in mediating spatial knowledge transfer to external surroundings, as is the effect of different sensory modalities accessed in simulated and real worlds. This challenges the capacity of blind people to use virtual reality to explore a scene without graphics. The present experiment involves a haptic and auditory maritime virtual environment. In triangulation tasks, we measure systematic errors and preliminary results show an ability to learn configurational knowledge and to navigate through it without vision. Subjects appeared to take advantage of getting lost in an egocentric “haptic” view in the virtual environment to improve performances in the real environment.
Full Text Available Haptic cues are important for balance. Knowledge of the temporal features of their effect may be crucial for the design of neural prostheses. Touching a stable surface with a fingertip reduces body sway in standing subjects eyes closed (EC, and removal of haptic cue reinstates a large sway pattern. Changes in sway occur rapidly on changing haptic conditions. Here, we describe the effects and time-course of stabilization produced by a haptic cue derived from a walking cane. We intended to confirm that cane use reduces body sway, to evaluate the effect of vision on stabilization by a cane, and to estimate the delay of the changes in body sway after addition and withdrawal of haptic input. Seventeen healthy young subjects stood in tandem position on a force platform, with eyes closed or open (EO. They gently lowered the cane onto and lifted it from a second force platform. Sixty trials per direction of haptic shift (Touch → NoTouch, T-NT; NoTouch → Touch, NT-T and visual condition (EC-EO were acquired. Traces of Center of foot Pressure (CoP and the force exerted by cane were filtered, rectified, and averaged. The position in space of a reflective marker positioned on the cane tip was also acquired by an optoelectronic device. Cross-correlation (CC analysis was performed between traces of cane tip and CoP displacement. Latencies of changes in CoP oscillation in the frontal plane EC following the T-NT and NT-T haptic shift were statistically estimated. The CoP oscillations were larger in EC than EO under both T and NT (p < 0.001 and larger during NT than T conditions (p < 0.001. Haptic-induced effect under EC (Romberg quotient NT/T ~ 1.2 was less effective than that of vision under NT condition (EC/EO ~ 1.5 (p < 0.001. With EO cane had little effect. Cane displacement lagged CoP displacement under both EC and EO. Latencies to changes in CoP oscillations were longer after addition (NT-T, about 1.6 s than withdrawal (T-NT, about 0.9 s of haptic
Beaver, John D; Mogg, Karin; Bradley, Brendan P
Two studies investigated the effects of conditioning to masked stimuli on visuospatial attention. During the conditioning phase, masked snakes and spiders were paired with a burst of white noise, or paired with an innocuous tone, in the conditioned stimulus (CS)+ and CS- conditions, respectively. Attentional allocation to the CSs was then assessed with a visual probe task, in which the CSs were presented unmasked (Experiment 1) or both unmasked and masked (Experiment 2), together with fear-irrelevant control stimuli (flowers and mushrooms). In Experiment 1, participants preferentially allocated attention to CS+ relative to control stimuli. Experiment 2 suggested that this attentional bias depended on the perceived aversiveness of the unconditioned stimulus and did not require conscious recognition of the CSs during both acquisition and expression. Copyright 2005 APA, all rights reserved.
Li, Song; Li, Wengang; Khashab, Niveen M.
applications. Stimuli-responsive nanomaterials guarantee the controlled release of cargo to a given location, at a specific time, and with an accurate amount. In this review, we have combined the major stimuli that are currently used to achieve the ultimate
Deltomme, Berre; Mertens, G.; Tibboel, Helen; Braem, Senne
We investigated whether stimuli merely instructed to be fear-relevant can bias visual attention, even when the fear relation was never experienced before. Participants performed a dot-probe task with pictures of naturally fear-relevant (snake or spider) or -irrelevant (bird or butterfly) stimuli.
Aoyama, Yasuhiro; Uchida, Hiroyuki; Sugi, Yasuyuki; Kawakami, Akinobu; Fujii, Miki; Kiso, Kanae; Kono, Ryota; Takebayashi, Takashi; Hirao, Kazuki
Abstract Background: Information received subconsciously can influence exercise performance; however, it remains unclear whether subliminal or supraliminal reward is more effective in improving standing balance ability when priming stimuli are subconsciously delivered. The present study aimed to compare the effects of subliminal priming-plus-subliminal reward stimuli (experimental) with subliminal priming-plus-supraliminal reward stimuli (control) on standing balance ability. Methods: This wa...
Sakaki, Michiko; Niki, N.; Mather, M.
The present study addressed the hypothesis that emotional stimuli relevant to survival or reproduction (biologically emotional stimuli) automatically affect cognitive processing (e.g., attention, memory), while those relevant to social life (socially emotional stimuli) require elaborative processing to modulate attention and memory. Results of our behavioral studies showed that (1) biologically emotional images hold attention more strongly than do socially emotional images, (2) memory for bio...
Kuhn, David E.; DeLeon, Iser G.; Terlonge, Cindy; Goysovich, Richard
Stimulus preference assessments for individuals with developmental disabilities typically involve offering choices among stimuli and providing immediate access to the chosen stimuli. Several researchers have explored the utility of presenting choices verbally, thereby obviating the need to present the choices in tangible form and deliver access to…
Hemanth N. Shetty
Full Text Available The objective of this study was to investigate the effect of stimuli, transducers and gender on the latency and amplitude of acoustic change complex (ACC. ACC is a multiple overlapping P1-N1-P2 complex reflecting acoustic changes across the entire stimulus. Fifteen males and 15 females, in the age range of 18 to 25 (mean=21.67 years, having normal hearing participated in the study. The ACC was recorded using the vertical montage. The naturally produced stimuli /sa/ and /si/ were presented through the insert earphone/loud speaker to record the ACC. The ACC obtained from different stimuli presented through different transducers from male/female participants were analyzed using mixed analysis of variance. Dependent t-test and independent t-test were performed when indicated. There was a significant difference in latency of 2N1 at the transition, with latency for /sa/ being earlier; but not at the onset portions of ACC. There was no significant difference in amplitude of ACC between the stimuli. Among the transducers, there was no significant difference in latency and amplitude of ACC, for both /sa/ and /si/ stimuli. Female participants showed earlier latency for 2N1 and larger amplitude of N1 and 2P2 than male participants, which was significant. ACC provides important insight in detecting the subtle spectral changes in each stimulus. Among the transducers, no difference in ACC was noted as the spectra of stimuli delivered were within the frequency response of the transducers. The earlier 2N1 latency and larger N1 and 2P2 amplitudes noticed in female participants could be due to smaller head circumference. The findings of this study will be useful in determining the capacity of the auditory pathway in detecting subtle spectral changes in the stimulus at the level of the auditory cortex.
Koster, W.G.; Schuur, van R.
In experiments in which stimuli are presented closely spaced in time, subjects exhibit a limitation in the transmission of the signals. The result is either a delayed response or a less accurate response. This phenomenon has been called the psychological refractory phase (Telford, 1931). It is
Yang, Weiping; Li, Qi; Ochi, Tatsuya; Yang, Jingjing; Gao, Yulin; Tang, Xiaoyu; Takahashi, Satoshi; Wu, Jinglong
This article aims to investigate whether auditory stimuli in the horizontal plane, particularly originating from behind the participant, affect audiovisual integration by using behavioral and event-related potential (ERP) measurements. In this study, visual stimuli were presented directly in front of the participants, auditory stimuli were presented at one location in an equidistant horizontal plane at the front (0°, the fixation point), right (90°), back (180°), or left (270°) of the participants, and audiovisual stimuli that include both visual stimuli and auditory stimuli originating from one of the four locations were simultaneously presented. These stimuli were presented randomly with equal probability; during this time, participants were asked to attend to the visual stimulus and respond promptly only to visual target stimuli (a unimodal visual target stimulus and the visual target of the audiovisual stimulus). A significant facilitation of reaction times and hit rates was obtained following audiovisual stimulation, irrespective of whether the auditory stimuli were presented in the front or back of the participant. However, no significant interactions were found between visual stimuli and auditory stimuli from the right or left. Two main ERP components related to audiovisual integration were found: first, auditory stimuli from the front location produced an ERP reaction over the right temporal area and right occipital area at approximately 160-200 milliseconds; second, auditory stimuli from the back produced a reaction over the parietal and occipital areas at approximately 360-400 milliseconds. Our results confirmed that audiovisual integration was also elicited, even though auditory stimuli were presented behind the participant, but no integration occurred when auditory stimuli were presented in the right or left spaces, suggesting that the human brain might be particularly sensitive to information received from behind than both sides.
Luo, Shuwei; Luo, Wenbo; He, Weiqi; Chen, Xu; Luo, Yuejia
This study used event-related potentials to investigate the sensitivity of P1 and N170 components to human-like and animal-like makeup stimuli, which were derived from pictures of Peking opera characters. As predicted, human-like makeup stimuli elicited larger P1 and N170 amplitudes than did animal-like makeup stimuli. Interestingly, a right hemisphere advantage was observed for human-like but not for animal-like makeup stimuli. Dipole source analyses of 130-200-ms window showed that the bilateral fusiform face area may contribute to the differential sensitivity of the N170 component in response to human-like and animal-like makeup stimuli. The present study suggests that the amplitudes of both the P1 and the N170 are sensitive for the mouth component of face-like stimuli.
distributions of response times for the single-modality stimuli. It has been derived for synchronous stimuli and for stimuli with stimulus onset asynchrony (SOA). In most experiments with asynchronous stimuli, discrete SOA values are chosen and the race model inequality is separately tested for each SOA. Due...... to SOAs at which the violation of the race model prediction is expected to be large. In addition, the method enables data analysis for experiments in which stimuli are presented with SOA from a continuous distribution rather than in discrete steps.......In speeded response tasks with redundant signals, parallel processing of the signals is tested by the race model inequality. This inequality states that given a race of two signals, the cumulative distribution of response times for redundant stimuli never exceeds the sum of the cumulative...
Civelek, Turhan; Ucar, Erdem; Ustunel, Hakan; Aydin, Mehmet Kemal
The current research aims to explore the effects of a haptic augmented simulation on students' achievement and their attitudes towards Physics in an immersive virtual reality environment (VRE). A quasi-experimental post-test design was employed utilizing experiment and control groups. The participants were 215 students from a K-12 school in…
van Mier, Hanneke I
When making two bars haptically parallel to each other, large deviations have been observed, most likely caused by the bias of a hand-centered egocentric reference frame. A consistent finding is that women show significantly larger deviations than men when performing this task. It has been suggested that this difference might be due to the fact that women are more egocentrically oriented than men or are less efficient in overcoming the egocentric bias of the hand. If this is indeed the case, reducing the bias of the egocentric reference frame should eliminate the above-mentioned gender difference. This was investigated in the current study. Sixty participants (30 men, 30 women) were instructed to haptically match (task HP) the orientation of a test bar with the dominant hand to the orientation of a reference bar that was perceived with the non-dominant hand. In a haptic visual task (task HV), in which only the reference bar and exploring hand were out of view, no motor response was required, but participants had to "match" the perceived orientation by verbally naming the parallel orientation that was read out on a test protractor. Both females and males performed better in the HV task than in the HP task. Significant gender effects were only found in the haptic parallelity task (HP), corroborating the idea that women perform at the same level as men when the egocentric bias of the hand is reduced.
This survey provides an overview of work on haptic technology for social touch. Social touch has been studied extensively in psychology and neuroscience. With the development of new technologies, it is now possible to engage in social touch at a distance or engage in social touch with artificial
Overvliet, Krista E.; Krampe, Ralf Th
We investigated the influence of image mediation (the process that translates tactile information into a visual image) on the development of haptic two-dimensional (2D) shape identification in 78 participants from five different age groups: preschoolers (4–5 years), first graders (6–7 years), fifth
... INTERNATIONAL TRADE COMMISSION [Investigation No. 337-TA-834] Certain Mobile Electronic Devices Incorporating Haptics; Institution of Investigation Pursuant to 19 U.S.C. 1337 AGENCY: U.S. International Trade.... International Trade Commission on February 7, 2012, and an amended complaint was filed with the U.S...
Kuhne, Markus; Eschelbach, Martin; Aghaeifar, Ali
Functional magnetic resonance imaging (fMRI) is a powerful tool for neuroscience. It allows the visualization of active areas in the human brain. Combining this method with haptic interfaces allows one to conduct human motor control studies with an opportunity for standardized experimental...
Huang, Shih-Chieh Douglas
In this dissertation, I investigate the effects of a grounded learning experience on college students' mental models of physics systems. The grounded learning experience consisted of a priming stage and an instruction stage, and within each stage, one of two different types of visuo-haptic representation was applied: visuo-gestural simulation…
Ellis, R R; Lederman, S J
Three experiments establish the size-weight illusion as a primarily haptic phenomenon, despite its having been more traditionally considered an example of vision influencing haptic processing. Experiment 1 documents, across a broad range of stimulus weights and volumes, the existence of a purely haptic size-weight illusion, equal in strength to the traditional illusion. Experiment 2 demonstrates that haptic volume cues are both sufficient and necessary for a full-strength illusion. In contrast, visual volume cues are merely sufficient, and produce a relatively weaker effect. Experiment 3 establishes that congenitally blind subjects experience an effect as powerful as that of blindfolded sighted observers, thus demonstrating that visual imagery is also unnecessary for a robust size-weight illusion. The results are discussed in terms of their implications for both sensory and cognitive theories of the size-weight illusion. Applications of this work to a human factors design and to sensor-based systems for robotic manipulation are also briefly considered.
Kesner, Samuel B; Howe, Robert D
Catheter devices allow physicians to access the inside of the human body easily and painlessly through natural orifices and vessels. Although catheters allow for the delivery of fluids and drugs, the deployment of devices, and the acquisition of the measurements, they do not allow clinicians to assess the physical properties of tissue inside the body due to the tissue motion and transmission limitations of the catheter devices, including compliance, friction, and backlash. The goal of this research is to increase the tactile information available to physicians during catheter procedures by providing haptic feedback during palpation procedures. To accomplish this goal, we have developed the first motion compensated actuated catheter system that enables haptic perception of fast moving tissue structures. The actuated catheter is instrumented with a distal tip force sensor and a force feedback interface that allows users to adjust the position of the catheter while experiencing the forces on the catheter tip. The efficacy of this device and interface is evaluated through a psychophyisical study comparing how accurately users can differentiate various materials attached to a cardiac motion simulator using the haptic device and a conventional manual catheter. The results demonstrate that haptics improves a user's ability to differentiate material properties and decreases the total number of errors by 50% over the manual catheter system.
Oosterhout, J. van; Abbink, D.A.; Koning, J.F.; Boessenkool, H.; Wildenbeest, J.G.W.; Heemskerk, C.J.M.
Highlights: Haptic shared control is generally based upon perfect environment information. A realistic implementation holds model errors with respect to the environment. Operators were aided with inaccurate guiding forces during a peg-in-hole task. The results showed that small guiding inaccuracies still aid the operator. -- Abstract: A promising solution to improve task performance in ITER hot cell remote handling is the use of haptic shared control. Haptic shared control can assist the human operator along a safe and optimal path with continuous guiding forces from an intelligent autonomous controller. Previous research tested such controllers with accurate knowledge of the environment (giving flawless guiding forces), while in a practical implementation guidance forces will sometimes be flawed due to inaccurate models or sensor information. This research investigated the effect of zero and small (7.5 mm) errors on task performance compared to normal (unguided) operation. In a human factors experiment subjects performed a three dimensional virtual reality peg-in-hole type task (30 mm diameter; 0.1 mm clearance), with and without potentially flawed haptic shared control. The results showed that the presence of guiding forces, despite of small guiding errors, still improved task performance with respect to unguided operations
Estevez Castillo, P.
Haptic teleoperation is a promising approach for dealing with the manipulation of micro-objects, fabricated in small series or as prototypes, and in processes which are novel or uncertain. Human operators provide their ability to plan, understand and react when faced with unexpected situations
Woo, Jaehong; Choi, Jae Hyuk; Seo, Jong Tae; Kim, Tae Il; Yi, Byung Ju
Colonoscopy is one of the most effective diagnostic and therapeutic tools for colorectal diseases. We aim to propose a master-slave robotic colonoscopy that is controllable in remote site using conventional colonoscopy. The master and slave robot were developed to use conventional flexible colonoscopy. The robotic colonoscopic procedure was performed using a colonoscope training model by one expert endoscopist and two unexperienced engineers. To provide the haptic sensation, the insertion force and the rotating torque were measured and sent to the master robot. A slave robot was developed to hold the colonoscopy and its knob, and perform insertion, rotation, and two tilting motions of colonoscope. A master robot was designed to teach motions of the slave robot. These measured force and torque were scaled down by one tenth to provide the operator with some reflection force and torque at the haptic device. The haptic sensation and feedback system was successful and helpful to feel the constrained force or torque in colon. The insertion time using robotic system decreased with repeated procedures. This work proposed a robotic approach for colonoscopy using haptic feedback algorithm, and this robotic device would effectively perform colonoscopy with reduced burden and comparable safety for patients in remote site.
Lee, Sang-Rock; Choi, Seung-Hyun; Choi, Seung-Bok; Cho, Myeong-Woo
This paper describes how to make an operator feel the desired repulsive force in a haptic system. When an operator manipulates a haptic system, the repulsive force of the operator varies significantly, depending on many factors such as position, velocity and force. In order to reflect the desired repulsive force to the operator, it is commonly known that a haptic system must compensate for irregularly changing forces. The irregularity of the forces, however, has discouraged many researchers from establishing a clear principle on how to make the operator feel the desired repulsive force. To resolve this problem, we introduce a smart haptic framework that can reflect the desired repulsive force to the operator, regardless of the operator’s movement. A dummy governing equation technique is introduced and used to calculate the proper actuating force in real time. The actuating force is generated by a PID controller. To verify the proposed method, a mathematical proof is offered to show that the repulsive force converges to the desired repulsive force. Additionally, to demonstrate the performance of the proposed method, simulational and experimental tests are implemented. (paper)
. Control inputs for both subtasks are provided by the human. The inputs are projected onto the space of subtasks using a forward mapping strategy. Measured wrenches are projected onto the feedback signals provided to the human via wearable fingertip haptic devices through a feedback mapping strategy...
Ellerbroek, J.; Rodriguez Martin, M.J.M.; Lombaerts, T; van Paassen, M.M.; Mulder, M.
This paper describes the design and evaluation of a shared control, haptic feedback system to communicate Flight Envelope Protection System intent. The concept uses a combination of stiffness feedback and vibration to communicate proximity of the aircraft state to flight envelope boundaries. In
Nguyen, Q H; Choi, S B; Lee, Y S; Han, M S
In this research work, a new configuration of a 3D haptic gripper for telemanipulation is proposed and optimally designed. The proposed haptic gripper, featuring three magnetorheological fluid brakes (MRBs), reflects the rolling torque, the grasping force and the approach force from the slave manipulator to the master operator. After describing the operational principle of the haptic gripper, an optimal design of the MRBs for the gripper is performed. The purpose of the optimization problem is to find the most compact MRB that can provide a required braking torque/force to the master operator while the off-state torque/force is kept as small as possible. In the optimal design, different types of MRBs and different MR fluids (MRFs) are considered. In order to obtain the optimal solution of the MRBs, an optimization approach based on finite element analysis (FEA) integrated with an optimization tool is used. The optimal solutions of the MRBs are then obtained and the optimized MRBs for the haptic gripper are identified. In addition, discussions on the optimal solutions and performance of the optimized MRBs are given. (paper)
Alaraj, Ali; Luciano, Cristian J; Bailey, Daniel P; Elsenousi, Abdussalam; Roitberg, Ben Z; Bernardo, Antonio; Banerjee, P Pat; Charbel, Fady T
With the decrease in the number of cerebral aneurysms treated surgically and the increase of complexity of those treated surgically, there is a need for simulation-based tools to teach future neurosurgeons the operative techniques of aneurysm clipping. To develop and evaluate the usefulness of a new haptic-based virtual reality simulator in the training of neurosurgical residents. A real-time sensory haptic feedback virtual reality aneurysm clipping simulator was developed using the ImmersiveTouch platform. A prototype middle cerebral artery aneurysm simulation was created from a computed tomographic angiogram. Aneurysm and vessel volume deformation and haptic feedback are provided in a 3-dimensional immersive virtual reality environment. Intraoperative aneurysm rupture was also simulated. Seventeen neurosurgery residents from 3 residency programs tested the simulator and provided feedback on its usefulness and resemblance to real aneurysm clipping surgery. Residents thought that the simulation would be useful in preparing for real-life surgery. About two-thirds of the residents thought that the 3-dimensional immersive anatomic details provided a close resemblance to real operative anatomy and accurate guidance for deciding surgical approaches. They thought the simulation was useful for preoperative surgical rehearsal and neurosurgical training. A third of the residents thought that the technology in its current form provided realistic haptic feedback for aneurysm surgery. Neurosurgical residents thought that the novel immersive VR simulator is helpful in their training, especially because they do not get a chance to perform aneurysm clippings until late in their residency programs.
Oosterhout, J. van, E-mail: J.vanOosterhout@differ.nl [Delft University of Technology, Faculty of 3mE, BioMechanical Engineering Department, Mekelweg 2, 2628 CD Delft (Netherlands); Abbink, D.A. [Delft University of Technology, Faculty of 3mE, BioMechanical Engineering Department, Mekelweg 2, 2628 CD Delft (Netherlands); Koning, J.F. [Heemskerk Innovative Technology B.V., Jonckerweg 12, 2201 DZ Noordwijk (Netherlands); Boessenkool, H. [FOM Institute DIFFER (Dutch Institute for Fundamental Energy Research), Association EURATOM-FOM, Partner in the Trilateral Euregio Cluster, PO Box 1207, 3430 BE Nieuwegein (Netherlands); Wildenbeest, J.G.W. [Delft University of Technology, Faculty of 3mE, BioMechanical Engineering Department, Mekelweg 2, 2628 CD Delft (Netherlands); Heemskerk Innovative Technology B.V., Jonckerweg 12, 2201 DZ Noordwijk (Netherlands); Heemskerk, C.J.M. [Heemskerk Innovative Technology B.V., Jonckerweg 12, 2201 DZ Noordwijk (Netherlands)
Highlights: Haptic shared control is generally based upon perfect environment information. A realistic implementation holds model errors with respect to the environment. Operators were aided with inaccurate guiding forces during a peg-in-hole task. The results showed that small guiding inaccuracies still aid the operator. -- Abstract: A promising solution to improve task performance in ITER hot cell remote handling is the use of haptic shared control. Haptic shared control can assist the human operator along a safe and optimal path with continuous guiding forces from an intelligent autonomous controller. Previous research tested such controllers with accurate knowledge of the environment (giving flawless guiding forces), while in a practical implementation guidance forces will sometimes be flawed due to inaccurate models or sensor information. This research investigated the effect of zero and small (7.5 mm) errors on task performance compared to normal (unguided) operation. In a human factors experiment subjects performed a three dimensional virtual reality peg-in-hole type task (30 mm diameter; 0.1 mm clearance), with and without potentially flawed haptic shared control. The results showed that the presence of guiding forces, despite of small guiding errors, still improved task performance with respect to unguided operations.
Mersha, A.Y.; Stramigioli, Stefano; Carloni, Raffaella
This paper deals with the bilateral teleoperation of underactuated aerial robots by means of a haptic interface. In particular, we propose a switching-based state mapping and control algorithm between a rate-based passive controller, which addresses the workspace incompatibility between the master
Boer, Laurens; Vallgårda, Anna; Cahill, Ben
The Hedonic Haptics player is a portable wearable device that plays back vibrotactile compositions. It consists of three domes each of which houses a vibration motor providing vibrotactile sensations to the wearer. The domes are connected to a control unit the size of a small Walkman. The Hedonic...
Woo, Jaehong; Choi, Jae Hyuk; Seo, Jong Tae
Purpose Colonoscopy is one of the most effective diagnostic and therapeutic tools for colorectal diseases. We aim to propose a master-slave robotic colonoscopy that is controllable in remote site using conventional colonoscopy. Materials and Methods The master and slave robot were developed to use conventional flexible colonoscopy. The robotic colonoscopic procedure was performed using a colonoscope training model by one expert endoscopist and two unexperienced engineers. To provide the haptic sensation, the insertion force and the rotating torque were measured and sent to the master robot. Results A slave robot was developed to hold the colonoscopy and its knob, and perform insertion, rotation, and two tilting motions of colonoscope. A master robot was designed to teach motions of the slave robot. These measured force and torque were scaled down by one tenth to provide the operator with some reflection force and torque at the haptic device. The haptic sensation and feedback system was successful and helpful to feel the constrained force or torque in colon. The insertion time using robotic system decreased with repeated procedures. Conclusion This work proposed a robotic approach for colonoscopy using haptic feedback algorithm, and this robotic device would effectively perform colonoscopy with reduced burden and comparable safety for patients in remote site. PMID:27873506
... INTERNATIONAL TRADE COMMISSION [Investigation No. 337-TA-834] Certain Mobile Electronic Devices.... 1337 in the importation, sale for importation, and sale within the United States after importation of certain mobile electronic devices incorporating haptics, by reason of the infringement of claims of six...
... INTERNATIONAL TRADE COMMISSION [Investigation No. 337-TA-834] Certain Mobile Electronic Devices... the importation, sale for importation, and sale within the United States after importation of certain mobile electronic devices incorporating haptics that infringe certain claims of six Immersion patents. 77...
This study pilot-tested a new application of a technology-based intervention to increase seat belt use. The technology was based on a : contingency in which unbelted drivers experienced sustained haptic feedback to the gas pedal when they exceeded 25...
Heller, Morton A.; Kappers, Astrid M L; McCarthy, Melissa; Clark, Ashley; Riddle, Tara; Fulkerson, Erin; Wemple, Lindsay; Walk, Anne McClure; Basso, Andreana; Wanek, Crystal; Russler, Kristen
A series of experiments was carried out to examine the effect of curvature on haptic judgments of extent in sighted and blind individuals. Experiment 1 showed that diameters connecting the endpoints of semicircular lines were underestimated with respect to straight lines, but failed to show an
Turchet, Luca; Nordahl, Rolf; Serafin, Stefania
We describe a system which simulates in realtime the auditory and haptic sensations of walking on different surfaces. The system is based on a pair of sandals enhanced with pressure sensors and actuators. The pressure sensors detect the interaction force during walking, and control several...
This article provides a synthesis of literature pertaining to the development of haptic exploratory strategies in children who have visual impairment and intellectual disabilities. The information received through such strategies assumes particular significance for these children, given the restricted information available through their visual…
Joan De Boeck
Full Text Available Force feedback has proven to be beneficial in the domain of robot-assisted rehabilitation. According to the patients' personal needs, the generated forces may either be used to assist, support, or oppose their movements. In our current research project, we focus onto the upper limb training for MS (multiple sclerosis and CVA (cerebrovascular accident patients, in which a basic building block to implement many rehabilitation exercises was found. This building block is a haptic linear path: a second-order continuous path, defined by a list of points in space. Earlier, different attempts have been investigated to realize haptic linear paths. In order to have a good training quality, it is important that the haptic simulation is continuous up to the second derivative while the patient is enforced to follow the path tightly, even when low or no guiding forces are provided. In this paper, we describe our best solution to these haptic linear paths, discuss the weaknesses found in practice, and propose and validate an improvement.
Neimeijer, Renate A M; Roefs, Anne; de Jong, Peter J
The present study was designed to test the hypothesis that anorexia nervosa (AN) patients are relatively insensitive to the attentional capture of visual food stimuli. Attentional avoidance of food might help AN patients to prevent more elaborate processing of food stimuli and the subsequent generation of craving, which might enable AN patients to maintain their strict diet. Participants were 66 restrictive AN spectrum patients and 55 healthy controls. A single-target rapid serial visual presentation task was used with food and disorder-neutral cues as critical distracter stimuli and disorder-neutral pictures as target stimuli. AN spectrum patients showed diminished task performance when visual food cues were presented in close temporal proximity of the to-be-identified target. In contrast to our hypothesis, results indicate that food cues automatically capture AN spectrum patients' attention. One explanation could be that the enhanced attentional capture of food cues in AN is driven by the relatively high threat value of food items in AN. Implications and suggestions for future research are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
We are currently developing an artificial arm/hand system which is capable of sensing stimuli and then transferring these stimuli to users as somatic sensations. Presently, we are evoking the virtual somatic sensations by electrically stimulating a sensory nerve fiber which innervates a single mechanoreceptor unit at the target area; this is done using a tungsten microelectrode that was percutaneously inserted into the use's peripheral nerve (a microstimulation method). The artificial arm/hand system is composed of a robot hand equipped with a pressure sensor system on its fingers. The sensor system detects mechanical stimuli, which are transferred to the user by means of the microstimulation method so that the user experiences the stimuli as the corresponding somatic sensations. In trials, the system worked satisfactorily and there was a good correlation between the pressure applied to the pressure sensors on the robot fingers and the subjective intensities of the evoked pressure sensations.
Van Mier, Hanneke I
Research has revealed that haptic perception of parallelity deviates from physical reality. Large and systematic deviations have been found in haptic parallelity matching most likely due to the influence of the hand-centered egocentric reference frame. Providing information that increases the influence of allocentric processing has been shown to improve performance on haptic matching. In this study allocentric processing was stimulated by providing informative vision in haptic matching tasks that were performed using hand- and arm-centered reference frames. Twenty blindfolded participants (ten men, ten women) explored the orientation of a reference bar with the non-dominant hand and subsequently matched (task HP) or mirrored (task HM) its orientation on a test bar with the dominant hand. Visual information was provided by means of informative vision with participants having full view of the test bar, while the reference bar was blocked from their view (task VHP). To decrease the egocentric bias of the hands, participants also performed a visual haptic parallelity drawing task (task VHPD) using an arm-centered reference frame, by drawing the orientation of the reference bar. In all tasks, the distance between and orientation of the bars were manipulated. A significant effect of task was found; performance improved from task HP, to VHP to VHPD, and HM. Significant effects of distance were found in the first three tasks, whereas orientation and gender effects were only significant in tasks HP and VHP. The results showed that stimulating allocentric processing by means of informative vision and reducing the egocentric bias by using an arm-centered reference frame led to most accurate performance on parallelity matching. © 2013 Elsevier B.V. All rights reserved.
Nappi, Michele; Paolino, Luca; Ricciardi, Stefano; Sebillo, Monica; Vitiello, Giuliana
Aerospace industry has been involved in virtual simulation for design and testing since the birth of virtual reality. Today this industry is showing a growing interest in the development of haptic-based maintenance training applications, which represent the most advanced way to simulate maintenance and repair tasks within a virtual environment by means of a visual-haptic approach. The goal is to allow the trainee to experiment the service procedures not only as a workflow reproduced at a visual level but also in terms of the kinaesthetic feedback involved with the manipulation of tools and components. This study, conducted in collaboration with aerospace industry specialists, is aimed to the development of an immersive virtual capable of immerging the trainees into a virtual environment where mechanics and technicians can perform maintenance simulation or training tasks by directly manipulating 3D virtual models of aircraft parts while perceiving force feedback through the haptic interface. The proposed system is based on ViRstperson, a virtual reality engine under development at the Italian Center for Aerospace Research (CIRA) to support engineering and technical activities such as design-time maintenance procedure validation, and maintenance training. This engine has been extended to support haptic-based interaction, enabling a more complete level of interaction, also in terms of impedance control, and thus fostering the development of haptic knowledge in the user. The user’s “sense of touch” within the immersive virtual environment is simulated through an Immersion CyberForce® hand-based force-feedback device. Preliminary testing of the proposed system seems encouraging.
Yang, Tae-Heon; Koo, Jeong-Hoi; Kim, Sang-Youn; Kwon, Dong-Soo
Haptic display units have been widely used for conveying button sensations to users, primarily employing vibrotactile actuators. However, the human feeling for pressing buttons mainly relies on kinaesthetic sensations (rather than vibrotactile sensations), and little studies exist on small-scale kinaesthetic haptic units. Thus, the primary goals of this paper are to design a miniature kinaesthetic actuator based on Magneto-Rheological (MR) fluid that can convey various button-clicking sensations and to experimentally evaluate its haptic performance. The design focuses of the proposed actuator were to produce sufficiently large actuation forces (resistive forces) for human users in a given size constraint and to offer a wide range of actuation forces for conveying vivid haptic sensations to users. To this end, this study first performed a series of parametric studies using mathematical force models for multiple operating modes of MR fluid in conjunction with finite element electromagnetism analysis. After selecting design parameters based on parametric studies, a prototype actuator was constructed, and its performance was evaluated using a dynamic mechanical analyzer. It measured the actuator's resistive force with a varying stroke (pressed depth) up to 1 mm and a varying input current from 0 A to 200 mA. The results show that the proposed actuator creates a wide range of resistive forces from around 2 N (off-state) to over 9.5 N at 200 mA. In order to assess the prototype's performance in the terms of the haptic application prospective, a maximum force rate was calculated to determine just noticeable difference in force changes for the 1 mm stoke of the actuator. The results show that the force rate is sufficient to mimic various levels of button sensations, indicating that the proposed kinaesthetic actuator can offer a wide range of resistive force changes that can be conveyed to human operators.
National Aeronautics and Space Administration — Supramolecular polymers based on non-covalent interactions can display a wide array of stimuli-responsive attributes. They can be tailored to change shape, actuate...
Adams, Russell J.; And Others
Two experiments assessed the extent of newborns' ability to discriminate color. Results imply that newborns have some, albeit limited, capacity to discriminate chromatic from achromatic stimuli, and hence, are at least dichromats. (Author/DR)
Faulkender, Patricia J.; And Others
An evaluation of selective generalization of habituation on the basis of meaningful categories of stimuli. Also explored are the sex differences in conceptual generalization of habituation. Subjects were 36 toddlers with a mean age of 40 months. (SDH)
Geurts, H.M.; Begeer, S.; Stockman, L.
The current study explored whether inhibitory control deficits in high functioning autism (HFA) emerged when socially relevant stimuli were used and whether arousal level affected the performance. A Go/NoGo paradigm, with socially relevant stimuli and varying presentation rates, was applied in 18
Podlesnik, Christopher A.; Jimenez-Gomez, Corina; Ward, Ryan D.; Shahan, Timothy A.
Stimuli uncorrelated with reinforcement have been shown to enhance response rates and resistance to disruption; however, the effects of different rates of stimulus presentations have not been assessed. In two experiments, we assessed the effects of adding different rates of response-dependent brief stimuli uncorrelated with primary reinforcement…
National Aeronautics and Space Administration — As expected, the STTR Phase I investigation confirmed that the Digital Virtual Human (DVH) and Robonaut technologies can be merged, and that haptic and...
八木 , 善彦
The mere exposure effect refers to the phenomenon where previous exposures to stimuli increasesubsequent affective preference for those stimuli. It has been indicated that with specific stimulus-category（i.e., paintings, matrices, and photographs of scene）, repeated exposure has little or oppositeeffect on affective ratings. In this study, two experiments were conducted in order to explore theeffect of stimulus-category on the mere exposure effects. Photographs of young woman’s（Experiment1）a...
Hoskin, Robert; Hunter, M D; Woodruff, P W R
Research concerning the impact of psychological stress on visual selective attention has produced mixed results. The current paper describes two experiments which utilise a novel auditory oddball paradigm to test the impact of psychological stress on auditory selective attention. Participants had to report the location of emotionally-neutral auditory stimuli, while ignoring task-irrelevant changes in their content. The results of the first experiment, in which speech stimuli were presented, suggested that stress improves the ability to selectively attend to left, but not right ear stimuli. When this experiment was repeated using tonal stimuli the same result was evident, but only for female participants. Females were also found to experience greater levels of distraction in general across the two experiments. These findings support the goal-shielding theory which suggests that stress improves selective attention by reducing the attentional resources available to process task-irrelevant information. The study also demonstrates, for the first time, that this goal-shielding effect extends to auditory perception. Copyright © 2014 Elsevier B.V. All rights reserved.
Herdman, A T; Fujioka, T; Chau, W; Ross, B; Pantev, C; Picton, T W
Congruent or incongruent grapheme-phoneme stimuli are easily perceived as one or two linguistic objects. The main objective of this study was to investigate the changes in cortical oscillations that reflect the processing of congruent and incongruent audiovisual stimuli. Graphemes were Japanese Hiragana characters for four different vowels (/a/, /o/, /u/, and /i/). They were presented simultaneously with their corresponding phonemes (congruent) or non-corresponding phonemes (incongruent) to native-speaking Japanese participants. Participants' reaction times to the congruent audiovisual stimuli were significantly faster by 57 ms as compared to reaction times to incongruent stimuli. We recorded the brain responses for each condition using a whole-head magnetoencephalograph (MEG). A novel approach to analysing MEG data, called synthetic aperture magnetometry (SAM), was used to identify event-related changes in cortical oscillations involved in audiovisual processing. The SAM contrast between congruent and incongruent responses revealed greater event-related desynchonization (8-16 Hz) bilaterally in the occipital lobes and greater event-related synchronization (4-8 Hz) in the left transverse temporal gyrus. Results from this study further support the concept of interactions between the auditory and visual sensory cortices in multi-sensory processing of audiovisual objects.
Pasqualotto, Achille; Finucane, Ciara M; Newell, Fiona N
We investigated the effects of indirect, ambient visual information on haptic spatial memory. Using touch only, participants first learned an array of objects arranged in a scene and were subsequently tested on their recognition of that scene which was always hidden from view. During haptic scene exploration, participants could either see the surrounding room or were blindfolded. We found a benefit in haptic memory performance only when ambient visual information was available in the early stages of the task but not when participants were initially blindfolded. Specifically, when ambient visual information was available a benefit on performance was found in a subsequent block of trials during which the participant was blindfolded (Experiment 1), and persisted over a delay of one week (Experiment 2). However, we found that the benefit for ambient visual information did not transfer to a novel environment (Experiment 3). In Experiment 4 we further investigated the nature of the visual information that improved haptic memory and found that geometric information about a surrounding (virtual) room rather than isolated object landmarks, facilitated haptic scene memory. Our results suggest that vision improves haptic memory for scenes by providing an environment-centred, allocentric reference frame for representing object location through touch. Copyright © 2013 Elsevier B.V. All rights reserved.
Full Text Available This study examined whether altered joint angular motion during haptic exploration could account for a decline in haptic sensitivity in individuals with PD by analyzing joint position data during haptic exploration of a curved contour. Each participant’s hand was passively moved by a robotic arm along the edges of a virtual box (5 cm × 15 cm with a curved left wall. After each trial, participants indicated whether the contour was curved or straight. Visual, auditory, and tactile cues were occluded, and an electrogoniometer recorded shoulder and elbow joint angles during each trial. The PD group in the OFF state had a higher mean detection threshold (4.67 m−1 than the control group (3.06 m−1. Individuals with PD in the OFF state also had a significantly greater magnitude of shoulder abduction than those in the ON state (p=0.003 and a smaller magnitude of elbow flexion than those in the ON state or compared to the control group (both p<0.001. These findings suggest that individuals with PD employ joint configurations that may contribute to haptic insensitivity. Dopamine replacement therapy improved joint configurations during haptic exploration in patients with PD, suggesting a role for dopaminergic dysfunction in PD-related haptic insensitivity.
Full Text Available The use of haptic devices in the rehabilitation of impaired limbs has become rather popular, given the proven effectiveness in promoting recovery. In a standard framework, such devices are used in rehabilitation centers, where patients interact with virtual tasks, presented on a screen. To track their sessions, kinematic/dynamic parameters or performance scores are recorded. However, as Internet access is now available at almost every home and in order to reduce the hospitalization time of the patient, the idea of doing rehabilitation at home is gaining wide consent. Medical care programs can be synchronized with the home rehabilitation device; patient data can be sent to the central server that could redirect to the therapist laptop (tele-healthcare. The controversial issue is that the recorded data do not actually represent the clinical conditions of the patients according to the medical assessment scales, forcing them to frequently undergo clinical tests at the hospital. To respond to this demand, we propose the use of a bilateral master/slave haptic system that could allow the clinician, who interacts with the master, to assess remotely and in real time the clinical conditions of the patient that uses the home rehabilitation device as the slave. In this paper, we describe a proof of concept to highlight the main issues of such an application, limited to one degree of freedom, and to the measure of the stiffness and range of motion of the hand.
King, Hanna M; Kurdziel, Laura B; Meyer, Jerrold S; Lacreuse, Agnès
. Thus, even though monkeys were sensitive to the social relevance and emotional valence of the stimuli in the two tasks, T manipulations had no effect on attention or memory for these stimuli. Because habituation to the stimuli may have mitigated the effect of treatment in the attentional task, we suggest that T may increase attentional biases to negative social stimuli only during early exposure to the stimuli with acute treatment or when stimuli are highly arousing (i.e., dynamically presented) with chronic treatment. In addition, the data suggest that T does not enhance working memory for emotional stimuli in young male macaques. Copyright © 2011 Elsevier Ltd. All rights reserved.
Jeka, J. J.; Easton, R. D.; Bentzen, B. L.; Lackner, J. R.
Haptic cues from fingertip contact with a stable surface attenuate body sway in subjects even when the contact forces are too small to provide physical support of the body. We investigated how haptic cues derived from contact of a cane with a stationary surface at low force levels aids postural control in sighted and congenitally blind individuals. Five sighted (eyes closed) and five congenitally blind subjects maintained a tandem Romberg stance in five conditions: (1) no cane; (2,3) touch contact (postural sway in all subjects, compared to the no-cane condition. A slanted cane was far more effective in reducing postural sway than was a perpendicular cane. Cane use also decreased head displacement of sighted subjects far more than that of blind subjects. These results suggest that head movement control is linked to postural control through gaze stabilization reflexes in sighted subjects; such reflexes are absent in congenitally blind individuals and may account for their higher levels of head displacement.
Begault, Durand R.; Anderson, Mark R.; Bittner, Rachael M.
The Western Electric Company produced a multi-line telephone during the 1940s-1970s using a six-button interface design that provided robust tactile, haptic and auditory cues regarding the "state" of the communication system. This multi-line telephone was used as a model for a trade study comparison of two interfaces: a touchscreen interface (iPad)) versus a pressure-sensitive strain gauge button interface (Phidget USB interface controllers). The experiment and its results are detailed in the authors' AES 133rd convention paper " Multimodal Information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Dispays". This Engineering Brief describes how the interface logic, visual indications, and auditory cues of the original telephone were synthesized using MAX/MSP, including the logic for line selection, line hold, and priority line activation.
Ahmad Hoirul Basori
Full Text Available he process of introducing emotion can be improved through three-dimensional (3D tutoring system. The problem that still not solved is how to provide realistic tutor (avatar in virtual environment. This paper propose an approach to teach children on understanding emotion sensation through facial expression and sense of touch (haptic.The algorithm is created by calculating constant factor (f based on maximum value of RGB and magnitude force then magnitude force range will be associated into particular colour. The Integration process will be started from rendering the facial expression then followed by adjusting the vibration power to emotion value. The result that achieved on experiment, it show around 71% students agree with the classification of magnitude force into emotion representation. Respondents commented that high magnitude force create similar sensation when respondents feel anger, while low magnitude force is more relaxing to respondents. Respondents also said that haptic and facial expression is very interactive and realistic.
Full Text Available Background. The teaching of implant surgery, as in other medical disciplines, is currently undergoing a particular evolution. Aim of the Study. To assess the usefulness of haptic device, a simulator for learning and training to accomplish basic acts in implant surgery. Materials and Methods. A total of 60 people including 40 third-year dental students without knowledge in implantology (divided into 2 groups: 20 beginners and 20 experiencing a simulator training course and 20 experienced practitioners (experience in implantology >15 implants participated in this study. A basic exercise drill was proposed to the three groups to assess their gestural abilities. Results. The results of the group training with the simulator tended to be significantly close to those of the experienced operators. Conclusion. Haptic simulator brings a real benefit in training for implant surgery. Long-term benefit and more complex exercises should be evaluated.
Full Text Available The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.
Okrainec, A; Farcas, M; Henao, O; Choy, I; Green, J; Fotoohi, M; Leslie, R; Wight, D; Karam, P; Gonzalez, N; Apkarian, J
The Veress needle is the most commonly used technique for creating the pneumoperitoneum at the start of a laparoscopic surgical procedure. Inserting the Veress needle correctly is crucial since errors can cause significant harm to patients. Unfortunately, this technique can be difficult to teach since surgeons rely heavily on tactile feedback while advancing the needle through the various layers of the abdominal wall. This critical step in laparoscopy, therefore, can be challenging for novice trainees to learn without adequate opportunities to practice in a safe environment with no risk of injury to patients. To address this issue, we have successfully developed a prototype of a virtual reality haptic needle insertion simulator using the tactile feedback of 22 surgeons to set realistic haptic parameters. A survey of these surgeons concluded that our device appeared and felt realistic, and could potentially be a useful tool for teaching the proper technique of Veress needle insertion.
Yoon, Jung Won; Hwang, Yoon Kwon [Gyeongsang National University, Jinju (Korea, Republic of); Ryu, Je Ha [Gwangju Institute of Science and Technology, Gwangju (Korea, Republic of)
This paper proposes an optimum design method that satisfies the desired orientation workspace at the boundary of the translation workspace while maximizing the mechanism isotropy for parallel manipulators. A simple genetic algorithm is used to obtain the optimal linkage parameters of a six-degree-of-freedom parallel manipulator that can be used as a haptic device. The objective function is composed of a desired spherical shape translation workspace and a desired orientation workspace located on the boundaries of the desired translation workspace, along with a global conditioning index based on a homogeneous Jacobian matrix. The objective function was optimized to satisfy the desired orientation workspace at the boundary positions as translated from a neutral position of the increased entropy mechanism. An optimization result with desired translation and orientation workspaces for a haptic device was obtained to show the effectiveness of the suggested scheme, and the kinematic performances of the proposed model were compared with those of a preexisting base model
Yoon, Jung Won; Hwang, Yoon Kwon; Ryu, Je Ha
This paper proposes an optimum design method that satisfies the desired orientation workspace at the boundary of the translation workspace while maximizing the mechanism isotropy for parallel manipulators. A simple genetic algorithm is used to obtain the optimal linkage parameters of a six-degree-of-freedom parallel manipulator that can be used as a haptic device. The objective function is composed of a desired spherical shape translation workspace and a desired orientation workspace located on the boundaries of the desired translation workspace, along with a global conditioning index based on a homogeneous Jacobian matrix. The objective function was optimized to satisfy the desired orientation workspace at the boundary positions as translated from a neutral position of the increased entropy mechanism. An optimization result with desired translation and orientation workspaces for a haptic device was obtained to show the effectiveness of the suggested scheme, and the kinematic performances of the proposed model were compared with those of a preexisting base model
Banerjee, Pat; Hu, Mengqi; Kannan, Rahul; Krishnaswamy, Srinivasan
The Sensimmer platform represents our ongoing research on simultaneous haptics and graphics rendering of 3D models. For simulation of medical and surgical procedures using Sensimmer, 3D models must be obtained from medical imaging data, such as magnetic resonance imaging (MRI) or computed tomography (CT). Image segmentation techniques are used to determine the anatomies of interest from the images. 3D models are obtained from segmentation and their triangle reduction is required for graphics and haptics rendering. This paper focuses on creating 3D models by automating the segmentation of CT images based on the pixel contrast for integrating the interface between Sensimmer and medical imaging devices, using the volumetric approach, Hough transform method, and manual centering method. Hence, automating the process has reduced the segmentation time by 56.35% while maintaining the same accuracy of the output at ±2 voxels.
This book presents a new approach to examining perceived quality of audiovisual sequences. It uses electroencephalography to understand how exactly user quality judgments are formed within a test participant, and what might be the physiologically-based implications when being exposed to lower quality media. The book redefines experimental paradigms of using EEG in the area of quality assessment so that they better suit the requirements of standard subjective quality testings. Therefore, experimental protocols and stimuli are adjusted accordingly. .
Lewis Brooks, Anthony
is it that is happening inside that affects our ‘sensitive selective & subjective’ choice. Does the present education of design incorporate this ‘hidden human happening’ in a suitably eloquent manner and is it more accessible as the computer becomes a more ubiquitous entity as we approach the age of the disappearing......"What is fantastic about today is that there is no one or two ways to go. Now things are more interesting in that they are completely open, and people do not have to restrain their imagination. For how can you restrain imagination?" Abstract: The age of the disappearing computer will result...... in a ‘remarkable reductive retraction’ from ‘fixation centers’ such that a more human intuitive interaction to the ‘New World’ becomes apparent in design scenarios. Ubiquitous ‘Virtual Interactive Space’ (Brooks, 1999) will become a more utilized and higher resolution capture resource integrative to design...
Chan, Stephanie C.Y.; Applegate, Marissa C.; Morton, Neal W; Polyn, Sean M.; Norman, Kenneth A.
Several prominent theories posit that information about recent experiences lingers in the brain and organizes memories for current experiences, by forming a temporal context that is linked to those memories at encoding. According to these theories, if the thoughts preceding an experience X resemble the thoughts preceding an experience Y, then X and Y should show an elevated probability of being recalled together. We tested this prediction by using multi-voxel pattern analysis (MVPA) of fMRI data to measure neural evidence for lingering processing of preceding stimuli. As predicted, memories encoded with similar lingering thoughts about the category of preceding stimuli were more likely to be recalled together. Our results demonstrate that the “fading embers” of previous stimuli help to organize recall, confirming a key prediction of computational models of episodic memory. PMID:28132858
Chan, Stephanie C Y; Applegate, Marissa C; Morton, Neal W; Polyn, Sean M; Norman, Kenneth A
Several prominent theories posit that information about recent experiences lingers in the brain and organizes memories for current experiences, by forming a temporal context that is linked to those memories at encoding. According to these theories, if the thoughts preceding an experience X resemble the thoughts preceding an experience Y, then X and Y should show an elevated probability of being recalled together. We tested this prediction by using multi-voxel pattern analysis (MVPA) of fMRI data to measure neural evidence for lingering processing of preceding stimuli. As predicted, memories encoded with similar lingering thoughts about the category of preceding stimuli were more likely to be recalled together. Our results demonstrate that the "fading embers" of previous stimuli help to organize recall, confirming a key prediction of computational models of episodic memory. Copyright © 2017 Elsevier Ltd. All rights reserved.
Full Text Available Several types of striped patterns have been reported to cause adverse sensations described as visual discomfort. Previous research using op-art-based stimuli has demonstrated that spurious eye movement signals can cause the experience of illusory motion, or shimmering effects, which might be perceived as uncomfortable. Whilst the shimmering effects are one cause of discomfort, another possible contributor to discomfort is excessive neural responses: As striped patterns do not have the statistical redundancy typical of natural images, they are perhaps unable to be encoded efficiently. If this is the case, then this should be seen in the amplitude of the EEG response. This study found that stimuli that were judged to be most comfortable were also those with the lowest EEG amplitude. This provides some support for the idea that excessive neural responses might also contribute to discomfort judgements in normal populations, in stimuli controlled for perceived contrast.
O'Hare, Louise; Clarke, Alasdair D F; Pollux, Petra M J
Several types of striped patterns have been reported to cause adverse sensations described as visual discomfort. Previous research using op-art-based stimuli has demonstrated that spurious eye movement signals can cause the experience of illusory motion, or shimmering effects, which might be perceived as uncomfortable. Whilst the shimmering effects are one cause of discomfort, another possible contributor to discomfort is excessive neural responses: As striped patterns do not have the statistical redundancy typical of natural images, they are perhaps unable to be encoded efficiently. If this is the case, then this should be seen in the amplitude of the EEG response. This study found that stimuli that were judged to be most comfortable were also those with the lowest EEG amplitude. This provides some support for the idea that excessive neural responses might also contribute to discomfort judgements in normal populations, in stimuli controlled for perceived contrast.
Alaraj, Ali; Luciano, Cristian J.; Bailey, Daniel P.; Elsenousi, Abdussalam; Roitberg, Ben Z.; Bernardo, Antonio; Banerjee, P. Pat; Charbel, Fady T.
Background With the decrease in the number of cerebral aneurysms treated surgically and the increase of complexity of those treated surgically, there is a need for simulation-based tools to teach future neurosurgeons the operative techniques of aneurysm clipping. Objective To develop and evaluate the usefulness of a new haptic-based virtual reality (VR) simulator in the training of neurosurgical residents. Methods A real-time sensory haptic feedback virtual reality aneurysm clipping simulator was developed using the Immersive Touch platform. A prototype middle cerebral artery aneurysm simulation was created from a computed tomography angiogram. Aneurysm and vessel volume deformation and haptic feedback are provided in a 3-D immersive VR environment. Intraoperative aneurysm rupture was also simulated. Seventeen neurosurgery residents from three residency programs tested the simulator and provided feedback on its usefulness and resemblance to real aneurysm clipping surgery. Results Residents felt that the simulation would be useful in preparing for real-life surgery. About two thirds of the residents felt that the 3-D immersive anatomical details provided a very close resemblance to real operative anatomy and accurate guidance for deciding surgical approaches. They believed the simulation is useful for preoperative surgical rehearsal and neurosurgical training. One third of the residents felt that the technology in its current form provided very realistic haptic feedback for aneurysm surgery. Conclusion Neurosurgical residents felt that the novel immersive VR simulator is helpful in their training especially since they do not get a chance to perform aneurysm clippings until very late in their residency programs. PMID:25599200