Experimental tests of light-pollution impacts on nocturnal insect courtship and dispersal.

Science.gov (United States)

Firebaugh, Ariel; Haynes, Kyle J

2016-12-01

Though a number of effects of artificial light pollution on behavior and physiology have been described, there is little understanding of their consequences for the growth and distribution of populations. Here, we document impacts of light pollution on aspects of firefly population ecology and underlying mating behaviors. Many firefly species have a unique communication system whereby bioluminescent flashes are used in courtship displays to find and attract mates. We performed a series of manipulative field experiments in which we quantified the effects of adding artificial nighttime lighting on abundances and total flashing activity of fireflies, courtship behaviors and mating between tethered females and free-flying males, and dispersal distances of marked individuals. We show that light pollution reduces flashing activities in a dark-active firefly species (Photuris versicolor) by 69.69 % and courtship behavior and mating success in a twilight-active species (Photinus pyralis). Though courtship behavior and mating success of Photinus pyralis was reduced by light pollution, we found no effects of light pollution on male dispersal in this species. Our findings suggest that light pollution is likely to adversely impact firefly populations, and contribute to wider discussions about the ecological consequences of sensory pollution.

Multimodal signalling in estrildid finches: song, dance and colour are associated with different ecological and life-history traits.

Science.gov (United States)

Gomes, A C R; Funghi, C; Soma, M; Sorenson, M D; Cardoso, G C

2017-07-01

Sexual traits (e.g. visual ornaments, acoustic signals, courtship behaviour) are often displayed together as multimodal signals. Some hypotheses predict joint evolution of different sexual signals (e.g. to increase the efficiency of communication) or that different signals trade off with each other (e.g. due to limited resources). Alternatively, multiple signals may evolve independently for different functions, or to communicate different information (multiple message hypothesis). We evaluated these hypotheses with a comparative study in the family Estrildidae, one of the largest songbird radiations, and one that includes many model species for research in sexual selection and communication. We found little evidence for either joint evolution or trade-offs between song and colour ornamentation. Some negative correlations between dance repertoire and song traits may suggest a functional compromise, but generally courtship dance also evolved independently from other signals. Instead of correlated evolution, we found that song, dance and colour are each related to different socio-ecological traits. Song complexity evolved together with ecological generalism, song performance with investment in reproduction, dance with commonness and habitat type, whereas colour ornamentation was shown previously to correlate mostly with gregariousness. We conclude that multimodal signals evolve in response to various socio-ecological traits, suggesting the accumulation of distinct signalling functions. © 2017 European Society For Evolutionary Biology. Journal of Evolutionary Biology © 2017 European Society For Evolutionary Biology.

Serotonergic activation during courtship and aggression in the brown anole, Anolis sagrei

Directory of Open Access Journals (Sweden)

Jacob T. Hartline

2017-05-01

Full Text Available The role of serotonin (5-hydroxytryptamine, 5-HT in social behavior regulation is not fully understood. While 5-HT release in nuclei of the social behavior network has generally been associated with inhibition of aggressive behavior across multiple classes of vertebrates, less is known about its effects on sexual, especially non-copulatory courtship display behaviors. Furthermore, most research has examined effects at 5-HT release sites, while studies examining the behavioral relevance of source cell populations have generated contradictory findings. This study utilized immunohistochemistry to examine the colocalization of 5-HT with Fos, an immediate early gene product and marker of neural activity, in the raphe and superior reticular nuclei of male brown anoles (Anolis sagrei exposed to either aggression, courtship, or control social interactions. Supporting previous research, copulation was associated with a decrease in 5-HT activity, while a novel link between 5-HT activity and latency to non-copulatory courtship was also found. Within the aggression group, intensity and frequency of behavior were both associated with decreased 5-HT activity. An effect of social context was also seen, with anoles exposed to either courtship or aggression encounters showing decreased 5-HT activity in certain raphe and superior reticular nuclei populations compared to controls. Interestingly, context effects and behavioral effects were seen at separate brain nuclei, suggesting the presence of separate systems with distinct functional roles.

Do male birds intercept and use rival courtship calls to adjust paternity protection behaviours?

DEFF Research Database (Denmark)

Matessi, Giuliano; McGregor, Peter Kenneth; Peake, Thomas More

2005-01-01

Abstract: We tested whether male rock sparrows (Petronia petronia) change behaviours directed at their females when played back courtship display calls simulating a potential cuckolding event in the vicinity of their nests. We compared the behaviour of males before, during and after such playback...

Sensory integration regulating male courtship behavior in Drosophila.

Directory of Open Access Journals (Sweden)

Dimitrije Krstic

Full Text Available The courtship behavior of Drosophila melanogaster serves as an excellent model system to study how complex innate behaviors are controlled by the nervous system. To understand how the underlying neural network controls this behavior, it is not sufficient to unravel its architecture, but also crucial to decipher its logic. By systematic analysis of how variations in sensory inputs alter the courtship behavior of a naïve male in the single-choice courtship paradigm, we derive a model describing the logic of the network that integrates the various sensory stimuli and elicits this complex innate behavior. This approach and the model derived from it distinguish (i between initiation and maintenance of courtship, (ii between courtship in daylight and in the dark, where the male uses a scanning strategy to retrieve the decamping female, and (iii between courtship towards receptive virgin females and mature males. The last distinction demonstrates that sexual orientation of the courting male, in the absence of discriminatory visual cues, depends on the integration of gustatory and behavioral feedback inputs, but not on olfactory signals from the courted animal. The model will complement studies on the connectivity and intrinsic properties of the neurons forming the circuitry that regulates male courtship behavior.

Multimodal interaction in the perception of impact events displayed via a multichannel audio and simulated structure-borne vibration

Science.gov (United States)

Martens, William L.; Woszczyk, Wieslaw

2005-09-01

For multimodal display systems in which realistic reproduction of impact events is desired, presenting structure-borne vibration along with multichannel audio recordings has been observed to create a greater sense of immersion in a virtual acoustic environment. Furthermore, there is an increased proportion of reports that the impact event took place within the observer's local area (this is termed ``presence with'' the event, in contrast to ``presence in'' the environment in which the event occurred). While holding the audio reproduction constant, varying the intermodal arrival time and level of mechanically displayed, synthetic whole-body vibration revealed a number of other subjective attributes that depend upon multimodal interaction in the perception of a representative impact event. For example, when the structure-borne component of the displayed impact event arrived 10 to 20 ms later than the airborne component, the intermodal delay was not only tolerated, but gave rise to an increase in the proportion of reports that the impact event had greater power. These results have enabled the refinement of a multimodal simulation in which the manipulation of synthetic whole-body vibration can be used to control perceptual attributes of impact events heard within an acoustic environment reproduced via a multichannel loudspeaker array.

Do male birds intercept and use rival courtship calls to adjust paternity protection behaviours?

DEFF Research Database (Denmark)

Matessi, Giuliano; McGregor, Peter Kenneth; Peake, Thomas More

2005-01-01

Abstract: We tested whether male rock sparrows (Petronia petronia) change behaviours directed at their females when played back courtship display calls simulating a potential cuckolding event in the vicinity of their nests. We compared the behaviour of males before, during and after such playback...... and communication strategies, and extend our knowledge of how the social environment can affect within-pair dynamics....

Evolution of multiple additive loci caused divergence between Drosophila yakuba and D. santomea in wing rowing during male courtship.

Directory of Open Access Journals (Sweden)

Jessica Cande

Full Text Available In Drosophila, male flies perform innate, stereotyped courtship behavior. This innate behavior evolves rapidly between fly species, and is likely to have contributed to reproductive isolation and species divergence. We currently understand little about the neurobiological and genetic mechanisms that contributed to the evolution of courtship behavior. Here we describe a novel behavioral difference between the two closely related species D. yakuba and D. santomea: the frequency of wing rowing during courtship. During courtship, D. santomea males repeatedly rotate their wing blades to face forward and then back (rowing, while D. yakuba males rarely row their wings. We found little intraspecific variation in the frequency of wing rowing for both species. We exploited multiplexed shotgun genotyping (MSG to genotype two backcross populations with a single lane of Illumina sequencing. We performed quantitative trait locus (QTL mapping using the ancestry information estimated by MSG and found that the species difference in wing rowing mapped to four or five genetically separable regions. We found no evidence that these loci display epistasis. The identified loci all act in the same direction and can account for most of the species difference.

Motor Control of Drosophila Courtship Song

Directory of Open Access Journals (Sweden)

Troy R. Shirangi

2013-11-01

Full Text Available Many animals utilize acoustic signals—or songs—to attract mates. During courtship, Drosophila melanogaster males vibrate a wing to produce trains of pulses and extended tone, called pulse and sine song, respectively. Courtship songs in the genus Drosophila are exceedingly diverse, and different song features appear to have evolved independently of each other. How the nervous system allows such diversity to evolve is not understood. Here, we identify a wing muscle in D. melanogaster (hg1 that is uniquely male-enlarged. The hg1 motoneuron and the sexually dimorphic development of the hg1 muscle are required specifically for the sine component of the male song. In contrast, the motoneuron innervating a sexually monomorphic wing muscle, ps1, is required specifically for a feature of pulse song. Thus, individual wing motor pathways can control separate aspects of courtship song and may provide a “modular” anatomical substrate for the evolution of diverse songs.

Social Factor and Victim-Offender Differences in Courtship Violence.

Science.gov (United States)

Makepeace, James M.

1987-01-01

Explored social factor differences between respondents with and without courtship violence experience and between male offenders and female victims. Data from the Seven College Survey revealed that those with courtship violence experience exhibited relatively "problematic" social profiles. Especially significant were race; religion;…

Integrated multimodal human-computer interface and augmented reality for interactive display applications

Science.gov (United States)

Vassiliou, Marius S.; Sundareswaran, Venkataraman; Chen, S.; Behringer, Reinhold; Tam, Clement K.; Chan, M.; Bangayan, Phil T.; McGee, Joshua H.

2000-08-01

We describe new systems for improved integrated multimodal human-computer interaction and augmented reality for a diverse array of applications, including future advanced cockpits, tactical operations centers, and others. We have developed an integrated display system featuring: speech recognition of multiple concurrent users equipped with both standard air- coupled microphones and novel throat-coupled sensors (developed at Army Research Labs for increased noise immunity); lip reading for improving speech recognition accuracy in noisy environments, three-dimensional spatialized audio for improved display of warnings, alerts, and other information; wireless, coordinated handheld-PC control of a large display; real-time display of data and inferences from wireless integrated networked sensors with on-board signal processing and discrimination; gesture control with disambiguated point-and-speak capability; head- and eye- tracking coupled with speech recognition for 'look-and-speak' interaction; and integrated tetherless augmented reality on a wearable computer. The various interaction modalities (speech recognition, 3D audio, eyetracking, etc.) are implemented a 'modality servers' in an Internet-based client-server architecture. Each modality server encapsulates and exposes commercial and research software packages, presenting a socket network interface that is abstracted to a high-level interface, minimizing both vendor dependencies and required changes on the client side as the server's technology improves.

Drosophila pheromone-sensing neurons expressing the ppk25 ion channel subunit stimulate male courtship and female receptivity.

Science.gov (United States)

Vijayan, Vinoy; Thistle, Rob; Liu, Tong; Starostina, Elena; Pikielny, Claudio W

2014-03-01

As in many species, gustatory pheromones regulate the mating behavior of Drosophila. Recently, several ppk genes, encoding ion channel subunits of the DEG/ENaC family, have been implicated in this process, leading to the identification of gustatory neurons that detect specific pheromones. In a subset of taste hairs on the legs of Drosophila, there are two ppk23-expressing, pheromone-sensing neurons with complementary response profiles; one neuron detects female pheromones that stimulate male courtship, the other detects male pheromones that inhibit male-male courtship. In contrast to ppk23, ppk25, is only expressed in a single gustatory neuron per taste hair, and males with impaired ppk25 function court females at reduced rates but do not display abnormal courtship of other males. These findings raised the possibility that ppk25 expression defines a subset of pheromone-sensing neurons. Here we show that ppk25 is expressed and functions in neurons that detect female-specific pheromones and mediates their stimulatory effect on male courtship. Furthermore, the role of ppk25 and ppk25-expressing neurons is not restricted to responses to female-specific pheromones. ppk25 is also required in the same subset of neurons for stimulation of male courtship by young males, males of the Tai2 strain, and by synthetic 7-pentacosene (7-P), a hydrocarbon normally found at low levels in both males and females. Finally, we unexpectedly find that, in females, ppk25 and ppk25-expressing cells regulate receptivity to mating. In the absence of the third antennal segment, which has both olfactory and auditory functions, mutations in ppk25 or silencing of ppk25-expressing neurons block female receptivity to males. Together these results indicate that ppk25 identifies a functionally specialized subset of pheromone-sensing neurons. While ppk25 neurons are required for the responses to multiple pheromones, in both males and females these neurons are specifically involved in stimulating

Phase-Specific Vocalizations of Male Mice at the Initial Encounter during the Courtship Sequence.

Directory of Open Access Journals (Sweden)

Yui K Matsumoto

Full Text Available Mice produce ultrasonic vocalizations featuring a variety of syllables. Vocalizations are observed during social interactions. In particular, males produce numerous syllables during courtship. Previous studies have shown that vocalizations change according to sexual behavior, suggesting that males vary their vocalizations depending on the phase of the courtship sequence. To examine this process, we recorded large sets of mouse vocalizations during male-female interactions and acoustically categorized these sounds into 12 vocal types. We found that males emitted predominantly short syllables during the first minute of interaction, more long syllables in the later phases, and mainly harmonic sounds during mounting. These context- and time-dependent changes in vocalization indicate that vocal communication during courtship in mice consists of at least three stages and imply that each vocalization type has a specific role in a phase of the courtship sequence. Our findings suggest that recording for a sufficiently long time and taking the phase of courtship into consideration could provide more insights into the role of vocalization in mouse courtship behavior in future study.

Assessment of Eye Fatigue Caused by 3D Displays Based on Multimodal Measurements

Science.gov (United States)

Bang, Jae Won; Heo, Hwan; Choi, Jong-Suk; Park, Kang Ryoung

2014-01-01

With the development of 3D displays, user's eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs), biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR), facial temperature (FT), and a subjective evaluation (SE) score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel) camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG) is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively. PMID:25192315

Assessment of Eye Fatigue Caused by 3D Displays Based on Multimodal Measurements

Directory of Open Access Journals (Sweden)

Jae Won Bang

2014-09-01

Full Text Available With the development of 3D displays, user’s eye fatigue has been an important issue when viewing these displays. There have been previous studies conducted on eye fatigue related to 3D display use, however, most of these have employed a limited number of modalities for measurements, such as electroencephalograms (EEGs, biomedical signals, and eye responses. In this paper, we propose a new assessment of eye fatigue related to 3D display use based on multimodal measurements. compared to previous works Our research is novel in the following four ways: first, to enhance the accuracy of assessment of eye fatigue, we measure EEG signals, eye blinking rate (BR, facial temperature (FT, and a subjective evaluation (SE score before and after a user watches a 3D display; second, in order to accurately measure BR in a manner that is convenient for the user, we implement a remote gaze-tracking system using a high speed (mega-pixel camera that measures eye blinks of both eyes; thirdly, changes in the FT are measured using a remote thermal camera, which can enhance the measurement of eye fatigue, and fourth, we perform various statistical analyses to evaluate the correlation between the EEG signal, eye BR, FT, and the SE score based on the T-test, correlation matrix, and effect size. Results show that the correlation of the SE with other data (FT, BR, and EEG is the highest, while those of the FT, BR, and EEG with other data are second, third, and fourth highest, respectively.

Courtship behavior of different wild strains of Ceratitis Capitata (Diptera: Tephritidae)

International Nuclear Information System (INIS)

Briceno, D.; Eberhard, W.; Vilardi, J.; Cayol, J.-P.; Shelly, T.

2007-01-01

This study documents differences in the courtship behavior of wild strains of Ceratitis capitata (Wiedemann) from Madeira (Portugal), Hawaii (U.S.A.), Costa Rica, and Patagonia (Argentina). Some traits showed large variations and others substantial overlaps. The angle at which the male faced toward the female at the moment of transition from continuous wing vibration and intermittent buzzing changed very little during the course of courtship in all strains, but males from Madeira tended to face more directly toward the female than other males. Females tended to look more, and more directly, toward the males as courtship progressed in all strains. The distance between male and female tended to decrease as courtship proceeded in all strains, but the distances at which males initiated continuous vibration, intermittent buzzing, and jumped onto the female were relatively less variable between strains, except for the strain from Costa Rica. Flies of Madeira courted for longer and the male moved his head and buzzed his wings longer than the other strains. (author) [es

The impact of men's magazines on adolescent boys' objectification and courtship beliefs.

Science.gov (United States)

Ward, L Monique; Vandenbosch, Laura; Eggermont, Steven

2015-02-01

Although much attention concerning the potential impact of sexualized media has focused on girls and women, less is known about how this content effects boys' perceptions of women and courtship. Accordingly, the current three-wave panel study investigated whether exposure to sexualizing magazines predicts adolescent boys' (N = 592) sexually objectifying notions of women and their beliefs about feminine courtship strategies. The results indicated that when boys consumed sexualizing magazines more often, they expressed more gender-stereotypical beliefs about feminine courtship strategies over time. This association was mediated by boys' objectification of women. The possibility of a reciprocal relation whereby beliefs about courtship strategies predict future consumption of sexualizing magazines was also explored but received no support. Discussion focuses on effects of sexualizing media on boys, and supports future research to build on multidisciplinary knowledge. Copyright © 2014 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Short and fast vs long and slow: age changes courtship in male orb-web spiders ( Argiope keyserlingi)

Science.gov (United States)

O'Hanlon, James C.; Wignall, Anne E.; Herberstein, Marie E.

2018-02-01

Male reproductive performance can vary with condition, age and future reproductive opportunities. Web-building spiders are ideal models to examine the effects of senescence on fitness-related behaviours due to strong selection on male courtship to reduce pre-copulatory sexual cannibalism. Argiope keyserlingi spiders generate courtship vibrations, or `shudders', that reduce female aggression. We found that male A. keyserlingi courtship slowed with chronological age. Older males took longer to travel across the courtship thread, and overall number of shudders increased. Males retained some ability to modulate courtship quality (shudder duration and number of rocks within each shudder) in response to female quality. A change in courtship performance over time, despite strong selection for repeatability, indicates that ageing in male A. keyserlingi may have direct impacts on reproductive performance.

Courtship and mating of Scorpiops luridus Zhu Lourenço & Qi, 2005 (Scorpiones: Euscorpiidae from Xizang province, China

Directory of Open Access Journals (Sweden)

GB Jiao

2010-01-01

Full Text Available In the current work, the courtship and mating of Scorpiops luridus Zhu Lourenço & Qi, 2005 (Euscorpiidae from Xizang province (Tibet, China, were studied for the first time in the laboratory. Most of the mating behaviors in Scorpiops luridus are not remarkably different from those exhibited by other scorpions. However, for the first time a male pulling a female with its chelicerae to rapidly accomplish the sperm uptake was observed. Additionally, the sexual stinging behavior displayed by the male occurred in the initial stage, not during the promenade stage as previously described in several scorpion species. Through observation and analysis, we speculate that venom injection during sexual stinging is selective, possibly relying on the status shown by the stung scorpion (passive or aggressive. In order to clearly describe the process of courtship and mating, both sequences are represented in a flow chart, while the main behavior components of these processes were identified, analyzed and discussed.

Robotic crabs reveal that female fiddler crabs are sensitive to changes in male display rate.

Science.gov (United States)

Mowles, Sophie L; Jennions, Michael D; Backwell, Patricia R Y

2018-01-01

Males often produce dynamic, repetitive courtship displays that can be demanding to perform and might advertise male quality to females. A key feature of demanding displays is that they can change in intensity: escalating as a male increases his signalling effort, but de-escalating as a signaller becomes fatigued. Here, we investigated whether female fiddler crabs, Uca mjoebergi , are sensitive to changes in male courtship wave rate. We performed playback experiments using robotic male crabs that had the same mean wave rate, but either escalated, de-escalated or remained constant. Females demonstrated a strong preference for escalating robots, but showed mixed responses to robots that de-escalated ('fast' to 'slow') compared to those that waved at a constant 'medium' rate. These findings demonstrate that females can discern changes in male display rate, and prefer males that escalate, but that females are also sensitive to past display rates indicative of prior vigour. © 2018 The Authors.

Drosophila Courtship Conditioning As a Measure of Learning and Memory.

Science.gov (United States)

Koemans, Tom S; Oppitz, Cornelia; Donders, Rogier A T; van Bokhoven, Hans; Schenck, Annette; Keleman, Krystyna; Kramer, Jamie M

2017-06-05

Many insights into the molecular mechanisms underlying learning and memory have been elucidated through the use of simple behavioral assays in model organisms such as the fruit fly, Drosophila melanogaster. Drosophila is useful for understanding the basic neurobiology underlying cognitive deficits resulting from mutations in genes associated with human cognitive disorders, such as intellectual disability (ID) and autism. This work describes a methodology for testing learning and memory using a classic paradigm in Drosophila known as courtship conditioning. Male flies court females using a distinct pattern of easily recognizable behaviors. Premated females are not receptive to mating and will reject the male's copulation attempts. In response to this rejection, male flies reduce their courtship behavior. This learned reduction in courtship behavior is measured over time, serving as an indicator of learning and memory. The basic numerical output of this assay is the courtship index (CI), which is defined as the percentage of time that a male spends courting during a 10 min interval. The learning index (LI) is the relative reduction of CI in flies that have been exposed to a premated female compared to naïve flies with no previous social encounters. For the statistical comparison of LIs between genotypes, a randomization test with bootstrapping is used. To illustrate how the assay can be used to address the role of a gene relating to learning and memory, the pan-neuronal knockdown of Dihydroxyacetone phosphate acyltransferase (Dhap-at) was characterized here. The human ortholog of Dhap-at, glyceronephosphate O-acyltransferase (GNPT), is involved in rhizomelic chondrodysplasia punctata type 2, an autosomal-recessive syndrome characterized by severe ID. Using the courtship conditioning assay, it was determined that Dhap-at is required for long-term memory, but not for short-term memory. This result serves as a basis for further investigation of the underlying molecular

Post-copulatory display in fulvous and black-bellied tree ducks

Science.gov (United States)

Meanley, B.; Meanley, A.G.

1958-01-01

The courtship display of tree ducks has been characterized as simple, resembling that of the swan (Delacour, 'Waterfowl of the World', vol. 1, p. 32, London, 1954). However F. Finn ('Bird Behaviour', p. 262, London, 1919) called attention briefly to the fact that "there is frequently a marked display after, but not before, pairing, both parties executing a step-dance in the water with one wing held aloft." So far as we know, this curious display has not been described in detail nor pictured.

A Fuzzy-Based Fusion Method of Multimodal Sensor-Based Measurements for the Quantitative Evaluation of Eye Fatigue on 3D Displays

Directory of Open Access Journals (Sweden)

Jae Won Bang

2015-05-01

Full Text Available With the rapid increase of 3-dimensional (3D content, considerable research related to the 3D human factor has been undertaken for quantitatively evaluating visual discomfort, including eye fatigue and dizziness, caused by viewing 3D content. Various modalities such as electroencephalograms (EEGs, biomedical signals, and eye responses have been investigated. However, the majority of the previous research has analyzed each modality separately to measure user eye fatigue. This cannot guarantee the credibility of the resulting eye fatigue evaluations. Therefore, we propose a new method for quantitatively evaluating eye fatigue related to 3D content by combining multimodal measurements. This research is novel for the following four reasons: first, for the evaluation of eye fatigue with high credibility on 3D displays, a fuzzy-based fusion method (FBFM is proposed based on the multimodalities of EEG signals, eye blinking rate (BR, facial temperature (FT, and subjective evaluation (SE; second, to measure a more accurate variation of eye fatigue (before and after watching a 3D display, we obtain the quality scores of EEG signals, eye BR, FT and SE; third, for combining the values of the four modalities we obtain the optimal weights of the EEG signals BR, FT and SE using a fuzzy system based on quality scores; fourth, the quantitative level of the variation of eye fatigue is finally obtained using the weighted sum of the values measured by the four modalities. Experimental results confirm that the effectiveness of the proposed FBFM is greater than other conventional multimodal measurements. Moreover, the credibility of the variations of the eye fatigue using the FBFM before and after watching the 3D display is proven using a t-test and descriptive statistical analysis using effect size.

Sex-specific signaling in the blood-brain barrier is required for male courtship in Drosophila.

Directory of Open Access Journals (Sweden)

Valbona Hoxha

Full Text Available Soluble circulating proteins play an important role in the regulation of mating behavior in Drosophila melanogaster. However, how these factors signal through the blood-brain barrier (bbb to interact with the sex-specific brain circuits that control courtship is unknown. Here we show that male identity of the blood-brain barrier is necessary and that male-specific factors in the bbb are physiologically required for normal male courtship behavior. Feminization of the bbb of adult males significantly reduces male courtship. We show that the bbb-specific G-protein coupled receptor moody and bbb-specific Go signaling in adult males are necessary for normal courtship. These data identify sex-specific factors and signaling processes in the bbb as important regulators of male mating behavior.

Social context-dependent modification of courtship behaviour in Drosophila prolongata.

Science.gov (United States)

Setoguchi, Shiori; Kudo, Ayumi; Takanashi, Takuma; Ishikawa, Yukio; Matsuo, Takashi

2015-11-07

Induction of alternative mating tactics by surrounding conditions, such as the presence of conspecific males, is observed in many animal species. Satellite behaviour is a remarkable example in which parasitic males exploit the reproductive investment by other males. Despite the abundance of parasitic mating tactics, however, few examples are known in which males alter courtship behaviour as a counter tactic against parasitic rivals. The fruit fly Drosophila prolongata shows prominent sexual dimorphism in the forelegs. When courting females, males of D. prolongata perform 'leg vibration', in which a male vibrates the female's body with his enlarged forelegs. In this study, we found that leg vibration increased female receptivity, but it also raised a risk of interception of the female by rival males. Consequently, in the presence of rivals, males of D. prolongata shifted their courtship behaviour from leg vibration to 'rubbing', which was less vulnerable to interference by rival males. These results demonstrated that the males of D. prolongata adjust their courtship behaviour to circumvent the social context-dependent risk of leg vibration. © 2015 The Author(s).

Advanced Multimodal Solutions for Information Presentation

Science.gov (United States)

Wenzel, Elizabeth M.; Godfroy-Cooper, Martine

2018-01-01

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a

Implications of differences of echoic and iconic memory for the design of multimodal displays

Science.gov (United States)

Glaser, Daniel Shields

It has been well documented that dual-task performance is more accurate when each task is based on a different sensory modality. It is also well documented that the memory for each sense has unequal durations, particularly visual (iconic) and auditory (echoic) sensory memory. In this dissertation I address whether differences in sensory memory (e.g. iconic vs. echoic) duration have implications for the design of a multimodal display. Since echoic memory persists for seconds in contrast to iconic memory which persists only for milliseconds, one of my hypotheses was that in a visual-auditory dual task condition, performance will be better if the visual task is completed before the auditory task than vice versa. In Experiment 1 I investigated whether the ability to recall multi-modal stimuli is affected by recall order, with each mode being responded to separately. In Experiment 2, I investigated the effects of stimulus order and recall order on the ability to recall information from a multi-modal presentation. In Experiment 3 I investigated the effect of presentation order using a more realistic task. In Experiment 4 I investigated whether manipulating the presentation order of stimuli of different modalities improves humans' ability to combine the information from the two modalities in order to make decision based on pre-learned rules. As hypothesized, accuracy was greater when visual stimuli were responded to first and auditory stimuli second. Also as hypothesized, performance was improved by not presenting both sequences at the same time, limiting the perceptual load. Contrary to my expectations, overall performance was better when a visual sequence was presented before the audio sequence. Though presenting a visual sequence prior to an auditory sequence lengthens the visual retention interval, it also provides time for visual information to be recoded to a more robust form without disruption. Experiment 4 demonstrated that decision making requiring the

Substrate vibrations during courtship in three Drosophila species.

Directory of Open Access Journals (Sweden)

Valerio Mazzoni

Full Text Available While a plethora of studies have focused on the role of visual, chemical and near-field airborne signals in courtship of Drosophila fruit flies, the existence of substrate-borne vibrational signals has been almost completely overlooked. Here we describe substrate vibrations generated during courtship in three species of the D. melanogaster group, from the allegedly mute species D. suzukii, its sister species D. biarmipes, and from D. melanogaster. In all species, we recorded several types of substrate vibrations which were generated by locomotion, abdominal vibrations and most likely through the activity of thoracic wing muscles. In D. melanogaster and D. suzukii, all substrate vibrations described in intact males were also recorded in males with amputated wings. Evidence suggests that vibrational signalling may be widespread among Drosophila species, and fruit flies may provide an ideal model to study various aspects of this widespread form of animal communication.

Hormonal Signaling Cascade during an Early-Adult Critical Period Required for Courtship Memory Retention in Drosophila.

Science.gov (United States)

Lee, Sang Soo; Ding, Yike; Karapetians, Natalie; Rivera-Perez, Crisalejandra; Noriega, Fernando Gabriel; Adams, Michael E

2017-09-25

Formation and expression of memories are critical for context-dependent decision making. In Drosophila, a courting male rejected by a mated female subsequently courts less avidly when paired with a virgin female, a behavioral modification attributed to "courtship memory." Here we show the critical role of hormonal state for maintenance of courtship memory. Ecdysis-triggering hormone (ETH) is essential for courtship memory through regulation of juvenile hormone (JH) levels in adult males. Reduction of JH levels via silencing of ETH signaling genes impairs short-term courtship memory, a phenotype rescuable by the JH analog methoprene. JH-deficit-induced memory impairment involves rapid decay rather than failure of memory acquisition. A critical period governs memory performance during the first 3 days of adulthood. Using sex-peptide-expressing "pseudo-mated" trainers, we find that robust courtship memory elicited in the absence of aversive chemical mating cues also is dependent on ETH-JH signaling. Finally, we find that JH acts through dopaminergic neurons and conclude that an ETH-JH-dopamine signaling cascade is required during a critical period for promotion of social-context-dependent memory. Copyright © 2017 Elsevier Ltd. All rights reserved.

Multimodal warnings to enhance risk communication and safety

NARCIS (Netherlands)

Haas, E.C.; Erp, J.B.F. van

2014-01-01

Multimodal warnings incorporate audio and/or skin-based (tactile) cues to supplement or replace visual cues in environments where the user’s visual perception is busy, impaired, or nonexistent. This paper describes characteristics of audio, tactile, and multimodal warning displays and their role in

Female rock sparrows (Petronia petronia), not males, respond differently to simulations of different courtship interaction outcomes

DEFF Research Database (Denmark)

Matessi, Giuliano; Peake, Tom M.; McGregor, Peter K.

2007-01-01

individuals of both sexes have access to a range of mating strategies. We tested whether rock sparrows (Petronia petronia) behave differently after hearing playbacks of vocal interactions simulating a successful courtship as opposed to playback of an unsuccessful courtship. We found no support for our...

Female presence and estrous state influence mouse ultrasonic courtship vocalizations.

Directory of Open Access Journals (Sweden)

Jessica L Hanson

Full Text Available The laboratory mouse is an emerging model for context-dependent vocal signaling and reception. Mouse ultrasonic vocalizations are robustly produced in social contexts. In adults, male vocalization during courtship has become a model of interest for signal-receiver interactions. These vocalizations can be grouped into syllable types that are consistently produced by different subspecies and strains of mice. Vocalizations are unique to individuals, vary across development, and depend on social housing conditions. The behavioral significance of different syllable types, including the contexts in which different vocalizations are made and the responses listeners have to different types of vocalizations, is not well understood. We examined the effect of female presence and estrous state on male vocalizations by exploring the use of syllable types and the parameters of syllables during courtship. We also explored correlations between vocalizations and other behaviors. These experimental manipulations produced four main findings: 1 vocalizations varied among males, 2 the production of USVs and an increase in the use of a specific syllable type were temporally related to mounting behavior, 3 the frequency (kHz, bandwidth, and duration of syllables produced by males were influenced by the estrous phase of female partners, and 4 syllable types changed when females were removed. These findings show that mouse ultrasonic courtship vocalizations are sensitive to changes in female phase and presence, further demonstrating the context-sensitivity of these calls.

Blown by the wind: the ecology of male courtship display behavior in orchid bees.

Science.gov (United States)

Pokorny, Tamara; Vogler, Ira; Losch, René; Schlütting, Patrick; Juarez, Pedro; Bissantz, Nicolai; Ramírez, Santiago R; Eltz, Thomas

2017-04-01

Many insects rely on chemical signals to transmit precise information on the location, identity, and quality of potential mates. Chemical signals are often broadcasted at sites with physical properties that maximize signal propagation and signal transmission. Male neotropical orchid bees (Euglossini) perch and display on vertical branches and tree trunks in the forest to expose volatile blends (perfumes) that they previously collected from their environment. Previous studies have shown that the chemical composition of perfume blends is highly differentiated even between closely related species. However, variation in behavioral components of perfume exposure and male display remain poorly understood. We conducted a four-year study on orchid bee display sites (8 species) in pacific Costa Rica, using field observations along with chemical analysis and cage experiments to assess display niche partitioning among sympatric species. We evaluated the influence of physical factors (terrain, wind, light) on the distribution of perch sites and on display behavior, and tested a prediction of the sex pheromone-analogue hypothesis, i.e., that displaying males have above-average quantities or qualities of acquired perfumes. Males of different species displayed in the same general area and sometimes in close proximity to each other, but partitioned the display niche by selecting different perch diameters, display heights, and by displaying at different times of the day. Most perch sites were located inside the forest on elevated ground, especially along ridges, where stronger winds may help disperse perfume signals. Furthermore, the angular position of displaying males on perches was narrowly determined by wind direction, with males being positioned on the downwind side of the perch, where they would be most conspicuous to conspecifics approaching on an odor trail. Although our results generally support the hypothesis that perfumes serve as pheromone analogues, we did not find

Compressive multi-mode superresolution display

KAUST Repository

Heide, Felix; Gregson, James; Wetzstein, Gordon; Raskar, Ramesh D.; Heidrich, Wolfgang

2014-01-01

consists of readily-available components and is driven by a novel splitting algorithm that computes the pixel states from a target high-resolution image. In effect, the display pixels present a compressed representation of the target image that is perceived

A role for the adult fat body in Drosophila male courtship behavior.

Directory of Open Access Journals (Sweden)

Anna A Lazareva

2007-01-01

Full Text Available Mating behavior in Drosophila depends critically on the sexual identity of specific regions in the brain, but several studies have identified courtship genes that express products only outside the nervous system. Although these genes are each active in a variety of non-neuronal cell types, they are all prominently expressed in the adult fat body, suggesting an important role for this tissue in behavior. To test its role in male courtship, fat body was feminized using the highly specific Larval serum protein promoter. We report here that the specific feminization of this tissue strongly reduces the competence of males to perform courtship. This effect is limited to the fat body of sexually mature adults as the feminization of larval fat body that normally persists in young adults does not affect mating. We propose that feminization of fat body affects the synthesis of male-specific secreted circulating proteins that influence the central nervous system. In support of this idea, we demonstrate that Takeout, a protein known to influence mating, is present in the hemolymph of adult males but not females and acts as a secreted protein.

An endocrine disrupting chemical changes courtship and parental care in the sand goby

International Nuclear Information System (INIS)

Saaristo, Minna; Craft, John A.; Lehtonen, Kari K.; Lindstroem, Kai

2010-01-01

Endocrine disrupting chemicals (EDCs) are a diverse group of compounds that can mimic, block or modulate the synthesis of natural hormones. They are known to cause impairment of reproduction of aquatic organisms at very low concentrations. The aim of this study was to examine how exposure from 10 to 31 days to 17α-ethinyl estradiol (EE2, 41 ng L -1 ) affects the courtship and parental care behaviour of male sand gobies (Pomatoschistus minutus). The sand goby exhibits a polygynous mating system, where males compete for females and provide paternal care. First, male courtship performance towards a stimulus female was recorded with video camera. Secondly, after the male had received eggs his parental care behaviour was video recorded. In addition to behavioural endpoints, we measured the expression of hepatic vitellogenin (Vtg) and zona radiata protein (Zrp) mRNA, as well as common somatic indices. Our study shows that exposure to EE2 affected male fanning behaviour during both courtship and parental care. Interestingly, small exposed males increased their courtship fanning to similar levels as larger control males. However, during parental care egg fanning was not related to male size, and all exposed males fanned more than control males. The EE2-exposure induced Vtg and Zrp mRNA expression in males and decreased hepatosomatic index (HSI), and increased gonadosomatic index (GSI). Females prefer males that fan more, which will favour the small EDC exposed males. This may lead to mating that favours males that are not strong enough to tend the eggs until they hatch, thus decreasing the reproductive success of individuals.

Sexually dimorphic activation of dopaminergic areas depends on affiliation during courtship and pair formation

Directory of Open Access Journals (Sweden)

Mai eIwasaki

2014-06-01

Full Text Available For many species, dyadic interaction during courtship and pair bonding engage intense emotional states that control approach or avoidance behavior. Previous studies have shown that one component of a common social brain network (SBN, dopaminergic areas, are highly engaged during male songbird courtship of females. We tested whether the level of activity in dopaminergic systems of both females and males during courtship is related to their level of affiliation. In order to objectively quantify affiliative behaviors, we developed a system for tracking the position of both birds during free interaction sessions. During a third successive daily interaction session, there was a range of levels of affiliation among bird pairs, as quantified by several position and movement parameters. Because both positive and negative social interactions were present, we chose to characterize affiliation strength by pair valence. As a potential neural system involved in regulating pair valence, the level of activity of the dopaminergic group A11 (within the central gray was selectively reduced in females of positive valence pairs. Further, activation of non-dopaminergic neurons in VTA was negatively related to valence, with this relationship strongest in ventral VTA of females. Together, these results suggest that inhibition of fear or avoidance networks may be associated with development of close affiliation, and highlight the importance of negative as well as positive emotional states in the process of courtship, and in development of long-lasting social bonds.

Nest ornamentation by female spotless starlings in response to a male display: an experimental study.

Science.gov (United States)

Polo, Vicente; Veiga, José P

2006-07-01

1. The use of behavioural traits by females in signalling condition has been practically ignored in evolutionary theory. However, females may also exhibit ornaments and behavioural displays, although less elaborated than those of males. 2. In this study we suggest that the carrying of feathers by spotless starlings Sturnus unicolor Temminck females to decorate the nest represents an elaborated and costly behaviour that is displayed in response to a courtship male behaviour: the carrying of nest green plants. 3. By experimentally increasing the amount of green plants in the nests, to give the appearance that highly attractive males defended them, we induced females to increase their feather carrying rates. 4. The amount of feathers carried to the nest was correlated to female reproductive experience and laying date, two variables correlated with female body condition. These results suggests that this behaviour may work as an honest indicator of female quality. 5. We conclude that male carrying plants and female carrying feathers can be viewed as two sex-specific functionally related signalling behaviours involved in mutual courtship or status signalling.

An endocrine disrupting chemical changes courtship and parental care in the sand goby

Energy Technology Data Exchange (ETDEWEB)

Saaristo, Minna, E-mail: Minna.Saaristo@helsinki.fi [Department of Bio- and Environmental Sciences, University of Helsinki, P.O. Box 65, FI-00014 Helsinki (Finland); Craft, John A. [Biological and Biomedical Sciences, Glasgow Caledonian University, Cowcaddens Road, Glasgow G4 0BA, Scotland (United Kingdom); Lehtonen, Kari K. [Finnish Environment Institute, Marine Research Centre, P.O. Box 140, FI-00251 Helsinki (Finland); Lindstroem, Kai [Environmental and Marine Biology, Abo Akademi University, FI-20520 Turku (Finland)

2010-05-10

Endocrine disrupting chemicals (EDCs) are a diverse group of compounds that can mimic, block or modulate the synthesis of natural hormones. They are known to cause impairment of reproduction of aquatic organisms at very low concentrations. The aim of this study was to examine how exposure from 10 to 31 days to 17{alpha}-ethinyl estradiol (EE2, 41 ng L{sup -1}) affects the courtship and parental care behaviour of male sand gobies (Pomatoschistus minutus). The sand goby exhibits a polygynous mating system, where males compete for females and provide paternal care. First, male courtship performance towards a stimulus female was recorded with video camera. Secondly, after the male had received eggs his parental care behaviour was video recorded. In addition to behavioural endpoints, we measured the expression of hepatic vitellogenin (Vtg) and zona radiata protein (Zrp) mRNA, as well as common somatic indices. Our study shows that exposure to EE2 affected male fanning behaviour during both courtship and parental care. Interestingly, small exposed males increased their courtship fanning to similar levels as larger control males. However, during parental care egg fanning was not related to male size, and all exposed males fanned more than control males. The EE2-exposure induced Vtg and Zrp mRNA expression in males and decreased hepatosomatic index (HSI), and increased gonadosomatic index (GSI). Females prefer males that fan more, which will favour the small EDC exposed males. This may lead to mating that favours males that are not strong enough to tend the eggs until they hatch, thus decreasing the reproductive success of individuals.

Evolutionary insights into the regulation of courtship behavior in male amphibians and reptiles.

Science.gov (United States)

Woolley, Sarah C; Sakata, Jon T; Crews, David

2004-11-15

Comparative studies of species differences and similarities in the regulation of courtship behavior afford an understanding of evolutionary pressures and constraints shaping reproductive processes and the relative contributions of hormonal, genetic, and ecological factors. Here, we review species differences and similarities in the control of courtship and copulatory behaviors in male amphibians and reptiles, focusing on the role of sex steroid hormones, the neurohormone arginine vasotocin (AVT), and catecholamines. We discuss species differences in the sensory modalities used during courtship and in the neural correlates of these differences, as well as the value of particular model systems for neural evolution studies with regard to reproductive processes. For example, in some genera of amphibians (e.g., Ambystoma) and reptiles (e.g., Cnemidophorus), interspecific hybridizations occur, making it possible to compare the ancestral with the descendant species, and these systems provide a window into the process of behavioral and neural evolution as well as the effect of genome size. Though our understanding of the hormonal and neural correlates of mating behavior in a variety of amphibian and reptilian species has advanced substantially, more studies that manipulate hormone or neurotransmitter systems are required to assess the functions of these systems.

A signal-substrate match in the substrate-borne component of a multimodal courtship display

Directory of Open Access Journals (Sweden)

Damian O. ELIAS, Andrew C. MASON, Eileen A. HEBETS

2010-06-01

Full Text Available The environment can impose strong limitations on the efficacy of signal transmission. In particular, for vibratory communication, the signaling environment is often extremely heterogeneous at very small scales. Nevertheless, natural selection is expected to select for signals well-suited to effective transmission. Here, we test for substrate-dependent signal efficacy in the wolf spider Schizocosa stridulans Stratton 1991. We first explore the transmission characteristics of this important signaling modality by playing recorded substrate-borne signals through three different substrates (leaf litter, pine litter, and red clay and measuring the propagated signal. We found that the substrate-borne signal of S. stridulans attenuates the least on leaf litter, the substrate upon which the species is naturally found. Next, by assessing mating success with artificially muted and non-muted males across different signaling substrates (leaf litter, pine litter, and sand, we explored the relationship between substrate-borne signaling and substrate for mating success. We found that muted males were unsuccessful in obtaining copulations regardless of substrate, while mating success was dependent on the signaling substrate for non-muted males. For non-muted males, more males copulated on leaf litter than any other substrate. Taken together, these results confirm the importance of substrate-borne signaling in S. stridulans and suggest a match between signal properties and signal efficacy – leaf litter transmits the signal most effectively and males are most successful in obtaining copulations on leaf litter [Current Zoology 56 (3: 370–378, 2010].

Endocrine disruption of courtship behaviour and reproduction in zebrafish (Danio rerio)

DEFF Research Database (Denmark)

Broch-Lips, Mia Gina Gruwier

2011-01-01

of the reversibility of hormonally induced shifts in sex ratio of zebrafish. In the first part of this study zebrafish were exposed to three different environmentally relevant concentrations of the synthetic oestrogen17α-ethinylestradiol (EE2) from egg stage to sexual maturity. Secondary sexual characteristics...... as fertilizing the spawned eggs. It was further demonstrated that the exposure to TB led to irreversible masculinisation of zebrafish which is in contrast with the partial reversibility of oestrogen induced sex change. During my investigations leading to this thesis it became apparent that sexual behaviour...... courtship behaviour have only been scarcely investigated. The aim of this project was to learn more about the effects of EDCS on the courtship behaviour and reproduction in zebrafish as well as investigating the reversibility of observed effects. I furthermore observed some interesting aspects...

Interaction between visual and chemical cues in a Liolaemus lizard: a multimodal approach.

Science.gov (United States)

Vicente, Natalin S; Halloy, Monique

2017-12-01

Multimodal communication involves the use of signals and cues across two or more sensory modalities. The genus Liolaemus (Iguania: Liolaemidae) offers a great potential for studies on the ecology and evolution of multimodal communication, including visual and chemical signals. In this study, we analyzed the response of male and female Liolaemus pacha to chemical, visual and combined (multimodal) stimuli. Using cue-isolation tests, we registered the number of tongue flicks and headbob displays from exposure to signals in each modality. Number of tongue flicks was greater when a chemical stimulus was presented alone than in the presence of visual or multimodal stimuli. In contrast, headbob displays were fewer in number with visual and chemical stimuli alone, but significantly higher in number when combined. Female signallers triggered significantly more tongue flicks than male signallers, suggesting that chemical cues are involved in sexual recognition. We did not find an inhibition between chemical and visual cues. On the contrary, we observed a dominance of the chemical modality, because when presented with visual stimuli, lizards also responded with more tongue flicks than headbob displays. The total response produced by multimodal stimuli was similar to that of the chemical stimuli alone, possibly suggesting non-redundancy. We discuss whether the visual component of a multimodal signal could attract attention at a distance, increasing the effectiveness of transmission and reception of the information in chemical cues. Copyright © 2017 Elsevier GmbH. All rights reserved.

Singing-Related Activity in Anterior Forebrain of Male Zebra Finches Reflects Courtship Motivation for Target Females

Science.gov (United States)

Iwasaki, Mai; Poulsen, Thomas M.; Oka, Kotaro; Hessler, Neal A.

2013-01-01

A critical function of singing by male songbirds is to attract a female mate. Previous studies have suggested that the anterior forebrain system is involved in this courtship behavior. Neural activity in this system, including the striatal Area X, is strikingly dependent on the function of male singing. When males sing to attract a female bird rather than while alone, less variable neural activity results in less variable song spectral features, which may be attractive to the female. These characteristics of neural activity and singing thus may reflect a male's motivation for courtship. Here, we compared the variability of neural activity and song features between courtship singing directed to a female with whom a male had previously formed a pair-bond or to other females. Surprisingly, across all units, there was no clear tendency for a difference in variability of neural activity or song features between courtship of paired females, nonpaired females, or dummy females. However, across the population of recordings, there was a significant relationship between the relative variability of syllable frequency and neural activity: when syllable frequency was less variable to paired than nonpaired females, neural activity was also less variable (and vice-versa). These results show that the lower variability of neural activity and syllable frequency during directed singing is not a binary distinction from undirected singing, but can vary in intensity, possibly related to the relative preference of a male for his singing target. PMID:24312344

Characterization of courtship sounds of species of the subgroup fasciola (Diptera, Drosophilidae, Drosophila repleta group: interspecific and interpopulational analyses

Directory of Open Access Journals (Sweden)

C. T. A. COSTA

Full Text Available The aim of this work was to characterize the male courtship song pattern of various species of the fasciola subgroup and to determine the level of variation both within and among species. The parameters analyzed were intrapulse interval (PI, interpulse interval (IPI, and intrapulse frequency (IF. Six different species were analyzed: D. coroica (three populations, D. ellisoni, D. fascioloides, D. moju, D. onca, and D. rosinae (one population each. There were significant differences among the six species for these three courtship song parameters. The IPI was the most variable parameter among these species, suggesting that this parameter is important for female discrimination. Four different hypotheses could explain this variation: 1. different selection pressures with absence of flow gene; 2. intraspecific sexual selection; 3. sympatric effects on song evolution; and 4. genetic drift. The PI was the only parameter that was significantly different among the three population of D. coroica. Low variability among populations within the same species was already observed for other subgroups and could be explained by the following hypotheses: strong selection acting on the song parameters, gene flow, or recent colonization from a common source. Additional studies of the courtship song of other species of the fasciola subgroup, as well as for other subgroups of the repleta group, and studies, using molecular makers, that focus on the genetic basis of the differences among these species in courtship song would allow us to evaluate the association of courtship song and sexual isolation in these species, and would also help us to understand the evolution of these behavioural differences.

Dynamic changes in display architecture and function across environments revealed by a systems approach to animal communication.

Science.gov (United States)

Rosenthal, Malcolm F; Wilkins, Matthew R; Shizuka, Daizaburo; Hebets, Eileen A

2018-02-20

Animal communication is often structurally complex and dynamic, with signaler and receiver behavior varying in response to multiple environmental factors. To date, studies assessing signal dynamics have mostly focused on the relationships between select signaling traits and receiver responses in a single environment. We use the wolf spider Schizocosa floridana to explore the relationships between courtship display form and function across two social contexts (female presence vs absence) and two light environments (light vs dark). We use traditional analytical methods to determine predictors of copulation success (i.e., signal function) and examine these predictors in a structural context by overlaying them on signal phenotype networks (Wilkins et al. 2015). This allows us to explore system design principles (degeneracy, redundancy, pluripotentiality), providing insight into hypotheses regarding complex signal evolution. We found that both social context and light environment affect courtship structure, although the predictors of mating success remain similar across light environments, suggesting system degeneracy. Contrastingly, the same display traits may serve different functions across social environments, suggesting pluripotentiality. Ultimately, our network approach uncovers a complexity in display structure and function that is missed by functional analyses alone, highlighting the importance of systems-based methodologies for understanding the dynamic nature of complex signals. © 2018 The Author(s). Evolution © 2018 The Society for the Study of Evolution.

Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

Science.gov (United States)

Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

2017-10-01

Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

Digital image display system for emergency room

International Nuclear Information System (INIS)

Murry, R.C.; Lane, T.J.; Miax, L.S.

1989-01-01

This paper reports on a digital image display system for the emergency room (ER) in a major trauma hospital. Its objective is to reduce radiographic image delivery time to a busy ER while simultaneously providing a multimodality capability. Image storage, retrieval, and display will also be facilitated with this system. The system's backbone is a token-ring network of RISC and personal computers. The display terminals are higher- function RISC computers with 1,024 2 color or gray-scale monitors. The PCs serve as administrative terminals. Nuclear medicine, CT, MR, and digitized film images are transferred to the image display system

Differential courtship activity and alterations of reproductive success of competing gupply males as an indicator for low concentrations of aquatic pollutants

Energy Technology Data Exchange (ETDEWEB)

Schroeder, J.H.; Peters, K.

1988-09-01

Differential courtship activity of guppy males competing for the same females was used as a bioindicator for low concentrations of water-borne pollutants in a previous study. Patterns of male sexual activity were chosen because they determine reproductive success. The mean difference between courtship activities of two male competitors determines the relative fitness of the male in question. Accordingly, the decrease in mean differential courtship after exposure to aquatic contaminants was predicted to cause a corresponding change in the relative reproductive success. The present study completed the previous one by repeating the experiment with a 10% addition of wastewater drawn from the last clearing basin of a Munich purification plant this time using virgin (non-inseminated) females which were receptive to male courtship. The females subsequently were allowed to produce as many offspring as possible. The number of young guppies sired by individual male competitors could easily be traced by the use of sex-linked phenotypic color patterns as markers. The purpose of these two studies was to show that the quantification of sexual activities of male guppies is useful for monitoring environmental alterations which affect fitness characters.

Semiochemical and Vibrational Cues and Signals Mediating Mate Finding and Courtship in Psylloidea (Hemiptera: A Synthesis

Directory of Open Access Journals (Sweden)

Umar K. Lubanga

2014-07-01

Full Text Available Mate finding and courtship involve complex interactions that require close coordination between individuals of the opposite gender. Well-organized signalling systems, sometimes involving a combination of signal modalities, are required to convey species-specific and individual information to members of the opposite gender. Previous studies of psyllids have focused on single-signal modalities and have largely ignored the potentially interdependent nature of different types of signals. Several studies have shown that semiochemicals play a role in psyllid mate finding. However, long-range semiochemical sex attractants, such as the highly volatile sex pheromones used by many Lepidoptera (molecular weights <300, are yet to be identified. The compounds identified thus far, namely 13-methylheptacosane (from Cacopsylla pyricola and dodecanoic acid (from Diaphorina citri, seem to have short range activity or no activity under field conditions. The possible role played by cuticular hydrocarbons in psyllid courtship remains largely ignored. Conversely, many psyllid species rely on vibrational signals for mate finding and mate assessment during courtship. This apparent disproportional reliance on vibrational rather than semiochemical signals suggests that vibrational signals have been more influential in sexual selection in psyllids. However, male fitness, female choice and benefits accrued from selecting fitter males remain poorly understood.

The sensory substrate of multimodal communication in brown-headed cowbirds: are females sensory 'specialists' or 'generalists'?

Science.gov (United States)

Ronald, Kelly L; Sesterhenn, Timothy M; Fernandez-Juricic, Esteban; Lucas, Jeffrey R

2017-11-01

Many animals communicate with multimodal signals. While we have an understanding of multimodal signal production, we know relatively less about receiver filtering of multimodal signals and whether filtering capacity in one modality influences filtering in a second modality. Most multimodal signals contain a temporal element, such as change in frequency over time or a dynamic visual display. We examined the relationship in temporal resolution across two modalities to test whether females are (1) sensory 'specialists', where a trade-off exists between the sensory modalities, (2) sensory 'generalists', where a positive relationship exists between the modalities, or (3) whether no relationship exists between modalities. We used female brown-headed cowbirds (Molothrus ater) to investigate this question as males court females with an audiovisual display. We found a significant positive relationship between female visual and auditory temporal resolution, suggesting that females are sensory 'generalists'. Females appear to resolve information well across multiple modalities, which may select for males that signal their quality similarly across modalities.

Conventions of Courtship: Gender and Race Differences in the Significance of Dating Rituals

Science.gov (United States)

Jackson, Pamela Braboy; Kleiner, Sibyl; Geist, Claudia; Cebulko, Kara

2011-01-01

Dating rituals include dating--courtship methods that are regularly enacted. This study explores gender and race differences in the relative importance placed on certain symbolic activities previously identified by the dating literature as constituting such rituals. Using information collected from a racially diverse sample of college students (N…

Male courtship preferences demonstrate discrimination against allopatric colour morphs in a cichlid fish.

Science.gov (United States)

Zoppoth, P; Koblmüller, S; Sefc, K M

2013-03-01

Whether premating isolation is achieved by male-specific, female-specific or sex-independent assortative preferences often depends on the underlying evolutionary processes. Here we test mate preferences of males presented with females of different allopatric colour variants of the cichlid fish Tropheus sp., a Lake Tanganyika endemic with rich geographical colour pattern variation, in which the strength of sexual isolation varies between populations. We conducted two-way mate choice experiments to compare behaviour of males of a red-bodied morph (population Moliro) towards females from their own population with behaviour towards females from four allopatric populations at different stages of phylogenetic and phenotypic divergence. Males courted same-population females significantly more intensely than females of other populations, and reduced their heteromorphic courtship efforts both with increasing genetic and increasing phenotypic distinctness of the females. In particular, females of a closely related red-bodied population received significantly more courtship than either genetically distinct, similarly coloured females ('Kirschfleck' morph) or genetically related, differently coloured females ('yellow-blotch' morph), both of which were courted similarly. Genetically and phenotypically distinct females (Tropheus polli) were not courted at all. Consistent with previous female-choice experiments, female courtship activity also decreased with increasing genetic distance from the males' population. Given successful experimental and natural introgression between colour morphs and the pervasive allopatry of related variants, we consider it unlikely that assortative preferences of both sexes were driven by direct selection during periods of secondary contact or, in turn, drove colour pattern differentiation in allopatry. Rather, we suggest that sexual isolation evolved as by-product of allopatric divergence. © 2012 The Authors. Journal of Evolutionary Biology © 2012

Alternative Mating Tactics in Male Chameleons (Chamaeleo chamaeleon) Are Evident in Both Long-Term Body Color and Short-Term Courtship Pattern

Science.gov (United States)

Keren-Rotem, Tammy; Levy, Noga; Wolf, Lior; Bouskila, Amos; Geffen, Eli

2016-01-01

Alternative mating tactics in males of various taxa are associated with body color, body size, and social status. Chameleons are known for their ability to change body color following immediate environmental or social stimuli. In this study, we examined whether the differential appearance of male common chameleon during the breeding season is indeed an expression of alternative mating tactics. We documented body color of males and used computer vision techniques to classify images of individuals into discrete color patterns associated with seasons, individual characteristics, and social contexts. Our findings revealed no differences in body color and color patterns among males during the non-breeding season. However, during the breeding season males appeared in several color displays, which reflected body size, social status, and behavioral patterns. Furthermore, smaller and younger males resembled the appearance of small females. Consequently, we suggest that long-term color change in males during the breeding season reflects male alternative mating tactics. Upon encounter with a receptive female, males rapidly alter their appearance to that of a specific brief courtship display, which reflects their social status. The females, however, copulated indiscriminately in respect to male color patterns. Thus, we suggest that the differential color patterns displayed by males during the breeding season are largely aimed at inter-male signaling. PMID:27409771

Alternative Mating Tactics in Male Chameleons (Chamaeleo chamaeleon Are Evident in Both Long-Term Body Color and Short-Term Courtship Pattern.

Directory of Open Access Journals (Sweden)

Tammy Keren-Rotem

Full Text Available Alternative mating tactics in males of various taxa are associated with body color, body size, and social status. Chameleons are known for their ability to change body color following immediate environmental or social stimuli. In this study, we examined whether the differential appearance of male common chameleon during the breeding season is indeed an expression of alternative mating tactics. We documented body color of males and used computer vision techniques to classify images of individuals into discrete color patterns associated with seasons, individual characteristics, and social contexts. Our findings revealed no differences in body color and color patterns among males during the non-breeding season. However, during the breeding season males appeared in several color displays, which reflected body size, social status, and behavioral patterns. Furthermore, smaller and younger males resembled the appearance of small females. Consequently, we suggest that long-term color change in males during the breeding season reflects male alternative mating tactics. Upon encounter with a receptive female, males rapidly alter their appearance to that of a specific brief courtship display, which reflects their social status. The females, however, copulated indiscriminately in respect to male color patterns. Thus, we suggest that the differential color patterns displayed by males during the breeding season are largely aimed at inter-male signaling.

[Courtship behavior, communicative sound production and resistance to stress in Drosophila mutants with defective agnostic gene, coding for LIMK1].

Science.gov (United States)

Popov, A V; Kaminskaia, A N; Savvateeva-Popova, E V

2009-01-01

To elucidate the role of one of the main elements of signal cascade of actin remodeling--LIM-kinase 1 (LIMK1)--in the control of animal behavior we studied the characteristics of courtship behavior, parameters of acoustic communicative signals and their resistance to heat shock (HS, 37 degrees C, 30 min) in Drosophila melanogaster males from the strain with mutation in locus agnostic (agn(ts3)) containing gene CG1848 for LIMK1. The data obtained was compared with the results of our previous similar investigation on wild type CS males (Popov et al., 2006). Flies were divided into 4 groups. The males of control groups were not subjected to heat shock. The rest of males were subjected to heat shock either at the beginning of larval development when predominantly mushroom body neuroblasts are dividing (groups HS1), or at the prepupal stage when the brain central complex is developing (groups HS2), or at the imago stage one hour before the test (groups HS3). All males were tested at the age of 5 days. Virgin and fertilized CS females were used as courtship objects. Comparison of control groups of the two strains--CS and agnostic--have shown that the mutation agn(ts3) has no influence on the main parameters of courtship behavior of intact (not subjected to HS) males (courtship latency, the rapidity of achieving copulation, courtship efficiency) but leads to lowering of their sexual activity, increase of duration of sound trains in the songs and to slight increase of rate and stability of working of singing pacemakers. Agnostic males in comparison to wild type males are more resistant to HS given 1 hour before the test. After HS their courtship intensity does not decrease and the main parameters of their courtship behavior and communicative sound signals in comparison tu wild type males either do not change, or appear to be even better stabilized. The frequency of distorted sound pulses (an indicator of frequency of impairments in the activity pattern of neuro

Both male and female identity influence variation in male signalling effort

Directory of Open Access Journals (Sweden)

Svensson P Andreas

2011-08-01

Full Text Available Abstract Background Male sexual displays play an important role in sexual selection by affecting reproductive success. However, for such displays to be useful for female mate choice, courtship should vary more among than within individual males. In this regard, a potentially important source of within male variation is adjustment of male courtship effort in response to female traits. Accordingly, we set out to dissect sources of variation in male courtship effort in a fish, the desert goby (Chlamydogobius eremius. We did so by designing an experiment that allowed simultaneous estimation of within and between male variation in courtship, while also assessing the importance of the males and females as sources of courtship variation. Results Although males adjusted their courtship depending on the identity of the female (a potentially important source of within-male variation, among-male differences were considerably greater. In addition, male courtship effort towards a pair of females was highly repeatable over a short time frame. Conclusion Despite the plasticity in male courtship effort, courtship displays had the potential to reliably convey information about the male to mate-searching females. Our experiment therefore underscores the importance of addressing the different sources contributing to variation in the expression of sexually-selected traits.

Genetics of sexual isolation based on courtship song between two sympatric species: Drosophila ananassae and D. pallidosa.

Science.gov (United States)

Yamada, Hirokazu; Matsuda, Muneo; Oguma, Yuzuru

2002-11-01

Sexual isolation has been considered one of the primary causes of speciation and its genetic study has the potential to reveal the genetics of speciation. In Drosophila, the importance of courtship songs in sexual isolation between closely related species has been well investigated, but studies analysing the genetic basis of the difference in the courtship songs associated with sexual isolation are less well documented. Drosophila ananassae and Drosophila pallidosa are useful for studies of sexual isolation, because of their sympatric distribution and absence of postmating isolation. Courtship songs are known to play a crucial role in sexual isolation between these two species, and the female discrimination behaviour against the courting male has been revealed to be controlled by a very narrow region on the second chromosome. In this study we investigated the genetic basis controlling the song differences associated with their sexual isolation, using intact and wingless males with chromosomes substituted between species. The results obtained from F1 hybrid males between these species indicate the dominance of the song characters favoured by D. pallidosa females. In addition, the results obtained from backcross F2 males indicate that chromosome 2 had a major effect on the control of the song characters associated with sexual isolation.

Mate choice in the eye and ear of the beholder? Female multimodal sensory configuration influences her preferences.

Science.gov (United States)

Ronald, Kelly L; Fernández-Juricic, Esteban; Lucas, Jeffrey R

2018-05-16

A common assumption in sexual selection studies is that receivers decode signal information similarly. However, receivers may vary in how they rank signallers if signal perception varies with an individual's sensory configuration. Furthermore, receivers may vary in their weighting of different elements of multimodal signals based on their sensory configuration. This could lead to complex levels of selection on signalling traits. We tested whether multimodal sensory configuration could affect preferences for multimodal signals. We used brown-headed cowbird ( Molothrus ater ) females to examine how auditory sensitivity and auditory filters, which influence auditory spectral and temporal resolution, affect song preferences, and how visual spatial resolution and visual temporal resolution, which influence resolution of a moving visual signal, affect visual display preferences. Our results show that multimodal sensory configuration significantly affects preferences for male displays: females with better auditory temporal resolution preferred songs that were shorter, with lower Wiener entropy, and higher frequency; and females with better visual temporal resolution preferred males with less intense visual displays. Our findings provide new insights into mate-choice decisions and receiver signal processing. Furthermore, our results challenge a long-standing assumption in animal communication which can affect how we address honest signalling, assortative mating and sensory drive. © 2018 The Author(s).

Courtship behaviour of Phlebotomus papatasi the sand fly vector of cutaneous leishmaniasis

Directory of Open Access Journals (Sweden)

Chelbi Ifhem

2012-08-01

Full Text Available Abstract Background The sand fly Phlebotomus papatasi is an Old World vector of Leishmania major, the etiologic agent of zoonotic cutaneous leishmaniasis. This study describes the courtship behaviour of P. papatasi and compares it with that of Lutzomyia longipalpis, the New World vector of visceral leishmaniasis. Understanding the details of courtship behaviour in P. papatasi may help us to understand the role of sex pheromones in this important vector. Results P. papatasi courtship was found to start with the female touching the male, leading him to begin abdomen bending and wing flapping. Following a period of leg rubbing and facing, the male flaps his wings while approaching the female. The female then briefly flaps her wings in response, to indicate that she is willing to mate, thereby signaling the male to begin copulation. Male P. papatasi did not engage in parading behaviour, which is performed by male L. longipalpis to mark out individual territories during lekking (the establishment and maintenance of mating aggregations, or wing-flap during copulation, believed to function in the production of audio signals important to mate recognition. In P. papatasi the only predictor of mating success for males was previous copulation attempts and for females stationary wing-flapping. By contrast, male L. longipalpis mating success is predicted by male approach-flapping and semi-circling behaviour and for females stationary wing-flapping. Conclusions The results show that there are important differences between the mating behaviours of P. papatasi and L. longipalpis. Abdomen bending, which does not occur in L. longipalpis, may act in the release of sex pheromone from an as yet unidentified site in the male abdomen. In male L. longipalpis wing-flapping is believed to be associated with distribution of male pheromone. These different behaviours are likely to signify significant differences in how pheromone is used, an observation that is consistent

Learning of courtship components in Drosophila mercatorum (Paterson & Wheller (Diptera, Drosophilidae Aprendizado de corte sexual em Drosophila mercatorum (Paterson & Wheller (Diptera, Drosophilidae

Directory of Open Access Journals (Sweden)

Andrei Polejack

2007-03-01

Full Text Available In Drosophila, courtship is an elaborate sequence of behavioural patterns that enables the flies to identify conspecific mates from those of closely related species. This is important because drosophilids usually gather in feeding sites, where males of various species court females vigorously. We investigated the effects of previous experience on D. mercatorum courtship, by testing if virgin males learn to improve their courtship by observing other flies (social learning, or by adjusting their pre-existent behaviour based on previous experiences (facilitation. Behaviours recorded in a controlled environment were courtship latency, courtship (orientation, tapping and wing vibration, mating and other behaviours not related to sexual activities. This study demonstrated that males of D. mercatorum were capable of improving their mating ability based on prior experiences, but they had no social learning on the development of courtship.Em Drosophila, a corte sexual consiste em uma elaborada seqüência de padrões comportamentais que possibilita às moscas reconhecer parceiros conspecíficos dentre indivíduos de outras espécies. Essa discriminação é importante uma vez que drosofilídeos geralmente se agregam em sítios de alimentação, onde machos de diversas espécies cortejam as fêmeas vigorosamente. Neste estudo, testamos se machos virgens aprimoram seu comportamento de corte mediante a observação do cortejo de outras moscas da população (aprendizado social, ou mediante experiências próprias anteriores (facilitação. O comportamento de corte das moscas, observado em ambiente controlado, foi registrado com relação aos seguintes componentes: latência da corte, duração da corte (orientação, "tapping" e vibração das asas, cópula, e outros comportamentos não relacionados à corte sexual. Os resultados aqui obtidos sugerem que machos de D. mercatorum são capazes de aprimorar sua habilidade de cortejar fêmeas em função de

Modification of Male Courtship Motivation by Olfactory Habituation via the GABAA Receptor in Drosophila melanogaster

Science.gov (United States)

Tachibana, Shin-Ichiro; Touhara, Kazushige; Ejima, Aki

2015-01-01

A male-specific component, 11-cis-vaccenyl acetate (cVA) works as an anti-aphrodisiac pheromone in Drosophila melanogaster. The presence of cVA on a male suppresses the courtship motivation of other males and contributes to suppression of male-male homosexual courtship, while the absence of cVA on a female stimulates the sexual motivation of nearby males and enhances the male-female interaction. However, little is known how a male distinguishes the presence or absence of cVA on a target fly from either self-produced cVA or secondhand cVA from other males in the vicinity. In this study, we demonstrate that male flies have keen sensitivity to cVA; therefore, the presence of another male in the area reduces courtship toward a female. This reduced level of sexual motivation, however, could be overcome by pretest odor exposure via olfactory habituation to cVA. Real-time imaging of cVA-responsive sensory neurons using the neural activity sensor revealed that prolonged exposure to cVA decreased the levels of cVA responses in the primary olfactory center. Pharmacological and genetic screening revealed that signal transduction via GABAA receptors contributed to this olfactory habituation. We also found that the habituation experience increased the copulation success of wild-type males in a group. In contrast, transgenic males, in which GABA input in a small subset of local neurons was blocked by RNAi, failed to acquire the sexual advantage conferred by habituation. Thus, we illustrate a novel phenomenon in which olfactory habituation positively affects sexual capability in a competitive environment. PMID:26252206

Methyltestosterone-induced changes in electro-olfactogram responses and courtship behaviors of cyprinids.

Science.gov (United States)

Belanger, Rachelle M; Pachkowski, Melanie D; Stacey, Norm E

2010-01-01

In the tinfoil barb (Barbonymus schwanenfeldii; family Cyprinidae), we previously found that increased olfactory sensitivity to a female prostaglandin pheromone could induce sexual behavior display in juvenile fish treated with androgens. Here, we determined if this phenomenon is widespread among cyprinid fishes by adding 17alpha-methyltestosterone (MT) to aquaria containing juveniles of 4 cyprinid species (tinfoil barbs; redtail sharkminnows, Epalzeorhynchos bicolor; goldfish, Carassius auratus; zebrafish, Danio rerio) and then using electro-olfactogram (EOG) recordings and behavioral assays to determine if androgen treatment enhances pheromone detection and male sex behaviors. In all 4 cyprinids, MT treatment increased the magnitudes and sensitivities of EOG response to prostaglandins and, consistent with our initial study on tinfoil barbs, did not affect EOG responses to the free and conjugated steroid to which each species is most sensitive. In zebrafish, EOG responses to prostaglandins were similar in MT-treated juveniles and adult males, whereas responses of control (ethanol exposed) fish were similar to those of adult females. Finally, as previously observed in tinfoil barbs, MT treatment of juvenile redtail sharkminnows increased courtship behaviors (nuzzling and quivering) with a stimulus fish. We conclude that androgen-induced increase in olfactory responsiveness to pheromonal prostaglandins is common among the family Cyprinidae. This phenomenon will help us unravel the development of sexually dimorphic olfactory-mediated behavior.

Female genitalia concealment promotes intimate male courtship in a water strider.

Directory of Open Access Journals (Sweden)

Chang S Han

2009-06-01

Full Text Available Violent coercive mating initiation is typical for animals with sexual conflict over mating. In these species, the coevolutionary arms-race between female defenses against coercive mating and male counter-adaptations for increased mating success leads to coevolutionary chases of male and female traits that influence the mating. It has been controversial whether one of the sexes can evolve traits that allow them to "win" this arms race. Here, we use morphological analysis (traditional and scanning electron micrographs, laboratory experiments and comparative methods to show how females of a species characterized by typical coercive mating initiation appear to "win" a particular stage of the sexual conflict by evolving morphology to hide their genitalia from direct, forceful access by males. In an apparent response to the female morphological adaptation, males of this species added to their typically violent coercive mounting of the female new post-mounting, pre-copulatory courtship signals produced by tapping the water's surface with the mid-legs. These courtship signals are intimate in the sense that they are aimed at the female, on whom the male is already mounted. Females respond to the signals by exposing their hidden genitalia for copulatory intromission. Our results indicate that the apparent victory of coevolutionary arms race by one sex in terms of morphology may trigger evolution of a behavioral phenotype in the opposite sex.

Courtship pheromones in parasitic wasps: comparison of bioactive and inactive hydrocarbon profiles by multivariate statistical methods

NARCIS (Netherlands)

Steiner, S.; Mumm, R.; Ruther, J.

2007-01-01

Cuticular hydrocarbons play a significant role in the regulation of cuticular permeability and also in the chemical communication of insects. In the parasitoid Lariophagus distinguendus (Hymenoptera: Pteromalidae), male courtship behavior is mediated by a female-produced sex pheromone. Previous

MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony

Directory of Open Access Journals (Sweden)

Anton Čižmár

2009-10-01

Full Text Available In this paper the project MobilTel ispresented. The communication itself is becoming amultimodal interactive process. The MobilTel projectprovides research and development activities inmultimodal interfaces area. The result is a functionalarchitecture for mobile multimodal telecommunicationsystem running on handheld device. The MobilTelcommunicator is a multimodal Slovak speech andgraphical interface with integrated VoIP client. Theother possible modalities are pen – touch screeninteraction, keyboard, and display on which theinformation is more user friendly presented (icons,emoticons, etc., and provides hyperlink and scrollingmenu availability.We describe the method of interaction between mobileterminal (PDA and MobilTel multimodal PCcommunicator over a VoIP WLAN connection basedon SIP protocol. We also present the graphicalexamples of services that enable users to obtaininformation about weather or information about trainconnection between two train stations.

Moths produce extremely quiet ultrasonic courtship songs by rubbing specialized scales

DEFF Research Database (Denmark)

Nakano, Ryo; Skals, Niels; Takanashi, Takuma

2008-01-01

level at 1 cm) adapted for private sexual communication in the Asian corn borer moth, Ostrinia furnacalis. During courtship, the male rubs specialized scales on the wing against those on the thorax to produce the songs, with the wing membrane underlying the scales possibly acting as a sound resonator....... The male's song suppresses the escape behavior of the female, thereby increasing his mating success. Our discovery of extremely low-intensity ultrasonic communication may point to a whole undiscovered world of private communication, using "quiet" ultrasound....

Patterns of resistance and transgression in Eastern Indonesia: single women's practices of clandestine courtship and cohabitation.

Science.gov (United States)

Bennett, Linda Rae

2005-03-01

This paper explores how single women in the regional Indonesian city of Mataram express sexual desire in a social, cultural and political climate that idealizes the confinement of female sexuality within marriage. It is based on 21 months of ethnographic fieldwork conducted with single women, their families and health care providers. Success for young women in negotiating sexual desire is dependent upon their ability to maintain a faultless public reputation and mediate between their desires and those of men. Many single women find ways to pursue their desires by bending the rules of courtship conventions, performing sexual purity in public, while resisting from within the hegemonic sexual culture. However, women who visibly transgress dominant sexual ideals (and in doing so offend the status quo) are stigmatized and ostracized. Single women's practice of resistance and sexual transgression in premarital relationships are represented using the examples of pacaran backstreet (clandestine courtship) and cohabitation prior to marriage.

Student displays of academic competence in the international university

DEFF Research Database (Denmark)

Kristiansen, Elisabeth Dalby

that there may be a connection, on the one hand between students'​ orientation to language as a relevant ressource for displaying academic competence and the project report as the sole product of the students'​ project, and on the other hand between the orientation to multimodal resources for displaying academic......The study presents an ethnomethodologically founded understanding of academic competence as situated social practices displayed in and through social interaction. The project uses Conversation Analysis as a method for describing such displays of competence. The project describes the conversational...... phenomenon of the 'Writing aloud Voice'​ (WAV) and describes how students use WAV sequences to demonstrate their knowledge of and ability to use certain academic conventions for formulating research questions. This constitutes one method for displaying academic competence. The project also describes...

A multimodal parallel architecture: A cognitive framework for multimodal interactions.

Science.gov (United States)

Cohn, Neil

2016-01-01

Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

Perceived Synchrony of Frog Multimodal Signal Components Is Influenced by Content and Order.

Science.gov (United States)

Taylor, Ryan C; Page, Rachel A; Klein, Barrett A; Ryan, Michael J; Hunter, Kimberly L

2017-10-01

Multimodal signaling is common in communication systems. Depending on the species, individual signal components may be produced synchronously as a result of physiological constraint (fixed) or each component may be produced independently (fluid) in time. For animals that rely on fixed signals, a basic prediction is that asynchrony between the components should degrade the perception of signal salience, reducing receiver response. Male túngara frogs, Physalaemus pustulosus, produce a fixed multisensory courtship signal by vocalizing with two call components (whines and chucks) and inflating a vocal sac (visual component). Using a robotic frog, we tested female responses to variation in the temporal arrangement between acoustic and visual components. When the visual component lagged a complex call (whine + chuck), females largely rejected this asynchronous multisensory signal in favor of the complex call absent the visual cue. When the chuck component was removed from one call, but the robofrog inflation lagged the complex call, females responded strongly to the asynchronous multimodal signal. When the chuck component was removed from both calls, females reversed preference and responded positively to the asynchronous multisensory signal. When the visual component preceded the call, females responded as often to the multimodal signal as to the call alone. These data show that asynchrony of a normally fixed signal does reduce receiver responsiveness. The magnitude and overall response, however, depend on specific temporal interactions between the acoustic and visual components. The sensitivity of túngara frogs to lagging visual cues, but not leading ones, and the influence of acoustic signal content on the perception of visual asynchrony is similar to those reported in human psychophysics literature. Virtually all acoustically communicating animals must conduct auditory scene analyses and identify the source of signals. Our data suggest that some basic

Social interactions in different environments impacts and motivates reproductive displays in college students

Directory of Open Access Journals (Sweden)

J. Wortham

2017-06-01

Full Text Available Social environments can have an impact on the interactions between the sexes, specifically pre-courtship behaviors. Sexual selection theory may explain social interactions of the sexes, where males display and attract mates more than females. These behaviors may intensify in a sexual environment. It was hypothesized that individuals would display more in a sexualized environment compared to a non-sexualized location. This research sampled N = 880 participants at a university in a southern state in North America and asked which unisex sunglasses they preferred. While the most popular non-showy sunglasses were selected the most, showy new arrival sunglasses were selected more often when the surveyor’s behavior was flirty, compared to normal behavior and dressing sexy. Thus, social interactions such as flirting between the sexes impacted the behaviors of others and increased the intensity of reproductive displays. At the location with sexualized behaviors and dress, individuals selected the non-showy sunglasses, possibly to draw attention to their bodies in swimsuits, whereas at the non-sexy location, new arrivals were chosen at a higher frequency, possibly to stand out when wearing normal clothes. The sexes chose to stand out at equal frequencies as did single participants and people in a relationship, suggesting that all individuals are trying to display and attract mates equally. Social environments impacted display behaviors and the motivation to display is discussed. Keywords: Sociology, Psychology

Acoustic courtship songs in males of the fruit fly Anastrepha ludens (Diptera: Tephritidae associated with geography, mass rearing and courtship success

Directory of Open Access Journals (Sweden)

R.D Briceño

2009-11-01

Full Text Available The Sterile Insect Technique (SIT has been used successfully to control or eradicate fruit flies. The commonly observed inferiority of mass-reared males, compared with wild males, when they are paired with wild females, is apparently due to their inadequate courtship. Anastrepha ludens males produce two types of wing vibration during courtship and mating, the "calling sound" and the "premating or precopulatory sound". There were clear differences in the calling songs between successful and unsuccessful courtships in sterile (irradiated and fertile Mexican flies. Among sterile flies, successful males produce longer buzzes, shorter interpulses and a higher power spectrum in the signal. Fertile flies showed the same trend. For mating songs a significant difference occurred in two parameters: power spectrum between sterile and fertile flies with respect to the type of song, and the signal duration and intensity were greater in non-irradiated flies. Calling songs of wild flies compared with laboratory grown flies from Mexico had shorter interpulses, longer pulses, and a greater power spectrum. However, in the case of premating songs, the only difference was in the intensity, which was significantly greater in wild males. An unexpected result was not observing pulses during pheromone deposition in wild males from Costa Rica. Comparing the premating songs of wild flies from Costa Rica and Mexico, no significant differences were observed in the duration, and the intensity of the signal was slightly greater in flies from Mexico. Rev. Biol. Trop. 57 (Suppl. 1: 257-265. Epub 2009 November 30.La técnica estéril del insecto (SIT se ha utilizado con éxito para controlar o para suprimir las moscas de fruta y su impacto en los cultivos. La inferioridad comúnmente observada de machos criados masivamente, comparada con los machos silvestres, cuando se aparean con las hembras silvestres es al parecer debido a su inadecuado cortejo. Los machos de Anastrepha

Highly tissue specific expression of Sphinx supports its male courtship related role in Drosophila melanogaster.

Science.gov (United States)

Chen, Ying; Dai, Hongzheng; Chen, Sidi; Zhang, Luoying; Long, Manyuan

2011-04-26

Sphinx is a lineage-specific non-coding RNA gene involved in regulating courtship behavior in Drosophila melanogaster. The 5' flanking region of the gene is conserved across Drosophila species, with the proximal 300 bp being conserved out to D. virilis and a further 600 bp region being conserved amongst the melanogaster subgroup (D. melanogaster, D. simulans, D. sechellia, D. yakuba, and D. erecta). Using a green fluorescence protein transformation system, we demonstrated that a 253 bp region of the highly conserved segment was sufficient to drive sphinx expression in male accessory gland. GFP signals were also observed in brain, wing hairs and leg bristles. An additional ∼800 bp upstream region was able to enhance expression specifically in proboscis, suggesting the existence of enhancer elements. Using anti-GFP staining, we identified putative sphinx expression signal in the brain antennal lobe and inner antennocerebral tract, suggesting that sphinx might be involved in olfactory neuron mediated regulation of male courtship behavior. Whole genome expression profiling of the sphinx knockout mutation identified significant up-regulated gene categories related to accessory gland protein function and odor perception, suggesting sphinx might be a negative regulator of its target genes.

Highly tissue specific expression of Sphinx supports its male courtship related role in Drosophila melanogaster.

Directory of Open Access Journals (Sweden)

Ying Chen

2011-04-01

Full Text Available Sphinx is a lineage-specific non-coding RNA gene involved in regulating courtship behavior in Drosophila melanogaster. The 5' flanking region of the gene is conserved across Drosophila species, with the proximal 300 bp being conserved out to D. virilis and a further 600 bp region being conserved amongst the melanogaster subgroup (D. melanogaster, D. simulans, D. sechellia, D. yakuba, and D. erecta. Using a green fluorescence protein transformation system, we demonstrated that a 253 bp region of the highly conserved segment was sufficient to drive sphinx expression in male accessory gland. GFP signals were also observed in brain, wing hairs and leg bristles. An additional ∼800 bp upstream region was able to enhance expression specifically in proboscis, suggesting the existence of enhancer elements. Using anti-GFP staining, we identified putative sphinx expression signal in the brain antennal lobe and inner antennocerebral tract, suggesting that sphinx might be involved in olfactory neuron mediated regulation of male courtship behavior. Whole genome expression profiling of the sphinx knockout mutation identified significant up-regulated gene categories related to accessory gland protein function and odor perception, suggesting sphinx might be a negative regulator of its target genes.

Theropod courtship: large scale physical evidence of display arenas and avian-like scrape ceremony behaviour by Cretaceous dinosaurs.

Science.gov (United States)

Lockley, Martin G; McCrea, Richard T; Buckley, Lisa G; Lim, Jong Deock; Matthews, Neffra A; Breithaupt, Brent H; Houck, Karen J; Gierliński, Gerard D; Surmik, Dawid; Kim, Kyung Soo; Xing, Lida; Kong, Dal Yong; Cart, Ken; Martin, Jason; Hadden, Glade

2016-01-07

Relationships between non-avian theropod dinosaurs and extant and fossil birds are a major focus of current paleobiological research. Despite extensive phylogenetic and morphological support, behavioural evidence is mostly ambiguous and does not usually fossilize. Thus, inferences that dinosaurs, especially theropods displayed behaviour analogous to modern birds are intriguing but speculative. Here we present extensive and geographically widespread physical evidence of substrate scraping behavior by large theropods considered as compelling evidence of "display arenas" or leks, and consistent with "nest scrape display" behaviour among many extant ground-nesting birds. Large scrapes, up to 2 m in diameter, occur abundantly at several Cretaceous sites in Colorado. They constitute a previously unknown category of large dinosaurian trace fossil, inferred to fill gaps in our understanding of early phases in the breeding cycle of theropods. The trace makers were probably lekking species that were seasonally active at large display arena sites. Such scrapes indicate stereotypical avian behaviour hitherto unknown among Cretaceous theropods, and most likely associated with terrirorial activity in the breeding season. The scrapes most probably occur near nesting colonies, as yet unknown or no longer preserved in the immediate study areas. Thus, they provide clues to paleoenvironments where such nesting sites occurred.

When less is best: female brown-headed cowbirds prefer less intense male displays.

Science.gov (United States)

O'Loghlen, Adrian L; Rothstein, Stephen I

2012-01-01

Sexual selection theory predicts that females should prefer males with the most intense courtship displays. However, wing-spread song displays that male brown-headed cowbirds (Molothrus ater) direct at females are generally less intense than versions of this display that are directed at other males. Because male-directed displays are used in aggressive signaling, we hypothesized that females should prefer lower intensity performances of this display. To test this hypothesis, we played audiovisual recordings showing the same males performing both high intensity male-directed and low intensity female-directed displays to females (N = 8) and recorded the females' copulation solicitation display (CSD) responses. All eight females responded strongly to both categories of playbacks but were more sexually stimulated by the low intensity female-directed displays. Because each pair of high and low intensity playback videos had the exact same audio track, the divergent responses of females must have been based on differences in the visual content of the displays shown in the videos. Preferences female cowbirds show in acoustic CSD studies are correlated with mate choice in field and captivity studies and this is also likely to be true for preferences elucidated by playback of audiovisual displays. Female preferences for low intensity female-directed displays may explain why male cowbirds rarely use high intensity displays when signaling to females. Repetitive high intensity displays may demonstrate a male's current condition and explain why these displays are used in male-male interactions which can escalate into physical fights in which males in poorer condition could be injured or killed. This is the first study in songbirds to use audiovisual playbacks to assess how female sexual behavior varies in response to variation in a male visual display.

A Multi-Mode Video Driver for a High Resolution LCoS Display

OpenAIRE

Farrell, Ronan; Jacob, Mark; Maher, Roger

2000-01-01

This paper describes the design of a display driver for Liquid Crystal on Silicon (LCoS) microdisplays. These are high resolution reflective display devices which allow up to 1280x1024 pixels on an area of 3.75cm2, and are typically refreshed at 120Hz. The required driver consists of a digital section capable of taking the common display formats such as SVGA and new formats, SXGA, and processing these to a common 120HzRGB signal, requiring an output rate of 160 mega-pixels/second. This signal...

The Effect of Multimodal Feedback on Perceived Exertion on a VR Exercise Setting

DEFF Research Database (Denmark)

Bruun-Pedersen, Jon Ram; Andersen, Morten G.; Clemmesen, Mathias M.

2018-01-01

This paper seeks to determine if multimodal feedback, from auditory and haptic stimuli, can affect a user’s perceived exertion in a virtual reality setting. A simple virtual environment was created in the style of a desert to minimize the amount of visual distractions; a head mounted display was ...

Female novelty and the courtship behavior of male guinea pigs (Cavia porcellus

Directory of Open Access Journals (Sweden)

Cohn D.W.H.

2004-01-01

Full Text Available In several rodent species, an increase or recovery of sexual behavior can be observed when sexually satiated males are placed in contact with a novel mate. In order to assess the influence of female novelty on the courtship behavior of guinea pigs (Cavia porcellus, four adult males were observed during four daily 15-min sessions while interacting with the same pregnant female (same-female sessions. A new female was presented during the fifth session (switched-female session. The duration of behavioral categories was obtained from videotape records using an observational software. From the first to the second session, all males decreased the time allocated to investigating (sniffing and licking, following, and mounting the female, and that response did not recover by the end of the same-female sessions. No similar decreasing tendencies were detected in the circling or rumba categories. A marked increase of investigating occurred in all males from the last same-female session (8.1, 11.9, 15.1 and 17.3 percent session time to the switched-female one (16.4, 18.4, 37.1 and 28.9 percent session time, respectively. Increases in following and circling were recorded in three of four males, and full-blown recovery of mounting in one male. No consistent changes in the females' responses to males (following or attacking were observed throughout testing. These results are consistent with the hypothesis that guinea pig males recognize individual females and that courtship responses may suffer a habituation/recovery process controlled by mate novelty.

Moths are not silent, but whisper ultrasonic courtship songs

DEFF Research Database (Denmark)

Nakano, R; Takanashi, T; Fujii, T

2009-01-01

) were recently shown to whisper extremely low-intensity ultrasonic courtship songs close to females. Since low sound levels will prevent eavesdropping by predators, parasites and conspecific rivals, we predicted low intensity ultrasound communication to be widespread among moths. Here we tested 13...... species of moths including members of the Noctuidae, Arctiidae, Geometridae and Crambidae. Males of nine species, 70%, produced broadband ultrasound close to females. Peak frequencies ranged from 38 to above 100 kHz. All sounds were of low intensity, 43-76 dB SPL at 1 cm [64+/-10 dB peSPL (mean +/- s......Ultrasonic hearing is widespread among moths, but very few moth species have been reported to produce ultrasounds for sexual communication. In those that do, the signals are intense and thus well matched for long distance communication. By contrast, males of the Asian corn borer moth (Crambidae...

Applying Connectivist Principles and the Task-Based Approach to the Design of a Multimodal Didactic Unit

Directory of Open Access Journals (Sweden)

Yeraldine Aldana Gutiérrez

2012-12-01

Full Text Available This article describes the pedagogical intervention developed in a public school as part of the research “Exploring Communications Practices through Facebook as a Mediatic Device”, framed within the computer mediated communications field. Twelve ninth graders’ communications practices were explored and addressed by means of multimodal technological resources and tasks based on the connectivist learning view. As a result, a didactic unit was designed in the form of the digital book Diverface. This one in turn displayed information through different media channels and semiotic elements to support its multimodal features. Teachers and students might thus need to reconstruct an alternative multimodal literacy so that they can produce and interpret texts of the same nature in online environments.

Fan-Shaped Body Neurons Are Involved in "Period"-Dependent Regulation of Long-Term Courtship Memory in "Drosophila"

Science.gov (United States)

Sakai, Takaomi; Inami, Show; Sato, Shoma; Kitamoto, Toshihiro

2012-01-01

In addition to its established function in the regulation of circadian rhythms, the "Drosophila" gene "period" ("per") also plays an important role in processing long-term memory (LTM). Here, we used courtship conditioning as a learning paradigm and revealed that (1) overexpression and knocking down of "per" in subsets of brain neurons enhance and…

Multimodal responsive action

DEFF Research Database (Denmark)

Oshima, Sae

; Raymond 2003; Schegloff and Lerner 2009), including those with multimodal actions (e.g. Olsher 2004; Fasulo & Monzoni 2009). Some responsive actions can also be completed with bodily behavior alone, such as: when an agreement display is achieved by using only nonvocal actions (Jarmon 1996), when...... the recipient’s gaze shift becomes a significant part of the speaker’s turn construction (Goodwin 1980), and when head nods show the recipient’s affiliation with the speaker’s stance (Stivers 2008). Still, much room remains for extending our current understanding of responding actions that necessarily involve...... a hairstylist and a client negotiate the quality of the service that has been provided. Here, the first action is usually the stylist’s question and/or explanation of the new cut that invites the client’s assessment/(dis)agreement, accompanied with embodied actions that project an imminent self...

Do circadian genes and ambient temperature affect substrate-borne signalling during Drosophila courtship?

Directory of Open Access Journals (Sweden)

Izarne Medina

2015-11-01

Full Text Available Courtship vibratory signals can be air-borne or substrate-borne. They convey distinct and species-specific information from one individual to its prospective partner. Here, we study the substrate-borne vibratory signals generated by the abdominal quivers of the Drosophila male during courtship; these vibrations travel through the ground towards courted females and coincide with female immobility. It is not known which physical parameters of the vibrations encode the information that is received by the females and induces them to pause. We examined the intervals between each vibratory pulse, a feature that was reported to carry information for animal communication. We were unable to find evidence of periodic variations in the lengths of these intervals, as has been reported for fly acoustical signals. Because it was suggested that the genes involved in the circadian clock may also regulate shorter rhythms, we search for effects of period on the interval lengths. Males that are mutant for the period gene produced vibrations with significantly altered interpulse intervals; also, treating wild type males with constant light results in similar alterations to the interpulse intervals. Our results suggest that both the clock and light/dark cycles have input into the interpulse intervals of these vibrations. We wondered if we could alter the interpulse intervals by other means, and found that ambient temperature also had a strong effect. However, behavioural analysis suggests that only extreme ambient temperatures can affect the strong correlation between female immobility and substrate-borne vibrations.

Behavioral and neural lateralization of vision in courtship singing of the zebra finch.

Science.gov (United States)

George, Isabelle; Hara, Erina; Hessler, Neal A

2006-09-01

Along with human speech and language processing, birdsong has been one of the best-characterized model systems for understanding the relationship of lateralization of brain function to behavior. Lateralization of song production has been extensively characterized, and lateralization of song perception has begun to be studied. Here we have begun to examine whether behavior and brain function are lateralized in relation to communicative aspects of singing, as well. In order to monitor central brain function, we assayed the levels of several activity dependent immediate early genes after directed courtship singing. Consistent with a lateralization of visual processing during communication, there were higher levels of expression of both egr-1 and c-fos in the left optic tectum after directed singing. Because input from the eyes to the brain is almost completely contralateral in birds, these results suggest that visual input from the right eye should be favored during normal singing to females. Consistent with this, we further found that males sang more when they could use only their right eye compared to when they could use only their left eye. Normal levels of singing, though, required free use of both eyes to view the female. These results suggest that there is a preference for visual processing by the right eye and left brain hemisphere during courtship singing. This may reflect a proposed specialization of the avian left hemisphere in sustaining attention on stimuli toward which a motor response is planned.

Evaluation of selectivity in homologous multimodal chromatographic systems using in silico designed antibody fragment libraries.

Science.gov (United States)

Karkov, Hanne Sophie; Woo, James; Krogh, Berit Olsen; Ahmadian, Haleh; Cramer, Steven M

2015-12-24

This study describes the in silico design, surface property analyses, production and chromatographic evaluations of a diverse set of antibody Fab fragment variants. Based on previous findings, we hypothesized that the complementarity-determining regions (CDRs) constitute important binding sites for multimodal chromatographic ligands. Given that antibodies are highly diversified molecules and in particular the CDRs, we set out to examine the generality of this result. For this purpose, four different Fab fragments with different CDRs and/or framework regions of the variable domains were identified and related variants were designed in silico. The four Fab variant libraries were subsequently generated by site-directed mutagenesis and produced by recombinant expression and affinity purification to enable examination of their chromatographic retention behavior. The effects of geometric re-arrangement of the functional moieties on the multimodal resin ligands were also investigated with respect to Fab variant retention profiles by comparing two commercially available multimodal cation-exchange ligands, Capto MMC and Nuvia cPrime, and two novel multimodal ligand prototypes. Interestingly, the chromatographic data demonstrated distinct selectivity trends between the four Fab variant libraries. For three of the Fab libraries, the CDR regions appeared as major binding sites for all multimodal ligands. In contrast, the fourth Fab library displayed a distinctly different chromatographic behavior, where Nuvia cPrime and related multimodal ligand prototypes provided markedly improved selectivity over Capto MMC. Clearly, the results illustrate that the discriminating power of multimodal ligands differs between different Fab fragments. The results are promising indications that multimodal chromatography using the appropriate multimodal ligands can be employed in downstream bioprocessing for challenging selective separation of product related variants. Copyright © 2015 Elsevier B

Multimodality and Ambient Intelligence

NARCIS (Netherlands)

Nijholt, Antinus; Verhaegh, W.; Aarts, E.; Korst, J.

2004-01-01

In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments

The impact of fMRI on multimodal navigation in surgery of cerebral lesions: four years clinical experience

International Nuclear Information System (INIS)

Wurm, Gabriele; Schnizer, Mathilde; Fellner, Claudia

2008-01-01

Neuronavigation with display of intraoperative structures, instrument locations, orientation and relationships to nearby structures can increase anatomic precision while enhancing the surgeon's confidence and his/her perception of safety. Combination of neuronavigation with functional imaging provides multimodal guidance for surgery of cerebral lesions. We evaluated the impact of functional MRI (fMRI) on surgical decision making and outcome. A neuronavigational device (StealthStation (tm), Medtronic Inc.) was used as platform to merge fMRI data with anatomic images, and to implement intraoperative multimodal guidance. In a 52-month period, where 977 surgical procedures were performed with the aid of neuronavigation, 88 patients underwent image-guided procedures using multimodal guidance. Patient, surgical and outcome data of this series was prospectively collected. Evaluation of 88 procedures on cerebral lesions in complex regions where fMRI data were integrated using the navigation system demonstrated that the additional information was presented in a user-friendly way. Computer assisted fMRI integration was found to be especially helpful in planning the best approach, in assessing alternative approaches, and in defining the extent of the surgical exposure. Furthermore, the surgeons found it more effective to interpret fMRI information when shown in a navigation system as compared to the traditional display on a light board or monitor. Multimodal navigation enhanced by fMRI was judged useful for optimization of surgery of cerebral lesions, especially in and around eloquent regions by experienced neurosurgeons. (orig.)

Signal complexity and modular organization of the courtship behaviours of two sibling species of wolf spiders (Araneae: Lycosidae).

Science.gov (United States)

Chiarle, Alberto; Isaia, Marco

2013-07-01

In this study, we compare the courtship behaviours of Pardosa proxima and P. vlijmi, two species of wolf spiders up to now regarded as "ethospecies", by means of motion analysis methodologies. In particular, we investigate the features of the signals, aiming at understanding the evolution of the courtship and its role in species delimitation and speciation processes. In our model, we highlight a modular structure of the behaviours and the presence of recurring units and phases. According to other similar cases concerning animal communication, we observed one highly variable and one stereotyped phase for both species. The stereotyped phase is here regarded as a signal related to species identity or an honest signal linked directly to the quality of the signaler. On the contrary, the variable phase aims to facilitate signal detection and assessment by the female reducing choice costs or errors. Variable phases include cues arisen from Fisherian runaway selection, female sensory exploitation and remaining of past selections. Copyright © 2013 Elsevier B.V. All rights reserved.

Theropod courtship: large scale physical evidence of display arenas and avian-like scrape ceremony behaviour by Cretaceous dinosaurs

Science.gov (United States)

Lockley, Martin G.; McCrea, Richard T.; Buckley, Lisa G.; Deock Lim, Jong; Matthews, Neffra A.; Breithaupt, Brent H.; Houck, Karen J.; Gierliński, Gerard D.; Surmik, Dawid; Soo Kim, Kyung; Xing, Lida; Yong Kong, Dal; Cart, Ken; Martin, Jason; Hadden, Glade

2016-01-01

Relationships between non-avian theropod dinosaurs and extant and fossil birds are a major focus of current paleobiological research. Despite extensive phylogenetic and morphological support, behavioural evidence is mostly ambiguous and does not usually fossilize. Thus, inferences that dinosaurs, especially theropods displayed behaviour analogous to modern birds are intriguing but speculative. Here we present extensive and geographically widespread physical evidence of substrate scraping behavior by large theropods considered as compelling evidence of “display arenas” or leks, and consistent with “nest scrape display” behaviour among many extant ground-nesting birds. Large scrapes, up to 2 m in diameter, occur abundantly at several Cretaceous sites in Colorado. They constitute a previously unknown category of large dinosaurian trace fossil, inferred to fill gaps in our understanding of early phases in the breeding cycle of theropods. The trace makers were probably lekking species that were seasonally active at large display arena sites. Such scrapes indicate stereotypical avian behaviour hitherto unknown among Cretaceous theropods, and most likely associated with terrirorial activity in the breeding season. The scrapes most probably occur near nesting colonies, as yet unknown or no longer preserved in the immediate study areas. Thus, they provide clues to paleoenvironments where such nesting sites occurred.

Strategic exploitation of fluctuating asymmetry in male Endler’s guppy courtship displays is modulated by social environment

Czech Academy of Sciences Publication Activity Database

Řežucha, Radomil; Reichard, Martin

2015-01-01

Roč. 28, č. 2 (2015), s. 356-367 ISSN 1010-061X R&D Projects: GA ČR GBP505/12/G112 Institutional support: RVO:68081766 Keywords : behavioural laterality * experience * Poecilia wingei * sidedness * sigmoid display * social environment Subject RIV: EG - Zoology Impact factor: 2.747, year: 2015

Male courtship behavior in Ceratitis Capitata (Diptera: Tephritidae) that have received Aromatherapy with ginger root oil

International Nuclear Information System (INIS)

Briceno, D.; Eberhard, W.; Shelly, T.

2007-01-01

The results of previous studies that showed that exposing mass-reared male Mediterranean fruit flies Ceratitis capitata (Wiedemann) to ginger root oil ('aromatherapy') increases the likelihood of mating with wild females were confirmed. The increased male success could be due to female responses to changes in male behavior or male pheromones. There were no significant differences in the types of courtship movements executed by males with and without aromatherapy. The durations of movements also did not differ when mass-reared males were paired with mass-reared females; however, when they were paired with wild females, there were a few, small differences. Previous studies indicated that the effectiveness of the male long-distance attractant pheromone is not affected by aromatherapy, but these studies did not consider pheromones released at close range during courtship, which behavioral analyses suggest may be different. We propose the following possible explanation for the different effects of aromatherapy with different females. Selection on males under mass rearing may have altered their close-range pheromones in ways that can be remedied by aromatherapy; and only wild females respond because the pheromonal responsiveness of mass-reared females has also changed. We propose observations that could test these ideas. (author) [es

Improving treatment planning accuracy through multimodality imaging

International Nuclear Information System (INIS)

Sailer, Scott L.; Rosenman, Julian G.; Soltys, Mitchel; Cullip, Tim J.; Chen, Jun

1996-01-01

Purpose: In clinical practice, physicians are constantly comparing multiple images taken at various times during the patient's treatment course. One goal of such a comparison is to accurately define the gross tumor volume (GTV). The introduction of three-dimensional treatment planning has greatly enhanced the ability to define the GTV, but there are times when the GTV is not visible on the treatment-planning computed tomography (CT) scan. We have modified our treatment-planning software to allow for interactive display of multiple, registered images that enhance the physician's ability to accurately determine the GTV. Methods and Materials: Images are registered using interactive tools developed at the University of North Carolina at Chapel Hill (UNC). Automated methods are also available. Images registered with the treatment-planning CT scan are digitized from film. After a physician has approved the registration, the registered images are made available to the treatment-planning software. Structures and volumes of interest are contoured on all images. In the beam's eye view, wire loop representations of these structures can be visualized from all image types simultaneously. Each registered image can be seamlessly viewed during the treatment-planning process, and all contours from all image types can be seen on any registered image. A beam may, therefore, be designed based on any contour. Results: Nineteen patients have been planned and treated using multimodality imaging from November 1993 through August 1994. All registered images were digitized from film, and many were from outside institutions. Brain has been the most common site (12), but the techniques of registration and image display have also been used for the thorax (4), abdomen (2), and extremity (1). The registered image has been an magnetic resonance (MR) scan in 15 cases and a diagnostic CT scan in 5 cases. In one case, sequential MRs, one before treatment and another after 30 Gy, were used to plan

Learning multimodal dictionaries.

Science.gov (United States)

Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

2007-09-01

Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

Stereotypic and complex phrase types provide structural evidence for a multi-message display in humpback whales (Megaptera novaeangliae).

Science.gov (United States)

Murray, Anita; Dunlop, Rebecca A; Noad, Michael J; Goldizen, Anne W

2018-02-01

Male humpback whales produce a mating display called "song." Behavioral studies indicate song has inter- and/or intra-sexual functionality, suggesting song may be a multi-message display. Multi-message displays often include stereotypic components that convey group membership for mate attraction and/or male-male interactions, and complex components that convey individual quality for courtship. Humpback whale song contains sounds ("units") arranged into sequences ("phrases"). Repetitions of a specific phrase create a "theme." Within a theme, imperfect phrase repetitions ("phrase variants") create variability among phrases of the same type ("phrase type"). The hypothesis that song contains stereotypic and complex phrase types, structural characteristics consistent with a multi-message display, is investigated using recordings of 17 east Australian males (8:2004, 9:2011). Phrase types are categorized as stereotypic or complex using number of unit types, number of phrase variants, and the proportion of phrases that is unique to an individual versus shared amongst males. Unit types are determined using self-organizing maps. Phrase variants are determined by Levenshtein distances between phrases. Stereotypic phrase types have smaller numbers of unit types and shared phrase variants. Complex phrase types have larger numbers of unit types and unique phrase variants. This study supports the hypothesis that song could be a multi-message display.

The songbird as a percussionist: syntactic rules for non-vocal sound and song production in Java sparrows.

Directory of Open Access Journals (Sweden)

Masayo Soma

Full Text Available Music and dance are two remarkable human characteristics that are closely related. Communication through integrated vocal and motional signals is also common in the courtship displays of birds. The contribution of songbird studies to our understanding of vocal learning has already shed some light on the cognitive underpinnings of musical ability. Moreover, recent pioneering research has begun to show how animals can synchronize their behaviors with external stimuli, like metronome beats. However, few studies have applied such perspectives to unraveling how animals can integrate multimodal communicative signals that have natural functions. Additionally, studies have rarely asked how well these behaviors are learned. With this in mind, here we cast a spotlight on an unusual animal behavior: non-vocal sound production associated with singing in the Java sparrow (Lonchura oryzivora, a songbird. We show that male Java sparrows coordinate their bill-click sounds with the syntax of their song-note sequences, similar to percussionists. Analysis showed that they produced clicks frequently toward the beginning of songs and before/after specific song notes. We also show that bill-clicking patterns are similar between social fathers and their sons, suggesting that these behaviors might be learned from models or linked to learning-based vocalizations. Individuals untutored by conspecifics also exhibited stereotypical bill-clicking patterns in relation to song-note sequence, indicating that while the production of bill clicking itself is intrinsic, its syncopation appears to develop with songs. This paints an intriguing picture in which non-vocal sounds are integrated with vocal courtship signals in a songbird, a model that we expect will contribute to the further understanding of multimodal communication.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

2010-01-01

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal' communication, which should not be confused with the term ‘multimedia'. While multimedia...... on their teaching and learning situations. The choices they make involve e-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very...

Reading Multimodal Texts for Learning – a Model for Cultivating Multimodal Literacy

Directory of Open Access Journals (Sweden)

Kristina Danielsson

2016-08-01

Full Text Available The re-conceptualisation of texts over the last 20 years, as well as the development of a multimodal understanding of communication and representation of knowledge, has profound consequences for the reading and understanding of multimodal texts, not least in educational contexts. However, if teachers and students are given tools to “unwrap” multimodal texts, they can develop a deeper understanding of texts, information structures, and the textual organisation of knowledge. This article presents a model for working with multimodal texts in education with the intention to highlight mutual multimodal text analysis in relation to the subject content. Examples are taken from a Singaporean science textbook as well as a Chilean science textbook, in order to demonstrate that the framework is versatile and applicable across different cultural contexts. The model takes into account the following aspects of texts: the general structure, how different semiotic resources operate, the ways in which different resources are combined (including coherence, the use of figurative language, and explicit/implicit values. Since learning operates on different dimensions – such as social and affective dimensions besides the cognitive ones – our inclusion of figurative language and values as components for textual analysis is a contribution to multimodal text analysis for learning.

The evolution of an academic-community partnership in the design, implementation, and evaluation of experience corps® Baltimore city: a courtship model.

Science.gov (United States)

Tan, Erwin J; McGill, Sylvia; Tanner, Elizabeth K; Carlson, Michelle C; Rebok, George W; Seeman, Teresa E; Fried, Linda P

2014-04-01

Experience Corps Baltimore City (EC) is a product of a partnership between the Greater Homewood Community Corporation (GHCC) and the Johns Hopkins Center on Aging and Health (COAH) that began in 1998. EC recruits volunteers aged 55 and older into high-impact mentoring and tutoring roles in public elementary schools that are designed to also benefit the volunteers. We describe the evolution of the GHCC-COAH partnership through the "Courtship Model." We describe how community-based participatory research principals, such as shared governance, were applied at the following stages: (1) partner selection, (2) getting serious, (3) commitment, and (4) leaving a legacy. EC could not have achieved its current level of success without academic-community partnership. In early stages of the "Courtship Model," GHCC and COAH were able to rely on the trust developed between the leadership of the partner organizations. Competing missions from different community and academic funders led to tension in later stages of the "Courtship Model" and necessitated a formal Memorandum of Understanding between the partners as they embarked on a randomized controlled trial. The GHCC-COAH partnership demonstrates how academic-community partnerships can serve as an engine for social innovation. The partnership could serve as a model for other communities seeking multiple funding sources to implement similar public health interventions that are based on national service models. Unified funding mechanisms would assist the formation of academic-community partnerships that could support the design, implementation, and the evaluation of community-based public health interventions.

Elaborate Mimetic Vocal Displays by Female Superb Lyrebirds

Directory of Open Access Journals (Sweden)

Anastasia H Dalziell

2016-04-01

Full Text Available Some of the most striking vocalizations in birds are made by males that incorporate vocal mimicry in their sexual displays. Mimetic vocalization in females is largely undescribed, but it is unclear whether this is because of a lack of selection for vocal mimicry in females, or whether the phenomenon has simply been overlooked. These issues are thrown into sharp relief in the superb lyrebird, Menura novaehollandiae, a basal oscine passerine with a lek-like mating system and female uniparental care. The spectacular mimetic song display produced by courting male lyrebirds is a textbook example of a sexually selected trait, but the vocalizations of female lyrebirds are largely unknown. Here, we provide the first analysis of the structure and context of the vocalizations of female lyrebirds. Female lyrebirds were completely silent during courtship; however, females regularly produced sophisticated vocal displays incorporating both lyrebird-specific vocalizations and imitations of sounds within their environment. The structure of female vocalizations varied significantly with context. While foraging, females mostly produced a complex lyrebird-specific song, whereas they gave lyrebird-specific alarm calls most often during nest defense. Within their vocal displays females also included a variety of mimetic vocalizations, including imitations of the calls of dangerous predators, and of alarm calls and song of harmless heterospecifics. Females gave more mimetic vocalizations during nest defense than while foraging, and the types of sounds they imitated varied between these contexts, suggesting that mimetic vocalizations have more than one function. These results are inconsistent with previous portrayals of vocalizations by female lyrebirds as rare, functionless by-products of sexual selection on males. Instead, our results support the hypotheses that complex female vocalizations play a role in nest defense and mediate female-female competition for

AMIDE: A Free Software Tool for Multimodality Medical Image Analysis

Directory of Open Access Journals (Sweden)

Andreas Markus Loening

2003-07-01

Full Text Available Amide's a Medical Image Data Examiner (AMIDE has been developed as a user-friendly, open-source software tool for displaying and analyzing multimodality volumetric medical images. Central to the package's abilities to simultaneously display multiple data sets (e.g., PET, CT, MRI and regions of interest is the on-demand data reslicing implemented within the program. Data sets can be freely shifted, rotated, viewed, and analyzed with the program automatically handling interpolation as needed from the original data. Validation has been performed by comparing the output of AMIDE with that of several existing software packages. AMIDE runs on UNIX, Macintosh OS X, and Microsoft Windows platforms, and it is freely available with source code under the terms of the GNU General Public License.

Critical Analysis of Multimodal Discourse

DEFF Research Database (Denmark)

van Leeuwen, Theo

2013-01-01

This is an encyclopaedia article which defines the fields of critical discourse analysis and multimodality studies, argues that within critical discourse analysis more attention should be paid to multimodality, and within multimodality to critical analysis, and ends reviewing a few examples of re...

Persistent activity in a recurrent circuit underlies courtship memory in Drosophila

Science.gov (United States)

Zhao, Xiaoliang; Lenek, Daniela; Dag, Ugur; Dickson, Barry J

2018-01-01

Recurrent connections are thought to be a common feature of the neural circuits that encode memories, but how memories are laid down in such circuits is not fully understood. Here we present evidence that courtship memory in Drosophila relies on the recurrent circuit between mushroom body gamma (MBγ), M6 output, and aSP13 dopaminergic neurons. We demonstrate persistent neuronal activity of aSP13 neurons and show that it transiently potentiates synaptic transmission from MBγ>M6 neurons. M6 neurons in turn provide input to aSP13 neurons, prolonging potentiation of MBγ>M6 synapses over time periods that match short-term memory. These data support a model in which persistent aSP13 activity within a recurrent circuit lays the foundation for a short-term memory. PMID:29322941

Multimodal label-free microscopy

Directory of Open Access Journals (Sweden)

Nicolas Pavillon

2014-09-01

Full Text Available This paper reviews the different multimodal applications based on a large extent of label-free imaging modalities, ranging from linear to nonlinear optics, while also including spectroscopic measurements. We put specific emphasis on multimodal measurements going across the usual boundaries between imaging modalities, whereas most multimodal platforms combine techniques based on similar light interactions or similar hardware implementations. In this review, we limit the scope to focus on applications for biology such as live cells or tissues, since by their nature of being alive or fragile, we are often not free to take liberties with the image acquisition times and are forced to gather the maximum amount of information possible at one time. For such samples, imaging by a given label-free method usually presents a challenge in obtaining sufficient optical signal or is limited in terms of the types of observable targets. Multimodal imaging is then particularly attractive for these samples in order to maximize the amount of measured information. While multimodal imaging is always useful in the sense of acquiring additional information from additional modes, at times it is possible to attain information that could not be discovered using any single mode alone, which is the essence of the progress that is possible using a multimodal approach.

A multimodal spectral approach to characterize rhythm in natural speech.

Science.gov (United States)

Alexandrou, Anna Maria; Saarinen, Timo; Kujala, Jan; Salmelin, Riitta

2016-01-01

Human utterances demonstrate temporal patterning, also referred to as rhythm. While simple oromotor behaviors (e.g., chewing) feature a salient periodical structure, conversational speech displays a time-varying quasi-rhythmic pattern. Quantification of periodicity in speech is challenging. Unimodal spectral approaches have highlighted rhythmic aspects of speech. However, speech is a complex multimodal phenomenon that arises from the interplay of articulatory, respiratory, and vocal systems. The present study addressed the question of whether a multimodal spectral approach, in the form of coherence analysis between electromyographic (EMG) and acoustic signals, would allow one to characterize rhythm in natural speech more efficiently than a unimodal analysis. The main experimental task consisted of speech production at three speaking rates; a simple oromotor task served as control. The EMG-acoustic coherence emerged as a sensitive means of tracking speech rhythm, whereas spectral analysis of either EMG or acoustic amplitude envelope alone was less informative. Coherence metrics seem to distinguish and highlight rhythmic structure in natural speech.

Two distinct genomic regions, harbouring the period and fruitless genes, affect male courtship song in Drosophila montana.

Science.gov (United States)

Lagisz, M; Wen, S-Y; Routtu, J; Klappert, K; Mazzi, D; Morales-Hojas, R; Schäfer, M A; Vieira, J; Hoikkala, A; Ritchie, M G; Butlin, R K

2012-06-01

Acoustic signals often have a significant role in pair formation and in species recognition. Determining the genetic basis of signal divergence will help to understand signal evolution by sexual selection and its role in the speciation process. An earlier study investigated quantitative trait locus for male courtship song carrier frequency (FRE) in Drosophila montana using microsatellite markers. We refined this study by adding to the linkage map markers for 10 candidate genes known to affect song production in Drosophila melanogaster. We also extended the analyses to additional song characters (pulse train length (PTL), pulse number (PN), interpulse interval, pulse length (PL) and cycle number (CN)). Our results indicate that loci in two different regions of the genome control distinct features of the courtship song. Pulse train traits (PTL and PN) mapped to the X chromosome, showing significant linkage with the period gene. In contrast, characters related to song pulse properties (PL, CN and carrier FRE) mapped to the region of chromosome 2 near the candidate gene fruitless, identifying these genes as suitable loci for further investigations. In previous studies, the pulse train traits have been found to vary substantially between Drosophila species, and so are potential species recognition signals, while the pulse traits may be more important in intra-specific mate choice.

The Multimodal Possibilities of Online Instructions

DEFF Research Database (Denmark)

Kampf, Constance

2006-01-01

The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi-modal analy......The WWW simplifies the process of delivering online instructions through multimodal channels because of the ease of use for voice, video, pictures, and text modes of communication built into it.  Given that instructions are being produced in multimodal format for the WWW, how do multi...

The Development of Infant Discrimination of Affect in Multimodal and Unimodal Stimulation: The Role of Intersensory Redundancy

Science.gov (United States)

Flom, Ross; Bahrick, Lorraine E.

2007-01-01

This research examined the developmental course of infants' ability to perceive affect in bimodal (audiovisual) and unimodal (auditory and visual) displays of a woman speaking. According to the intersensory redundancy hypothesis (L. E. Bahrick, R. Lickliter, & R. Flom, 2004), detection of amodal properties is facilitated in multimodal stimulation…

Fixed differences in the paralytic gene define two lineages within the Lutzomyia longipalpis complex producing different types of courtship songs.

Directory of Open Access Journals (Sweden)

Rachel M M A Lins

Full Text Available The sand fly Lutzomyia longipalpis (Diptera: Psychodidae: Phlebotominae, the most important vector of American visceral leishmaniasis, is widely distributed in Latin America. There is currently a consensus that it represents a species complex, however, the number and distribution of the different siblings is still uncertain. Previous analyses have indicated that Brazilian populations of this vector can be divided into two main groups according to the type of courtship song (Burst vs. Pulse males produce during copulation. Nevertheless, no diagnostic differences have been observed between these two groups with most molecular markers used to date. We analyzed the molecular divergence in a fragment of the paralytic (para gene, a locus involved in the control of courtship songs in Drosophila, among a number of Lu. longipalpis populations from Brazil producing Burst and Pulse-type songs. Our results revealed a very high level of divergence and fixed differences between populations producing the two types of songs. We also compared Lu. longipalpis with a very closely related species, Lutzomyia cruzi, which produces Burst-type songs. The results indicated a higher number of fixed differences between Lu. cruzi and the Pulse-type populations of Lu. longipalpis than with those producing Burst-type songs. The data confirmed our previous assumptions that the presence of different sibling species of the Lu. longipalpis complex in Brazil can be divided into two main groups, one representing a single species and a second more heterogeneous group that probably represents a number of incipient species. We hypothesize that para might be one of the genes directly involved in the control of the courtship song differences between these two groups or that it is linked to other loci associated with reproductive isolation of the Brazilian species.

Fixed Differences in the paralytic Gene Define Two Lineages within the Lutzomyia longipalpis Complex Producing Different Types of Courtship Songs

Science.gov (United States)

Lins, Rachel M. M. A.; Souza, Nataly A.; Brazil, Reginaldo P.; Maingon, Rhayza D. C.; Peixoto, Alexandre A.

2012-01-01

The sand fly Lutzomyia longipalpis (Diptera: Psychodidae: Phlebotominae), the most important vector of American visceral leishmaniasis, is widely distributed in Latin America. There is currently a consensus that it represents a species complex, however, the number and distribution of the different siblings is still uncertain. Previous analyses have indicated that Brazilian populations of this vector can be divided into two main groups according to the type of courtship song (Burst vs. Pulse) males produce during copulation. Nevertheless, no diagnostic differences have been observed between these two groups with most molecular markers used to date. We analyzed the molecular divergence in a fragment of the paralytic (para) gene, a locus involved in the control of courtship songs in Drosophila, among a number of Lu. longipalpis populations from Brazil producing Burst and Pulse-type songs. Our results revealed a very high level of divergence and fixed differences between populations producing the two types of songs. We also compared Lu. longipalpis with a very closely related species, Lutzomyia cruzi, which produces Burst-type songs. The results indicated a higher number of fixed differences between Lu. cruzi and the Pulse-type populations of Lu. longipalpis than with those producing Burst-type songs. The data confirmed our previous assumptions that the presence of different sibling species of the Lu. longipalpis complex in Brazil can be divided into two main groups, one representing a single species and a second more heterogeneous group that probably represents a number of incipient species. We hypothesize that para might be one of the genes directly involved in the control of the courtship song differences between these two groups or that it is linked to other loci associated with reproductive isolation of the Brazilian species. PMID:22970200

An Experimental Investigation of Improving Human Problem-Solving Performance by Guiding Attention and Adaptively Proving Details on Information Displays

National Research Council Canada - National Science Library

Narayanan, N. H

2007-01-01

... in real-time in response to the viewer's gaze patterns. Designs of these displays were based on a cognitive model of multimodal information comprehension developed in a previous ONR project (N0001496l1187...

Heart rate patterns during courtship and mating in rams and in estrous and nonestrous ewes ().

Science.gov (United States)

Orihuela, A; Omaña, J C; Ungerfeld, R

2016-02-01

The aim of this study was to compare the heart rate (HR) patterns in rams mated with estrous or nonestrous ewes and in mated estrous and nonestrous ewes () during courtship and mating. For this purpose, HR and behavior were recorded using a radio telemetry recording system and a closed-circuit television system with video recording, respectively. Rams were joined with either an estrous ( = 10) or a nonestrous ( = 10) ewe that was restrained in a stanchion by the neck. Data were continuously recorded until each ram performed 3 ejaculations. Eight days later, the HR of the 10 estrous and 10 nonestrous ewes was recorded during mating. Although the time between entrance into the yard and the first ejaculation was similar across rams, rams that mounted estrous ewes were faster at attaining their second (3min5s ± 17 s vs. 5min28s ± 18 s) and third (7min58s ± 45 s vs. 12 min ± 1min14s) ejaculations (all ewes. In all cases, HR reached maximum values immediately after each ejaculation and the HR pattern was similar across ejaculations (first, second, and third). Although HR was similar between estrous and nonestrous ewes before mating, nonestrous ewes had higher HR ( ewes displayed shorter interejaculation periods but HR did not differ between groups of rams during any ejaculation (first, second, or third), 2) HR for both groups of rams peaked shortly after each ejaculation, and 3) HR increased more in nonestrous than in estrous ewes while mating.

Individual consistency in exploratory behaviour and mating tactics in male guppies

Science.gov (United States)

Kelley, Jennifer L.; Phillips, Samuel C.; Evans, Jonathan P.

2013-10-01

While behavioural plasticity is considered an adaptation to fluctuating social and environmental conditions, many animals also display a high level of individual consistency in their behaviour over time or across contexts (generally termed ‘personality’). However, studies of animal personalities that include sexual behaviour, or functionally distinct but correlated traits, are relatively scarce. In this study, we tested for individual behavioural consistency in courtship and exploratory behaviour in male guppies ( Poecilia reticulata) in two light environments (high vs. low light intensity). Based on previous work on guppies, we predicted that males would modify their behaviour from sneak mating tactics to courtship displays under low light conditions, but also that the rank orders of courtship effort would remain unchanged (i.e. highly sexually active individuals would display relatively high levels of courtship under both light regimes). We also tested for correlations between courtship and exploratory behaviour, predicting that males that had high display rates would also be more likely to approach a novel object. Although males showed significant consistency in their exploratory and mating behaviour over time (1 week), we found no evidence that these traits constituted a behavioural syndrome. Furthermore, in contrast to previous work, we found no overall effect of the light environment on any of the behaviours measured, although males responded to the treatment on an individual-level basis, as reflected by a significant individual-by-environment interaction. The future challenge is to investigate how individual consistency across different environmental contexts relates to male reproductive success.

Multimodality imaging techniques.

Science.gov (United States)

Martí-Bonmatí, Luis; Sopena, Ramón; Bartumeus, Paula; Sopena, Pablo

2010-01-01

In multimodality imaging, the need to combine morphofunctional information can be approached by either acquiring images at different times (asynchronous), and fused them through digital image manipulation techniques or simultaneously acquiring images (synchronous) and merging them automatically. The asynchronous post-processing solution presents various constraints, mainly conditioned by the different positioning of the patient in the two scans acquired at different times in separated machines. The best solution to achieve consistency in time and space is obtained by the synchronous image acquisition. There are many multimodal technologies in molecular imaging. In this review we will focus on those multimodality image techniques more commonly used in the field of diagnostic imaging (SPECT-CT, PET-CT) and new developments (as PET-MR). The technological innovations and development of new tracers and smart probes are the main key points that will condition multimodality image and diagnostic imaging professionals' future. Although SPECT-CT and PET-CT are standard in most clinical scenarios, MR imaging has some advantages, providing excellent soft-tissue contrast and multidimensional functional, structural and morphological information. The next frontier is to develop efficient detectors and electronics systems capable of detecting two modality signals at the same time. Not only PET-MR but also MR-US or optic-PET will be introduced in clinical scenarios. Even more, MR diffusion-weighted, pharmacokinetic imaging, spectroscopy or functional BOLD imaging will merge with PET tracers to further increase molecular imaging as a relevant medical discipline. Multimodality imaging techniques will play a leading role in relevant clinical applications. The development of new diagnostic imaging research areas, mainly in the field of oncology, cardiology and neuropsychiatry, will impact the way medicine is performed today. Both clinical and experimental multimodality studies, in

Multimodality Registration without a Dedicated Multimodality Scanner

Directory of Open Access Journals (Sweden)

Bradley J. Beattie

2007-03-01

Full Text Available Multimodality scanners that allow the acquisition of both functional and structural image sets on a single system have recently become available for animal research use. Although the resultant registered functional/structural image sets can greatly enhance the interpretability of the functional data, the cost of multimodality systems can be prohibitive, and they are often limited to two modalities, which generally do not include magnetic resonance imaging. Using a thin plastic wrap to immobilize and fix a mouse or other small animal atop a removable bed, we are able to calculate registrations between all combinations of four different small animal imaging scanners (positron emission tomography, single-photon emission computed tomography, magnetic resonance, and computed tomography [CT] at our disposal, effectively equivalent to a quadruple-modality scanner. A comparison of serially acquired CT images, with intervening acquisitions on other scanners, demonstrates the ability of the proposed procedures to maintain the rigidity of an anesthetized mouse during transport between scanners. Movement of the bony structures of the mouse was estimated to be 0.62 mm. Soft tissue movement was predominantly the result of the filling (or emptying of the urinary bladder and thus largely constrained to this region. Phantom studies estimate the registration errors for all registration types to be less than 0.5 mm. Functional images using tracers targeted to known structures verify the accuracy of the functional to structural registrations. The procedures are easy to perform and produce robust and accurate results that rival those of dedicated multimodality scanners, but with more flexible registration combinations and while avoiding the expense and redundancy of multimodality systems.

Multimodal human communication--targeting facial expressions, speech content and prosody.

Science.gov (United States)

Regenbogen, Christina; Schneider, Daniel A; Gur, Raquel E; Schneider, Frank; Habel, Ute; Kellermann, Thilo

2012-05-01

Human communication is based on a dynamic information exchange of the communication channels facial expressions, prosody, and speech content. This fMRI study elucidated the impact of multimodal emotion processing and the specific contribution of each channel on behavioral empathy and its prerequisites. Ninety-six video clips displaying actors who told self-related stories were presented to 27 healthy participants. In two conditions, all channels uniformly transported only emotional or neutral information. Three conditions selectively presented two emotional channels and one neutral channel. Subjects indicated the actors' emotional valence and their own while fMRI was recorded. Activation patterns of tri-channel emotional communication reflected multimodal processing and facilitative effects for empathy. Accordingly, subjects' behavioral empathy rates significantly deteriorated once one source was neutral. However, emotionality expressed via two of three channels yielded activation in a network associated with theory-of-mind-processes. This suggested participants' effort to infer mental states of their counterparts and was accompanied by a decline of behavioral empathy, driven by the participants' emotional responses. Channel-specific emotional contributions were present in modality-specific areas. The identification of different network-nodes associated with human interactions constitutes a prerequisite for understanding dynamics that underlie multimodal integration and explain the observed decline in empathy rates. This task might also shed light on behavioral deficits and neural changes that accompany psychiatric diseases. Copyright © 2012 Elsevier Inc. All rights reserved.

Persistent activity in a recurrent circuit underlies courtship memory in Drosophila.

Science.gov (United States)

Zhao, Xiaoliang; Lenek, Daniela; Dag, Ugur; Dickson, Barry J; Keleman, Krystyna

2018-01-11

Recurrent connections are thought to be a common feature of the neural circuits that encode memories, but how memories are laid down in such circuits is not fully understood. Here we present evidence that courtship memory in Drosophila relies on the recurrent circuit between mushroom body gamma (MBγ), M6 output, and aSP13 dopaminergic neurons. We demonstrate persistent neuronal activity of aSP13 neurons and show that it transiently potentiates synaptic transmission from MBγ>M6 neurons. M6 neurons in turn provide input to aSP13 neurons, prolonging potentiation of MB γ >M6 synapses over time periods that match short-term memory. These data support a model in which persistent aSP13 activity within a recurrent circuit lays the foundation for a short-term memory. © 2018, Zhao et al.

A multimodal interface for real-time soldier-robot teaming

Science.gov (United States)

Barber, Daniel J.; Howard, Thomas M.; Walter, Matthew R.

2016-05-01

Recent research and advances in robotics have led to the development of novel platforms leveraging new sensing capabilities for semantic navigation. As these systems becoming increasingly more robust, they support highly complex commands beyond direct teleoperation and waypoint finding facilitating a transition away from robots as tools to robots as teammates. Supporting future Soldier-Robot teaming requires communication capabilities on par with human-human teams for successful integration of robots. Therefore, as robots increase in functionality, it is equally important that the interface between the Soldier and robot advances as well. Multimodal communication (MMC) enables human-robot teaming through redundancy and levels of communications more robust than single mode interaction. Commercial-off-the-shelf (COTS) technologies released in recent years for smart-phones and gaming provide tools for the creation of portable interfaces incorporating MMC through the use of speech, gestures, and visual displays. However, for multimodal interfaces to be successfully used in the military domain, they must be able to classify speech, gestures, and process natural language in real-time with high accuracy. For the present study, a prototype multimodal interface supporting real-time interactions with an autonomous robot was developed. This device integrated COTS Automated Speech Recognition (ASR), a custom gesture recognition glove, and natural language understanding on a tablet. This paper presents performance results (e.g. response times, accuracy) of the integrated device when commanding an autonomous robot to perform reconnaissance and surveillance activities in an unknown outdoor environment.

An Experimental Investigation of Improving Human Problem-Solving Performance by Guiding Attention and Adaptively Providing Details on Information Displays

National Research Council Canada - National Science Library

Narayanan, N. H

2007-01-01

... in real-time in response to the viewer's gaze patterns. Designs of these displays were based on a cognitive model of multimodal information comprehension developed in a previous ONR project (N00014-96-1-1187...

A data fusion environment for multimodal and multi-informational neuronavigation.

Science.gov (United States)

Jannin, P; Fleig, O J; Seigneuret, E; Grova, C; Morandi, X; Scarabin, J M

2000-01-01

Part of the planning and performance of neurosurgery consists of determining target areas, areas to be avoided, landmark areas, and trajectories, all of which are components of the surgical script. Nowadays, neurosurgeons have access to multimodal medical imaging to support the definition of the surgical script. The purpose of this paper is to present a software environment developed by the authors that allows full multimodal and multi-informational planning as well as neuronavigation for epilepsy and tumor surgery. We have developed a data fusion environment dedicated to neuronavigation around the Surgical Microscope Neuronavigator system (Carl Zeiss, Oberkochen, Germany). This environment includes registration, segmentation, 3D visualization, and interaction-applied tools. It provides the neuronavigation system with the multimodal information involved in the definition of the surgical script: lesional areas, sulci, ventricles segmented from magnetic resonance imaging (MRI), vessels segmented from magnetic resonance angiography (MRA), functional areas from magneto-encephalography (MEG), and functional magnetic resonance imaging (fMRI) for somatosensory, motor, or language activation. These data are considered to be relevant for the performance of the surgical procedure. The definition of each entity results from the same procedure: registration to the anatomical MRI data set (defined as the reference data set), segmentation, fused 3D display, selection of the relevant entities for the surgical step, encoding in 3D surface-based representation, and storage of the 3D surfaces in a file recognized by the neuronavigation software (STP 3.4, Leibinger; Freiburg, Germany). Multimodal neuronavigation is illustrated with two clinical cases for which multimodal information was introduced into the neuronavigation system. Lesional areas were used to define and follow the surgical path, sulci and vessels helped identify the anatomical environment of the surgical field, and

Sexual Dimorphisms of Appendicular Musculoskeletal Morphology Related to Social Display in Cuban Anolis Lizards.

Science.gov (United States)

Anzai, Wataru; Cádiz, Antonio; Endo, Hideki

2015-10-01

In Anolis lizards, sexual dimorphism has been reported in morphological and ecological traits. Males show larger body size and longer limbs related to territorial combat and courtship display with the dewlap. Although functional-anatomical traits are closely related to locomotor behaviors, differences between sexes in musculoskeletal traits on limbs remain unclear. We explored the relationships among sexual dimorphisms in musculoskeletal morphology, habitat, and locomotor traits in Anolis lizards. Specifically, we examined appendicular musculoskeletal morphology in three species of Cuban Anolis by measuring muscle mass and lengths of moment arms. Through comparisons of crossing locomotion, we found that the runner species possessed larger extensors in hindlimbs, which are advantageous for running, whereas the masses of the humeral and femoral retractors were larger in climber species, allowing these lizards to hold up their bodies and occupy tree substrates. Comparisons between the sexes showed different trends among the three species. Males of A. porcatus, which inhabit narrow branches or leaves, had stronger elbow extensors that maintain the display posture. In contrast, males of A. sagrei, which occupy broad surfaces, did not show sexual differences that affected social display. Moreover, A. bartschi indicated sexual differences despite the absence of dewlapping behavior. Our findings suggest that both sexes show fundamentally similar relationships between muscular morphology and locomotor habits to adapt arboreal or terrestrial substrates, and yet sexual dimorphism in forelimb muscles may additionally affected by male specific display with the dewlap.

Experimental observation of chaotic phase synchronization of a periodically pump-modulated multimode microchip Nd:YVO{sub 4} laser

Energy Technology Data Exchange (ETDEWEB)

Lin, Chien-Hui; Kuo, Chie-Tong [Department of Physics, National Sun Yat-Sen University, Kaohsiung 804, Taiwan, ROC (China); Hsu, Tzu-Fang, E-mail: tfhsu@mail.npue.edu.tw [Department of Applied Physics, National Pingtung University of Education, Pingtung 900, Taiwan, ROC (China); Jan, Hengtai; Han, Shiang-Yi [Department of Physics, National Kaohsiung Normal University, No. 62, Shenjhong Rd., Yanchao District, Kaohsiung City 824, Taiwan, ROC (China); Ho, Ming-Chung, E-mail: t1603@nknucc.nknu.edu.tw [Department of Physics, National Kaohsiung Normal University, No. 62, Shenjhong Rd., Yanchao District, Kaohsiung City 824, Taiwan, ROC (China); Jiang, I-Min [Department of Physics, National Sun Yat-Sen University, Kaohsiung 804, Taiwan, ROC (China)

2012-03-12

In this Letter we demonstrate the experimental observation of chaotic phase synchronization (CPS) in a periodically pump-modulated multimode microchip Nd:YVO{sub 4} laser. PS transition is displayed via the stroboscopic technique. We apply the recurrence probability and correlation probability of recurrence to estimate the degree of PS. The degree of PS is studied taking into account the modulation amplitude and modulation frequency. We also propose an experimental compatible numerical simulation to reflect the fact that the Arnold tongues are experimentally and numerically exhibited in the periodically pump-modulated multimode microchip Nd:YVO{sub 4} laser. -- Highlights: ► We show chaotic phase synchronization in a pump-modulated microchip Nd:YVO{sub 4} laser. ► Phase synchronization (PS) transition is displayed via the stroboscopic technique. ► The degree of PS is studied taking into account the modulation parameters. ► The Arnold tongues are experimentally and numerically exhibited in the laser.

Multimodal fluorescence imaging spectroscopy

NARCIS (Netherlands)

Stopel, Martijn H W; Blum, Christian; Subramaniam, Vinod; Engelborghs, Yves; Visser, Anthonie J.W.G.

2014-01-01

Multimodal fluorescence imaging is a versatile method that has a wide application range from biological studies to materials science. Typical observables in multimodal fluorescence imaging are intensity, lifetime, excitation, and emission spectra which are recorded at chosen locations at the sample.

Evaluation of the courtship and of the hybrid male sterility among Drosophila buzzatii cluster species (Diptera, Drosophilidae

Directory of Open Access Journals (Sweden)

MACHADO L. P. de B.

2002-01-01

Full Text Available In the Drosophila repleta group the establishment of subgroups and complexes made on the basis of morphological and cytological evidences is supported by tests of reproductive isolation. Among species in the repleta group, the buzzatii cluster, due to its polymorphism and polytipism, is an excellent material for ecological and speciation studies. Some interspecific crosses involving Drosophila seriema, Drosophila sp. B, D. koepferae and D. buzzatii strains were completely sterile while others involving strains from these species produced F1 hybrids that did not yield F2. In the present work, data on courtship duration and copula occurrence obtained in the analysis of flies from parental sterile crosses and on spermatozoon mobility observed in F1 hybrids that did not yield F2 are presented. Copula did not occur during one hour of observation and the spermatozoon also did not show mobility at any of the analyzed stages (3, 7, 9 and 10 days old. There was a high variation in courtship average duration and in the percentage of males that courted the females. The reproductive isolation mechanisms indicated by these observations were pre and post-zygotic, as supported by the absence of copula and male sterility. Data obtained also showed the occurrence of different degrees of reproductive compatibility among the strains classified as the same species but from distinct geographic localities.

Evaluation of the courtship and of the hybrid male sterility among Drosophila buzzatii cluster species (Diptera, Drosophilidae).

Science.gov (United States)

Machado, L P; Castro, J P; Madi-Ravazzi, L

2002-11-01

In the Drosophila repleta group the establishment of subgroups and complexes made on the basis of morphological and cytological evidences is supported by tests of reproductive isolation. Among species in the repleta group, the buzzatii cluster, due to its polymorphism and polytipism, is an excellent material for ecological and speciation studies. Some interspecific crosses involving Drosophila seriema, Drosophila sp. B, D. koepferae and D. buzzatii strains were completely sterile while others involving strains from these species produced F1 hybrids that did not yield F2. In the present work, data on courtship duration and copula occurrence obtained in the analysis of flies from parental sterile crosses and on spermatozoon mobility observed in F1 hybrids that did not yield F2 are presented. Copula did not occur during one hour of observation and the spermatozoon also did not show mobility at any of the analyzed stages (3, 7, 9 and 10 days old). There was a high variation in courtship average duration and in the percentage of males that courted the females. The reproductive isolation mechanisms indicated by these observations were pre and post-zygotic, as supported by the absence of copula and male sterility. Data obtained also showed the occurrence of different degrees of reproductive compatibility among the strains classified as the same species but from distinct geographic localities.

The dating mind: evolutionary psychology and the emerging science of human courtship.

Science.gov (United States)

Oesch, Nathan; Miklousic, Igor

2012-12-20

In the New York Times bestselling book The Game: Penetrating the Secret Society of Pickup Artists (2006), the world was granted its first exclusive introduction to the steadily growing dating coach and pick-up artist community. Many of its most prominent authorities claim to use insights and information gleaned both through first-hand experience as well as empirical research in evolutionary psychology. One of the industry's most well-respected authorities, the illusionist Erik von Markovik, promotes a three-phase model of human courtship: Attraction, building mutual Comfort and Trust, and Seduction. The following review argues that many of these claims are in fact grounded in solid empirical findings from social, physiological and evolutionary psychology. Two texts which represent much of this literature are critiqued and their implications discussed.

Variation in courtship ultrasounds of three Ostrinia moths with different sex pheromones

DEFF Research Database (Denmark)

Takanashi, Takuma; Nakano, Ryo; Surlykke, Annemarie

2010-01-01

energy at 40 kHz, but distinctly different from the ultrasound produced by O. furnacalis, consisting of groups of pulses peaking at 50 kHz and with substantially more energy up to 80 kHz. Despite overall similarities, temporal features and patterns of amplitude modulation differed significantly among...... the geographic populations of O. nubilalis and O. scapulalis, which differed in pheromone type. In contrast, no significant difference in hearing was found among the three species with regard to the most sensitive frequencies and hearing threshold levels. The patterns of variations in the songs and pheromones...... well reflected those of the phylogenetic relationships, implying that ultrasound and pheromone communications have diverged concordantly. Our results suggest that concordant evolution in sexual signals such as courtship ultrasounds and sex pheromones occurs in moths....

Inorganic Nanoparticles for Multimodal Molecular Imaging

Directory of Open Access Journals (Sweden)

Magdalena Swierczewska

2011-01-01

Full Text Available Multimodal molecular imaging can offer a synergistic improvement of diagnostic ability over a single imaging modality. Recent development of hybrid imaging systems has profoundly impacted the pool of available multimodal imaging probes. In particular, much interest has been focused on biocompatible, inorganic nanoparticle-based multimodal probes. Inorganic nanoparticles offer exceptional advantages to the field of multimodal imaging owing to their unique characteristics, such as nanometer dimensions, tunable imaging properties, and multifunctionality. Nanoparticles mainly based on iron oxide, quantum dots, gold, and silica have been applied to various imaging modalities to characterize and image specific biologic processes on a molecular level. A combination of nanoparticles and other materials such as biomolecules, polymers, and radiometals continue to increase functionality for in vivo multimodal imaging and therapeutic agents. In this review, we discuss the unique concepts, characteristics, and applications of the various multimodal imaging probes based on inorganic nanoparticles.

Multimodality in organization studies

DEFF Research Database (Denmark)

Van Leeuwen, Theo

2017-01-01

This afterword reviews the chapters in this volume and reflects on the synergies between organization and management studies and multimodality studies that emerge from the volume. These include the combination of strong sociological theorizing and detailed multimodal analysis, a focus on material...

Practical multimodal care for cancer cachexia.

Science.gov (United States)

Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

2016-12-01

Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

Multimodality Imaging Approach towards Primary Aortic Sarcomas Arising after Endovascular Abdominal Aortic Aneurysm Repair: Case Series Report

Energy Technology Data Exchange (ETDEWEB)

Kamran, Mudassar, E-mail: kamranm@mir.wustl.edu; Fowler, Kathryn J., E-mail: fowlerk@mir.wustl.edu; Mellnick, Vincent M., E-mail: mellnickv@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States); Sicard, Gregorio A., E-mail: sicard@wudosis.wustl.edu [Washington University School of Medicine, Department of Surgery (United States); Narra, Vamsi R., E-mail: narrav@mir.wustl.edu [Washington University School of Medicine, Mallinckrodt Institute of Radiology (United States)

2016-06-15

Primary aortic neoplasms are rare. Aortic sarcoma arising after endovascular aneurysm repair (EVAR) is a scarce subset of primary aortic malignancies, reports of which are infrequent in the published literature. The diagnosis of aortic sarcoma is challenging due to its non-specific clinical presentation, and the prognosis is poor due to delayed diagnosis, rapid proliferation, and propensity for metastasis. Post-EVAR, aortic sarcomas may mimic other more common aortic processes on surveillance imaging. Radiologists are rarely knowledgeable about this rare entity for which multimodality imaging and awareness are invaluable in early diagnosis. A series of three pathologically confirmed cases are presented to display the multimodality imaging features and clinical presentations of aortic sarcoma arising after EVAR.

Flat-panel video resolution LED display system

Science.gov (United States)

Wareberg, P. G.; Kennedy, D. I.

The system consists of a 128 x 128 element X-Y addressable LED array fabricated from green-emitting gallium phosphide. The LED array is interfaced with a 128 x 128 matrix TV camera. Associated electronics provides for seven levels of grey scale above zero with a grey scale ratio of square root of 2. Picture elements are on 0.008 inch centers resulting in a resolution of 125 lines-per-inch and a display area of approximately 1 sq. in. The LED array concept lends itself to modular construction, permitting assembly of a flat panel screen of any desired size from 1 x 1 inch building blocks without loss of resolution. A wide range of prospective aerospace applications exist extending from helmet-mounted systems involving small dedicated arrays to multimode cockpit displays constructed as modular screens. High-resolution LED arrays are already used as CRT replacements in military film-marking reconnaissance applications.

A Learning Algorithm for Multimodal Grammar Inference.

Science.gov (United States)

D'Ulizia, A; Ferri, F; Grifoni, P

2011-12-01

The high costs of development and maintenance of multimodal grammars in integrating and understanding input in multimodal interfaces lead to the investigation of novel algorithmic solutions in automating grammar generation and in updating processes. Many algorithms for context-free grammar inference have been developed in the natural language processing literature. An extension of these algorithms toward the inference of multimodal grammars is necessary for multimodal input processing. In this paper, we propose a novel grammar inference mechanism that allows us to learn a multimodal grammar from its positive samples of multimodal sentences. The algorithm first generates the multimodal grammar that is able to parse the positive samples of sentences and, afterward, makes use of two learning operators and the minimum description length metrics in improving the grammar description and in avoiding the over-generalization problem. The experimental results highlight the acceptable performances of the algorithm proposed in this paper since it has a very high probability of parsing valid sentences.

Stereoscopic Integrated Imaging Goggles for Multimodal Intraoperative Image Guidance.

Directory of Open Access Journals (Sweden)

Christopher A Mela

Full Text Available We have developed novel stereoscopic wearable multimodal intraoperative imaging and display systems entitled Integrated Imaging Goggles for guiding surgeries. The prototype systems offer real time stereoscopic fluorescence imaging and color reflectance imaging capacity, along with in vivo handheld microscopy and ultrasound imaging. With the Integrated Imaging Goggle, both wide-field fluorescence imaging and in vivo microscopy are provided. The real time ultrasound images can also be presented in the goggle display. Furthermore, real time goggle-to-goggle stereoscopic video sharing is demonstrated, which can greatly facilitate telemedicine. In this paper, the prototype systems are described, characterized and tested in surgeries in biological tissues ex vivo. We have found that the system can detect fluorescent targets with as low as 60 nM indocyanine green and can resolve structures down to 0.25 mm with large FOV stereoscopic imaging. The system has successfully guided simulated cancer surgeries in chicken. The Integrated Imaging Goggle is novel in 4 aspects: it is (a the first wearable stereoscopic wide-field intraoperative fluorescence imaging and display system, (b the first wearable system offering both large FOV and microscopic imaging simultaneously,

Sexual courtship of steriles males of Ceratitis Capitata (WIED) in SIT program

International Nuclear Information System (INIS)

Fadhel, Salma

2008-01-01

In the SIT programme, the success of sterile males to compete with the fertile males is an important parameter for assuring efficiency. In this study, two methods are tested to improve the sterile male quality: the first is the exposure of sterile males to different concentrations of Ginger Root Oil (GRO) (0, 20, 50 and 80 μl), the second is the exposure of males to different irradiation doses (80, 90, 100, 110, 120 and 145 Gy). The comparison of these methods depends to study of quality parameters (emergence, flight ability, survival) and courtship behaviour of sterile males (sperm production, mating competitiveness, sperm transfer). The 80μl concentration of GRO improves the mating competitiveness of males to compare with the Control (respectively: 68% and 46%). The 80 Gy irradiation dose assure the same result then the Control. (Author)

Expression of human PQBP-1 in Drosophila impairs long-term memory and induces abnormal courtship.

Science.gov (United States)

Yoshimura, Natsue; Horiuchi, Daisuke; Shibata, Masao; Saitoe, Minoru; Qi, Mei-Ling; Okazawa, Hitoshi

2006-04-17

Frame shift mutations of the polyglutamine binding protein-1 (PQBP1) gene lead to total or partial truncation of the C-terminal domain (CTD) and cause mental retardation in human patients. Interestingly, normal Drosophila homologue of PQBP-1 lacks CTD. As a model to analyze the molecular network of PQBP-1 affecting intelligence, we generated transgenic flies expressing human PQBP-1 with CTD. Pavlovian olfactory conditioning revealed that the transgenic flies showed disturbance of long-term memory. In addition, they showed abnormal courtship that male flies follow male flies. Abnormal functions of PQBP-1 or its binding partner might be linked to these symptoms.

Multimodal Aspects of Corporate Social Responsibility Communication

Directory of Open Access Journals (Sweden)

Carmen Daniela Maier

2014-12-01

Full Text Available This article addresses how the multimodal persuasive strategies of corporate social responsibility communication can highlight a company’s commitment to gender empowerment and environmental protection while advertising simultaneously its products. Drawing on an interdisciplinary methodological framework related to CSR communication, multimodal discourse analysis and gender theory, the article proposes a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by Coca-Cola company in their community-related films. By examining the semiotic modes’ interconnectivity and functional differentiation, this analytical endeavour expands the existing research work as the usual textual focus is extended to a multimodal one.

Multimodal sequence learning.

Science.gov (United States)

Kemény, Ferenc; Meier, Beat

2016-02-01

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence. Copyright © 2015 Elsevier B.V. All rights reserved.

Multimodal Processes Rescheduling

DEFF Research Database (Denmark)

Bocewicz, Grzegorz; Banaszak, Zbigniew A.; Nielsen, Peter

2013-01-01

Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe-cuted in the......Cyclic scheduling problems concerning multimodal processes are usually observed in FMSs producing multi-type parts where the Automated Guided Vehicles System (AGVS) plays a role of a material handling system. Schedulability analysis of concurrently flowing cyclic processes (SCCP) exe...

Multimodal Resources in Transnational Adoption

DEFF Research Database (Denmark)

Raudaskoski, Pirkko Liisa

The paper discusses an empirical analysis which highlights the multimodal nature of identity construction. A documentary on transnational adoption provides real life incidents as research material. The incidents involve (or from them emerge) various kinds of multimodal resources and participants...

Multispectral analysis of multimodal images

Energy Technology Data Exchange (ETDEWEB)

Kvinnsland, Yngve; Brekke, Njaal (Dept. of Surgical Sciences, Univ. of Bergen, Bergen (Norway)); Taxt, Torfinn M.; Gruener, Renate (Dept. of Biomedicine, Univ. of Bergen, Bergen (Norway))

2009-02-15

An increasing number of multimodal images represent a valuable increase in available image information, but at the same time it complicates the extraction of diagnostic information across the images. Multispectral analysis (MSA) has the potential to simplify this problem substantially as unlimited number of images can be combined, and tissue properties across the images can be extracted automatically. Materials and methods. We have developed a software solution for MSA containing two algorithms for unsupervised classification, an EM-algorithm finding multinormal class descriptions and the k-means clustering algorithm, and two for supervised classification, a Bayesian classifier using multinormal class descriptions and a kNN-algorithm. The software has an efficient user interface for the creation and manipulation of class descriptions, and it has proper tools for displaying the results. Results. The software has been tested on different sets of images. One application is to segment cross-sectional images of brain tissue (T1- and T2-weighted MR images) into its main normal tissues and brain tumors. Another interesting set of images are the perfusion maps and diffusion maps, derived images from raw MR images. The software returns segmentation that seem to be sensible. Discussion. The MSA software appears to be a valuable tool for image analysis with multimodal images at hand. It readily gives a segmentation of image volumes that visually seems to be sensible. However, to really learn how to use MSA, it will be necessary to gain more insight into what tissues the different segments contain, and the upcoming work will therefore be focused on examining the tissues through for example histological sections.

Multimodal Diversity of Postmodernist Fiction Text

Directory of Open Access Journals (Sweden)

U. I. Tykha

2016-12-01

Full Text Available The article is devoted to the analysis of structural and functional manifestations of multimodal diversity in postmodernist fiction texts. Multimodality is defined as the coexistence of more than one semiotic mode within a certain context. Multimodal texts feature a diversity of semiotic modes in the communication and development of their narrative. Such experimental texts subvert conventional patterns by introducing various semiotic resources – verbal or non-verbal.

Experiments in Multimodal Information Presentation

NARCIS (Netherlands)

van Hooijdonk, Charlotte; Bosma, W.E.; Krahmer, Emiel; Maes, Alfons; Theune, Mariet; van den Bosch, Antal; Bouma, Gosse

In this chapter we describe three experiments investigating multimodal information presentation in the context of a medical QA system. In Experiment 1, we wanted to know how non-experts design (multimodal) answers to medical questions, distinguishing between what questions and how questions. In

Modeling multimodal human-computer interaction

NARCIS (Netherlands)

Obrenovic, Z.; Starcevic, D.

2004-01-01

Incorporating the well-known Unified Modeling Language into a generic modeling framework makes research on multimodal human-computer interaction accessible to a wide range off software engineers. Multimodal interaction is part of everyday human discourse: We speak, move, gesture, and shift our gaze

Multimodal Discourse Analysis of the Movie "Argo"

Science.gov (United States)

Bo, Xu

2018-01-01

Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

Courtship, sex and poverty: illegitimacy in eighteenth-century Wales.

Science.gov (United States)

Muir, Angela Joy

2018-01-01

This article sheds new light on illegitimacy in eighteenth-century Britain through an analysis of evidence from 36 parishes across the former Welsh counties Montgomeryshire and Radnorshire. Quantitative analysis of illegitimacy ratios demonstrates that levels were significantly higher in certain, but not all, parts of Wales in the eighteenth century. This evidence is considered in relation to explanatory frameworks used in the analysis of English data, which attempt to account for rising levels through cultural changes that influenced premarital sexual behaviour, and economic opportunities created by industrialization. Welsh evidence appears to present a challenge to these understandings in two key ways: Wales was linguistically different and lacked certain cultural markers which some historians have associated with an eighteenth-century 'sexual revolution', and because the highest levels of illegitimacy were found in agricultural regions of Wales which experienced little or no industrial change. It is argued that Welsh illegitimacy was influenced by a combination of courtship-led marriage customs, a decline in traditional forms of social control and worsening economic circumstances which, on closer examination, appear remarkably similar to London. This analysis provides further evidence that illegitimacy in eighteenth-century Britain was a deeply complex phenomenon governed by diverse regionally specific social and economic influences.

Multimodal exemplification: The expansion of meaning in electronic ...

African Journals Online (AJOL)

Functional Multimodal Discourse Analysis (SF-MDA) and argues for improving their exemplifica-tion multimodally. Multimodal devices, if well coordinated, can help optimize e-dictionary exam-ples in informativity, diversity, dynamicity and ...

Is courtship intensity a signal of male parental care in Red-winged Blackbirds (Agelaius phoeniceus)?

Science.gov (United States)

Yasukawa, Ken; Knight, Richard L.; Skagen, Susan Knight

1987-01-01

We studied Red-winged Blackbird (Agelaius phoeniceus) behavior in marsh and prairie habitats to determine whether courting males provide cues of their nest defense, whether females prefer males that defend nests vigorously, and whether male nest defense affects nest success. We found no evidence that courtship behavior provides cues of male nest defense, or that females prefer males that court intensely. We found evidence that females nesting in marshes prefer males that defend nests intensely, but no evidence that intensely defending males in the prairie habitat achieve high nest success. We found differences, however, between marsh and prairie habitats that suggest a coarse-grained relationship between male parental quality and female choice of mate in this species.

BILINGUAL MULTIMODAL SYSTEM FOR TEXT-TO-AUDIOVISUAL SPEECH AND SIGN LANGUAGE SYNTHESIS

Directory of Open Access Journals (Sweden)

A. A. Karpov

2014-09-01

Full Text Available We present a conceptual model, architecture and software of a multimodal system for audio-visual speech and sign language synthesis by the input text. The main components of the developed multimodal synthesis system (signing avatar are: automatic text processor for input text analysis; simulation 3D model of human's head; computer text-to-speech synthesizer; a system for audio-visual speech synthesis; simulation 3D model of human’s hands and upper body; multimodal user interface integrating all the components for generation of audio, visual and signed speech. The proposed system performs automatic translation of input textual information into speech (audio information and gestures (video information, information fusion and its output in the form of multimedia information. A user can input any grammatically correct text in Russian or Czech languages to the system; it is analyzed by the text processor to detect sentences, words and characters. Then this textual information is converted into symbols of the sign language notation. We apply international «Hamburg Notation System» - HamNoSys, which describes the main differential features of each manual sign: hand shape, hand orientation, place and type of movement. On their basis the 3D signing avatar displays the elements of the sign language. The virtual 3D model of human’s head and upper body has been created using VRML virtual reality modeling language, and it is controlled by the software based on OpenGL graphical library. The developed multimodal synthesis system is a universal one since it is oriented for both regular users and disabled people (in particular, for the hard-of-hearing and visually impaired, and it serves for multimedia output (by audio and visual modalities of input textual information.

Reference resolution in multi-modal interaction: Preliminary observations

NARCIS (Netherlands)

González González, G.R.; Nijholt, Antinus

2002-01-01

In this paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can apply

Reference Resolution in Multi-modal Interaction: Position paper

NARCIS (Netherlands)

Fernando, T.; Nijholt, Antinus

2002-01-01

In this position paper we present our research on multimodal interaction in and with virtual environments. The aim of this presentation is to emphasize the necessity to spend more research on reference resolution in multimodal contexts. In multi-modal interaction the human conversational partner can

Robust Multimodal Dictionary Learning

Science.gov (United States)

Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

2014-01-01

We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

Beyond magic traits: Multimodal mating cues in Heliconius butterflies.

Science.gov (United States)

Mérot, Claire; Frérot, Brigitte; Leppik, Ene; Joron, Mathieu

2015-11-01

Species coexistence involves the evolution of reproductive barriers opposing gene flow. Heliconius butterflies display colorful patterns affecting mate choice and survival through warning signaling and mimicry. These patterns are called "magic traits" for speciation because divergent natural selection may promote mimicry shifts in pattern whose role as mating cue facilitates reproductive isolation. By contrast, between comimetic species, natural selection promotes pattern convergence. We addressed whether visual convergence interferes with reproductive isolation by testing for sexual isolation between two closely related species with similar patterns, H. timareta thelxinoe and H. melpomene amaryllis. Experiments with models confirmed visual attraction based on wing phenotype, leading to indiscriminate approach. Nevertheless, mate choice experiments showed assortative mating. Monitoring male behavior toward live females revealed asymmetry in male preference, H. melpomene males courting both species equally while H. timareta males strongly preferred conspecifics. Experiments with hybrid males suggested an important genetic component for such asymmetry. Behavioral observations support a key role for short-distance cues in determining male choice in H. timareta. Scents extracts from wings and genitalia revealed interspecific divergence in chemical signatures, and hybrid female scent composition was significantly associated with courtship intensity by H. timareta males, providing candidate chemical mating cues involved in sexual isolation. © 2015 The Author(s). Evolution © 2015 The Society for the Study of Evolution.

Recent developments in multimodality fluorescence imaging probes

Directory of Open Access Journals (Sweden)

Jianhong Zhao

2018-05-01

Full Text Available Multimodality optical imaging probes have emerged as powerful tools that improve detection sensitivity and accuracy, important in disease diagnosis and treatment. In this review, we focus on recent developments of optical fluorescence imaging (OFI probe integration with other imaging modalities such as X-ray computed tomography (CT, magnetic resonance imaging (MRI, positron emission tomography (PET, single-photon emission computed tomography (SPECT, and photoacoustic imaging (PAI. The imaging technologies are briefly described in order to introduce the strengths and limitations of each techniques and the need for further multimodality optical imaging probe development. The emphasis of this account is placed on how design strategies are currently implemented to afford physicochemically and biologically compatible multimodality optical fluorescence imaging probes. We also present studies that overcame intrinsic disadvantages of each imaging technique by multimodality approach with improved detection sensitivity and accuracy. KEY WORDS: Optical imaging, Fluorescence, Multimodality, Near-infrared fluorescence, Nanoprobe, Computed tomography, Magnetic resonance imaging, Positron emission tomography, Single-photon emission computed tomography, Photoacoustic imaging

Multimode-singlemode-multimode fiber sensor for alcohol sensing application

Science.gov (United States)

Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

Multimodal pain management after arthroscopic surgery

DEFF Research Database (Denmark)

Rasmussen, Sten

Multimodal Pain Management after Arthroscopic Surgery By Sten Rasmussen, M.D. The thesis is based on four randomized controlled trials. The main hypothesis was that multimodal pain treatment provides faster recovery after arthroscopic surgery. NSAID was tested against placebo after knee arthroscopy...

Multimodality, creativity and children's meaning-making: Drawings ...

African Journals Online (AJOL)

Multimodality, creativity and children's meaning-making: Drawings, writings, imaginings. ... Framed by social semiotic theories of communication, multimodal ... to create imaginary worlds and express meanings according to their interests.

A new multimodal interactive way of subjective scoring of 3D video quality of experience

Science.gov (United States)

Kim, Taewan; Lee, Kwanghyun; Lee, Sanghoon; Bovik, Alan C.

2014-03-01

People that watch today's 3D visual programs, such as 3D cinema, 3D TV and 3D games, experience wide and dynamically varying ranges of 3D visual immersion and 3D quality of experience (QoE). It is necessary to be able to deploy reliable methodologies that measure each viewers subjective experience. We propose a new methodology that we call Multimodal Interactive Continuous Scoring of Quality (MICSQ). MICSQ is composed of a device interaction process between the 3D display and a separate device (PC, tablet, etc.) used as an assessment tool, and a human interaction process between the subject(s) and the device. The scoring process is multimodal, using aural and tactile cues to help engage and focus the subject(s) on their tasks. Moreover, the wireless device interaction process makes it possible for multiple subjects to assess 3D QoE simultaneously in a large space such as a movie theater, and at di®erent visual angles and distances.

Towards an intelligent framework for multimodal affective data analysis.

Science.gov (United States)

Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

2015-03-01

An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

Active and passive sexual roles that arise in Drosophila male-male courtship are modulated by dopamine levels in PPL2ab neurons

OpenAIRE

Shiu-Ling Chen; Yu-Hui Chen; Chuan-Chan Wang; Yhu-Wei Yu; Yu-Chen Tsai; Hsiao-Wen Hsu; Chia-Lin Wu; Pei-Yu Wang; Lien-Cheng Chen; Tsuo-Hung Lan; Tsai-Feng Fu

2017-01-01

The neurology of male sexuality has been poorly studied owing to difficulties in studying brain circuitry in humans. Dopamine (DA) is essential for both physiological and behavioural responses, including the regulation of sexuality. Previous studies have revealed that alterations in DA synthesis in dopaminergic neurons can induce male-male courtship behaviour, while increasing DA levels in the protocerebral posteriolateral dopaminergic cluster neuron 2ab (PPL2ab) may enhance the intensity of ...

(Re-)Examination of Multimodal Augmented Reality

NARCIS (Netherlands)

Rosa, N.E.; Werkhoven, P.J.; Hürst, W.O.

2016-01-01

The majority of augmented reality (AR) research has been concerned with visual perception, however the move towards multimodality is imminent. At the same time, there is no clear vision of what multimodal AR is. The purpose of this position paper is to consider possible ways of examining AR other

Multimodal integration of anatomy and physiology classes: How instructors utilize multimodal teaching in their classrooms

Science.gov (United States)

McGraw, Gerald M., Jr.

Multimodality is the theory of communication as it applies to social and educational semiotics (making meaning through the use of multiple signs and symbols). The term multimodality describes a communication methodology that includes multiple textual, aural, and visual applications (modes) that are woven together to create what is referred to as an artifact. Multimodal teaching methodology attempts to create a deeper meaning to course content by activating the higher cognitive areas of the student's brain, creating a more sustained retention of the information (Murray, 2009). The introduction of multimodality educational methodologies as a means to more optimally engage students has been documented within educational literature. However, studies analyzing the distribution and penetration into basic sciences, more specifically anatomy and physiology, have not been forthcoming. This study used a quantitative survey design to determine the degree to which instructors integrated multimodality teaching practices into their course curricula. The instrument used for the study was designed by the researcher based on evidence found in the literature and sent to members of three associations/societies for anatomy and physiology instructors: the Human Anatomy and Physiology Society; the iTeach Anatomy & Physiology Collaborate; and the American Physiology Society. Respondents totaled 182 instructor members of two- and four-year, private and public higher learning colleges collected from the three organizations collectively with over 13,500 members in over 925 higher learning institutions nationwide. The study concluded that the expansion of multimodal methodologies into anatomy and physiology classrooms is at the beginning of the process and that there is ample opportunity for expansion. Instructors continue to use lecture as their primary means of interaction with students. Email is still the major form of out-of-class communication for full-time instructors. Instructors with

It pays to cheat: tactical deception in a cephalopod social signalling system.

Science.gov (United States)

Brown, Culum; Garwood, Martin P; Williamson, Jane E

2012-10-23

Signals in intraspecific communication should be inherently honest; otherwise the system is prone to collapse. Theory predicts, however, that honest signalling systems are susceptible to invasion by cheats, the extent of which is largely mediated by fear of reprisal. Cuttlefish facultatively change their shape and colour, an ability that evolved to avoid predators and capture prey. Here, we show that this ability is tactically employed by male mourning cuttlefish (Sepia plangon) to mislead conspecifics during courtship in a specific social context amenable to cheating 39 per cent of the time, while it was never employed in other social contexts. Males deceive rival males by displaying male courtship patterns to receptive females on one side of the body, and simultaneously displaying female patterns to a single rival male on the other, thus preventing the rival from disrupting courtship. The use of tactical deception in such a complex communication network indicates that sociality has played a key role in the cognitive evolution of cephalopods.

Multimodale trafiknet i GIS (Multimodal Traffic Network in GIS)

DEFF Research Database (Denmark)

Kronbak, Jacob; Brems, Camilla Riff

1996-01-01

The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example.......The report introduces the use of multi-modal traffic networks within a geographical Information System (GIS). The necessary theory of modelling multi-modal traffic network is reviewed and applied to the ARC/INFO GIS by an explorative example....

Training of Perceptual Motor Skills in Multimodal Virtual Environments

Directory of Open Access Journals (Sweden)

Gopher Daniel

2011-12-01

Full Text Available Multimodal, immersive, virtual reality (VR techniques open new perspectives for perceptualmotor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

Multimodal processes scheduling in mesh-like network environment

Directory of Open Access Journals (Sweden)

Bocewicz Grzegorz

2015-06-01

Full Text Available Multimodal processes planning and scheduling play a pivotal role in many different domains including city networks, multimodal transportation systems, computer and telecommunication networks and so on. Multimodal process can be seen as a process partially processed by locally executed cyclic processes. In that context the concept of a Mesh-like Multimodal Transportation Network (MMTN in which several isomorphic subnetworks interact each other via distinguished subsets of common shared intermodal transport interchange facilities (such as a railway station, bus station or bus/tram stop as to provide a variety of demand-responsive passenger transportation services is examined. Consider a mesh-like layout of a passengers transport network equipped with different lines including buses, trams, metro, trains etc. where passenger flows are treated as multimodal processes. The goal is to provide a declarative model enabling to state a constraint satisfaction problem aimed at multimodal transportation processes scheduling encompassing passenger flow itineraries. Then, the main objective is to provide conditions guaranteeing solvability of particular transport lines scheduling, i.e. guaranteeing the right match-up of local cyclic acting bus, tram, metro and train schedules to a given passengers flow itineraries.

Mediating multimodal environmental knowledge across animation techniques

DEFF Research Database (Denmark)

Maier, Carmen Daniela

2011-01-01

://www.sustainlane.com/. The multimodal discourse analysis is meant to reveal how selection and representation of environmental knowledge about social actors, social actions, resources, time and space are influenced by animation techniques. Furthermore, in the context of this multimodal discourse analysis, their influence upon......The growing awareness of and concern about present environmental problems generate a proliferation of new forms of environmental discourses that are mediated in various ways. This chapter explores issues related to the ways in which environmental knowledge is multimodally communicated...

Oestradiol and prostaglandin F2α regulate sexual displays in females of a sex-role reversed fish

Science.gov (United States)

Gonçalves, David; Costa, Silvia Santos; Teles, Magda C.; Silva, Helena; Inglês, Mafalda; Oliveira, Rui F.

2014-01-01

The mechanisms regulating sexual behaviours in female vertebrates are still poorly understood, mainly because in most species sexual displays in females are more subtle and less frequent than displays in males. In a sex-role reversed population of a teleost fish, the peacock blenny Salaria pavo, an external fertilizer, females are the courting sex and their sexual displays are conspicuous and unambiguous. We took advantage of this to investigate the role of ovarian-synthesized hormones in the induction of sexual displays in females. In particular, the effects of the sex steroids oestradiol (E2) and testosterone (T) and of the prostaglandin F2α (PGF2α) were tested. Females were ovariectomized and their sexual behaviour tested 7 days (sex steroids and PGF2α) and 14 days (sex steroids) after ovariectomy by presenting females to an established nesting male. Ovariectomy reduced the expression of sexual behaviours, although a significant proportion of females still courted the male 14 days after the ovary removal. Administration of PGF2α to ovariectomized females recovered the frequency of approaches to the male's nest and of courtship displays towards the nesting male. However, E2 also had a positive effect on sexual behaviour, particularly on the frequency of approaches to the male's nest. T administration failed to recover sexual behaviours in ovariectomized females. These results suggest that the increase in E2 levels postulated to occur during the breeding season facilitates female mate-searching and assessment behaviours, whereas PGF2α acts as a short-latency endogenous signal informing the brain that oocytes are mature and ready to be spawned. In the light of these results, the classical view for female fishes, that sex steroids maintain sexual behaviour in internal fertilizers and that prostaglandins activate spawning behaviours in external fertilizers, needs to be reviewed. PMID:24452030

Acoustic multimode interference and self-imaging phenomena realized in multimodal phononic crystal waveguides

International Nuclear Information System (INIS)

Zou, Qiushun; Yu, Tianbao; Liu, Jiangtao; Wang, Tongbiao; Liao, Qinghua; Liu, Nianhua

2015-01-01

We report an acoustic multimode interference effect and self-imaging phenomena in an acoustic multimode waveguide system which consists of M parallel phononic crystal waveguides (M-PnCWs). Results show that the self-imaging principle remains applicable for acoustic waveguides just as it does for optical multimode waveguides. To achieve the dispersions and replicas of the input acoustic waves produced along the propagation direction, we performed the finite element method on M-PnCWs, which support M guided modes within the target frequency range. The simulation results show that single images (including direct and mirrored images) and N-fold images (N is an integer) are identified along the propagation direction with asymmetric and symmetric incidence discussed separately. The simulated positions of the replicas agree well with the calculated values that are theoretically decided by self-imaging conditions based on the guided mode propagation analysis. Moreover, the potential applications based on this self-imaging effect for acoustic wavelength de-multiplexing and beam splitting in the acoustic field are also presented. (paper)

Modeling decision-making in single- and multi-modal medical images

Science.gov (United States)

Canosa, R. L.; Baum, K. G.

2009-02-01

This research introduces a mode-specific model of visual saliency that can be used to highlight likely lesion locations and potential errors (false positives and false negatives) in single-mode PET and MRI images and multi-modal fused PET/MRI images. Fused-modality digital images are a relatively recent technological improvement in medical imaging; therefore, a novel component of this research is to characterize the perceptual response to these fused images. Three different fusion techniques were compared to single-mode displays in terms of observer error rates using synthetic human brain images generated from an anthropomorphic phantom. An eye-tracking experiment was performed with naÃve (non-radiologist) observers who viewed the single- and multi-modal images. The eye-tracking data allowed the errors to be classified into four categories: false positives, search errors (false negatives never fixated), recognition errors (false negatives fixated less than 350 milliseconds), and decision errors (false negatives fixated greater than 350 milliseconds). A saliency model consisting of a set of differentially weighted low-level feature maps is derived from the known error and ground truth locations extracted from a subset of the test images for each modality. The saliency model shows that lesion and error locations attract visual attention according to low-level image features such as color, luminance, and texture.

Polarization Characterization of a Multi-Moded Feed Structure

Data.gov (United States)

National Aeronautics and Space Administration — The Polarization Characterization of a Multi-Moded Feed Structure projects characterize the polarization response of a multi-moded feed horn as an innovative...

Filter. Remix. Make.: Cultivating Adaptability through Multimodality

Science.gov (United States)

Dusenberry, Lisa; Hutter, Liz; Robinson, Joy

2015-01-01

This article establishes traits of adaptable communicators in the 21st century, explains why adaptability should be a goal of technical communication educators, and shows how multimodal pedagogy supports adaptability. Three examples of scalable, multimodal assignments (infographics, research interviews, and software demonstrations) that evidence…

To females of a noctuid moth, male courtship songs are nothing more than bat echolocation calls

DEFF Research Database (Denmark)

Nakano, Ryo; Takanashi, Takuma; Skals, Niels

2010-01-01

It has been proposed that intraspecific ultrasonic communication observed in some moths evolved, through sexual selection, subsequent to the development of ears sensitive to echolocation calls of insectivorous bats. Given this scenario, the receiver bias model of signal evolution argues that acou......It has been proposed that intraspecific ultrasonic communication observed in some moths evolved, through sexual selection, subsequent to the development of ears sensitive to echolocation calls of insectivorous bats. Given this scenario, the receiver bias model of signal evolution argues...... production in the male moth, and subsequently the role of the sound with reference to the female's ability to discriminate male courtship songs from bat calls. We found that males have sex-specific tymbals for ultrasound emission, and that the broadcast of either male songs or simulated bat calls equally...

Multimodal Pedagogies for Teacher Education in TESOL

Science.gov (United States)

Yi, Youngjoo; Angay-Crowder, Tuba

2016-01-01

As a growing number of English language learners (ELLs) engage in digital and multimodal literacy practices in their daily lives, teachers are starting to incorporate multimodal approaches into their instruction. However, anecdotal and empirical evidence shows that teachers often feel unprepared for integrating such practices into their curricula…

Implications of Multimodal Learning Models for foreign language teaching and learning

Directory of Open Access Journals (Sweden)

Miguel Farías

2011-04-01

Full Text Available This literature review article approaches the topic of information and communications technologies from the perspective of their impact on the language learning process, with particular emphasis on the most appropriate designs of multimodal texts as informed by models of multimodal learning. The first part contextualizes multimodality within the fields of discourse studies, the psychology of learning and CALL; the second, deals with multimodal conceptions of reading and writing by discussing hypertextuality and literacy. A final section outlines the possible implications of multimodal learning models for foreign language teaching and learning.

Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

Directory of Open Access Journals (Sweden)

Gayathri Rajagopal

2015-01-01

Full Text Available This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

Reproductive biology of the masked triggerfish Sufflamen fraenatus

Digital Repository Service at National Institute of Oceanography (India)

Sahayak, S.

different place at the time of spawning. According to Gladstone (1994), trigger fishes display pre-courtship, courtship and parental care at the time of spawning. The male migrates to a traditional mating ground where it establishes a territory... habits of some fishes of the Java Sea. Treubia, 17: 307-330. Fricke, H.W. 1980. Mating systems, maternal and biparental care in triggerfish (Balistidae). Z. Tierpsychol, 53 : 105-122. Gladstone, W. 1994. Lek- Like spawning, parental care and mating...

Percorsi linguistici e semiotici: Critical Multimodal Analysis of Digital Discourse

Directory of Open Access Journals (Sweden)

edited by Ilaria Moschini

2014-12-01

Full Text Available The language section of LEA - edited by Ilaria Moschini - is dedicated to the Critical Multimodal Analysis of Digital Discourse, an approach that encompasses the linguistic and semiotic detailed investigation of texts within a socio-cultural perspective. It features an interview with Professor Theo van Leeuwen by Ilaria Moschini and four essays: “Retwitting, reposting, repinning; reshaping identities online: Towards a social semiotic multimodal analysis of digital remediation” by Elisabetta Adami; “Multimodal aspects of corporate social responsibility communication” by Carmen Daniela Maier; “Pervasive Technologies and the Paradoxes of Multimodal Digital Communication” by Sandra Petroni and “Can the powerless speak? Linguistic and multimodal corporate media manipulation in digital environments: the case of Malala Yousafzai” by Maria Grazia Sindoni. 

Fiber-Optic Vibration Sensor Based on Multimode Fiber

Directory of Open Access Journals (Sweden)

I. Lujo

2008-06-01

Full Text Available The purpose of this paper is to present a fiberoptic vibration sensor based on the monitoring of the mode distribution in a multimode optical fiber. Detection of vibrations and their parameters is possible through observation of the output speckle pattern from the multimode optical fiber. A working experimental model has been built in which all used components are widely available and cheap: a CCD camera (a simple web-cam, a multimode laser in visible range as a light source, a length of multimode optical fiber, and a computer for signal processing. Measurements have shown good agreement with the actual frequency of vibrations, and promising results were achieved with the amplitude measurements although they require some adaptation of the experimental model. Proposed sensor is cheap and lightweight and therefore presents an interesting alternative for monitoring large smart structures.

Video genre classification using multimodal features

Science.gov (United States)

Jin, Sung Ho; Bae, Tae Meon; Choo, Jin Ho; Ro, Yong Man

2003-12-01

We propose a video genre classification method using multimodal features. The proposed method is applied for the preprocessing of automatic video summarization or the retrieval and classification of broadcasting video contents. Through a statistical analysis of low-level and middle-level audio-visual features in video, the proposed method can achieve good performance in classifying several broadcasting genres such as cartoon, drama, music video, news, and sports. In this paper, we adopt MPEG-7 audio-visual descriptors as multimodal features of video contents and evaluate the performance of the classification by feeding the features into a decision tree-based classifier which is trained by CART. The experimental results show that the proposed method can recognize several broadcasting video genres with a high accuracy and the classification performance with multimodal features is superior to the one with unimodal features in the genre classification.

Concepts for space nuclear multi-mode reactors

International Nuclear Information System (INIS)

Myrabo, L.; Botts, T.E.; Powell, J.R.

1983-01-01

A number of nuclear multi-mode reactor power plants are conceptualized for use with solid core, fixed particle bed and rotating particle bed reactors. Multi-mode systems generate high peak electrical power in the open cycle mode, with MHD generator or turbogenerator converters and cryogenically stored coolants. Low level stationkeeping power and auxiliary reactor cooling (i.e., for the removal of reactor afterheat) are provided in a closed cycle mode. Depending on reactor design, heat transfer to the low power converters can be accomplished by heat pipes, liquid metal coolants or high pressure gas coolants. Candidate low power conversion cycles include Brayton turbogenerator, Rankine turbogenerator, thermoelectric and thermionic approaches. A methodology is suggested for estimating the system mass of multi-mode nuclear power plants as a function of peak electric power level and required mission run time. The masses of closed cycle nuclear and open cycle chemical power systems are briefly examined to identify the regime of superiority for nuclear multi-mode systems. Key research and technology issues for such power plants are also identified

Multimode optical fibers: steady state mode exciter.

Science.gov (United States)

Ikeda, M; Sugimura, A; Ikegami, T

1976-09-01

The steady state mode power distribution of the multimode graded index fiber was measured. A simple and effective steady state mode exciter was fabricated by an etching technique. Its insertion loss was 0.5 dB for an injection laser. Deviation in transmission characteristics of multimode graded index fibers can be avoided by using the steady state mode exciter.

Observations on Territorial Behaviour of Springbok, Antidorcas ...

African Journals Online (AJOL)

Males did not have permanent harems, since groups of females were fluid in composition and highly mobile. Groups ... Aspects of territorial behaviour, such as courtship displays, defence of territory (by chasing out trespassing males), and advertising of territory by means of linked urination-defaecation displays on discrete ...

Deterministic multimode photonic device for quantum-information processing

DEFF Research Database (Denmark)

Nielsen, Anne E. B.; Mølmer, Klaus

2010-01-01

We propose the implementation of a light source that can deterministically generate a rich variety of multimode quantum states. The desired states are encoded in the collective population of different ground hyperfine states of an atomic ensemble and converted to multimode photonic states by exci...

Multimodal network design for sustainable household plastic recycling

NARCIS (Netherlands)

Bing Xiaoyun, Xiaoyun; Groot, J.J.; Bloemhof, J.M.; Vorst, van der J.G.A.J.

2013-01-01

Purpose – This research studies a plastic recycling system from a reverse logistics angle and investigates the potential benefits of a multimodality strategy to the network design of plastic recycling. This research aims to quantify the impact of multimodality on the network, to provide decision

Multimodal Speaker Diarization.

Science.gov (United States)

Noulas, A; Englebienne, G; Krose, B J A

2012-01-01

We present a novel probabilistic framework that fuses information coming from the audio and video modality to perform speaker diarization. The proposed framework is a Dynamic Bayesian Network (DBN) that is an extension of a factorial Hidden Markov Model (fHMM) and models the people appearing in an audiovisual recording as multimodal entities that generate observations in the audio stream, the video stream, and the joint audiovisual space. The framework is very robust to different contexts, makes no assumptions about the location of the recording equipment, and does not require labeled training data as it acquires the model parameters using the Expectation Maximization (EM) algorithm. We apply the proposed model to two meeting videos and a news broadcast video, all of which come from publicly available data sets. The results acquired in speaker diarization are in favor of the proposed multimodal framework, which outperforms the single modality analysis results and improves over the state-of-the-art audio-based speaker diarization.

Multi-modal locomotion: from animal to application

International Nuclear Information System (INIS)

Lock, R J; Burgess, S C; Vaidyanathan, R

2014-01-01

The majority of robotic vehicles that can be found today are bound to operations within a single media (i.e. land, air or water). This is very rarely the case when considering locomotive capabilities in natural systems. Utility for small robots often reflects the exact same problem domain as small animals, hence providing numerous avenues for biological inspiration. This paper begins to investigate the various modes of locomotion adopted by different genus groups in multiple media as an initial attempt to determine the compromise in ability adopted by the animals when achieving multi-modal locomotion. A review of current biologically inspired multi-modal robots is also presented. The primary aim of this research is to lay the foundation for a generation of vehicles capable of multi-modal locomotion, allowing ambulatory abilities in more than one media, surpassing current capabilities. By identifying and understanding when natural systems use specific locomotion mechanisms, when they opt for disparate mechanisms for each mode of locomotion rather than using a synergized singular mechanism, and how this affects their capability in each medium, similar combinations can be used as inspiration for future multi-modal biologically inspired robotic platforms. (topical review)

Multimodal Scaffolding in the Secondary English Classroom Curriculum

Science.gov (United States)

Boche, Benjamin; Henning, Megan

2015-01-01

This article examines the topic of multimodal scaffolding in the secondary English classroom curriculum through the viewpoint of one teacher's experiences. With technology becoming more commonplace and readily available in the English classroom, we must pinpoint specific and tangible ways to help teachers use and teach multimodalities in their…

Optimal Face-Iris Multimodal Fusion Scheme

Directory of Open Access Journals (Sweden)

Omid Sharifi

2016-06-01

Full Text Available Multimodal biometric systems are considered a way to minimize the limitations raised by single traits. This paper proposes new schemes based on score level, feature level and decision level fusion to efficiently fuse face and iris modalities. Log-Gabor transformation is applied as the feature extraction method on face and iris modalities. At each level of fusion, different schemes are proposed to improve the recognition performance and, finally, a combination of schemes at different fusion levels constructs an optimized and robust scheme. In this study, CASIA Iris Distance database is used to examine the robustness of all unimodal and multimodal schemes. In addition, Backtracking Search Algorithm (BSA, a novel population-based iterative evolutionary algorithm, is applied to improve the recognition accuracy of schemes by reducing the number of features and selecting the optimized weights for feature level and score level fusion, respectively. Experimental results on verification rates demonstrate a significant improvement of proposed fusion schemes over unimodal and multimodal fusion methods.

Multimodal coaching and its application to workplace, life and health coaching

OpenAIRE

Stephen Palmer

2012-01-01

This article highlights how the multimodal approach (Lazarus, 1989) has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Diffusion Maps for Multimodal Registration

Directory of Open Access Journals (Sweden)

Gemma Piella

2014-06-01

Full Text Available Multimodal image registration is a difficult task, due to the significant intensity variations between the images. A common approach is to use sophisticated similarity measures, such as mutual information, that are robust to those intensity variations. However, these similarity measures are computationally expensive and, moreover, often fail to capture the geometry and the associated dynamics linked with the images. Another approach is the transformation of the images into a common space where modalities can be directly compared. Within this approach, we propose to register multimodal images by using diffusion maps to describe the geometric and spectral properties of the data. Through diffusion maps, the multimodal data is transformed into a new set of canonical coordinates that reflect its geometry uniformly across modalities, so that meaningful correspondences can be established between them. Images in this new representation can then be registered using a simple Euclidean distance as a similarity measure. Registration accuracy was evaluated on both real and simulated brain images with known ground-truth for both rigid and non-rigid registration. Results showed that the proposed approach achieved higher accuracy than the conventional approach using mutual information.

Response of brown anoles Anolis sagrei to multimodal signals from a native and novel predator

Directory of Open Access Journals (Sweden)

Omar L. ELMASRI, Marcus S. MORENO, Courtney A. NEUMANN, Daniel T. BLUMSTEIN

2012-06-01

Full Text Available Multiple studies have focused on the importance of single modalities (visual, auditory, olfactory in eliciting anti-predator behavior, however multiple channels are often engaged simultaneously. While examining responses to multiple cues can potentially reveal more complex behavioral responses, little is known about how multimodal processing evolves. By contrasting response to familiar and novel predators, insights can be gained into the evolution of multimodal responses. We studied brown anoles’ (Anolis sagrei response to acoustic and visual predatory cues of a common potential predator, the great-tailed grackle Quiscalus mexicanus and to the American kestrel Falco sparverius, a species found in other populations but not present in our study population. We observed anole behavior before and after a stimulus and quantified rates of looking, display, and locomotion. Anoles increased their rate of locomotion in response to grackle models, an effect modulated by grackle vocalizations. No such response or modulation was seen when anoles were presented with kestrel stimuli. This suggests that the degree of sophistication of anole response to predators is experience dependent and that relaxed selection can result in reduced anti-predator response following loss of predators [Current Zoology 58 (6: 791–796, 2012].

Robustness of multimodal processes itineraries

DEFF Research Database (Denmark)

Bocewicz, G.; Banaszak, Z.; Nielsen, Izabela Ewa

2013-01-01

itineraries for assumed (O-D) trip. Since itinerary planning problem, constitutes a common routing and scheduling decision faced by travelers, hence the main question regards of itinerary replanning and particularly a method aimed at prototyping of mode sequences and paths selections. The declarative model......This paper concerns multimodal transport systems (MTS) represented by a supernetworks in which several unimodal networks are connected by transfer links and focuses on the scheduling problems encountered in these systems. Assuming unimodal networks are modeled as cyclic lines, i.e. the routes...... of multimodal processes driven itinerary planning problem is our main contribution. Illustrative examples providing alternative itineraries in some cases of MTS malfunction are presented....

Multimode model for projective photon-counting measurements

International Nuclear Information System (INIS)

Tualle-Brouri, Rosa; Ourjoumtsev, Alexei; Dantan, Aurelien; Grangier, Philippe; Wubs, Martijn; Soerensen, Anders S.

2009-01-01

We present a general model to account for the multimode nature of the quantum electromagnetic field in projective photon-counting measurements. We focus on photon-subtraction experiments, where non-Gaussian states are produced conditionally. These are useful states for continuous-variable quantum-information processing. We present a general method called mode reduction that reduces the multimode model to an effective two-mode problem. We apply this method to a multimode model describing broadband parametric down-conversion, thereby improving the analysis of existing experimental results. The main improvement is that spatial and frequency filters before the photon detector are taken into account explicitly. We find excellent agreement with previously published experimental results, using fewer free parameters than before, and discuss the implications of our analysis for the optimized production of states with negative Wigner functions.

Multimodal coaching and its application to workplace, life and health coaching

Directory of Open Access Journals (Sweden)

Stephen Palmer

2012-10-01

Full Text Available This article highlights how the multimodal approach (Lazarus, 1989 has been adapted to the field of coachingand coaching psychology. It covers the basic theories underpinning the multimodal approach and illustratesthe link between the theory and practice. Key multimodal strategies are covered including modalityprofiles, structural profiles, tracking and bridging.

Experiencia de enseñanza multimodal en una clase de idiomas [Experience of multimodal teaching in a language classroom

Directory of Open Access Journals (Sweden)

María Martínez Lirola

2013-12-01

Full Text Available Resumen: Nuestra sociedad es cada vez más tecnológica y multimodal por lo que es necesario que la enseñanza se adapte a los nuevos tiempos. Este artículo analiza el modo en que la asignatura Lengua Inglesa IV de la Licenciatura en Filología Inglesa en la Universidad de Alicante combina el desarrollo de las cinco destrezas (escucha, habla, lectura, escritura e interacción evaluadas por medio de un portafolio con la multimodalidad en las prácticas docentes y en cada una de las actividades que componen el portafolio. Los resultados de una encuesta preparada al final del curso académico 2011-2012 ponen de manifiesto las competencias principales que el alumnado universitario desarrolla gracias a la docencia multimodal y la importancia de las tutorías en este tipo de enseñanza. Abstract: Our society becomes more technological and multimodal and, consequently, teaching has to be adapted to the new time. This article analyses the way in which the subject English Language IV of the degree English Studies at the University of Alicante combines the development of the five skills (listening, speaking, reading, writing and interacting evaluated through a portfolio with multimodality in the teaching practices and in each of the activities that are part of the portfolio. The results of a survey prepared at the end of the academic year 2011-2012 point out the main competences that university students develop thanks to multimodal teaching and the importance of tutorials in this kind of teaching.

Multimodality

DEFF Research Database (Denmark)

Buhl, Mie

In this paper, I address an ongoing discussion in Danish E-learning research about how to take advantage of the fact that digital media facilitate other communication forms than text, so-called ‘multimodal’ communication, which should not be confused with the term ‘multimedia’. While multimedia...... and learning situations. The choices they make involve E-learning resources like videos, social platforms and mobile devices, not just as digital artefacts we interact with, but the entire practice of using digital media. In a life-long learning perspective, multimodality is potentially very useful...

Multimodal freight investment criteria.

Science.gov (United States)

2010-07-01

Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

Multimodal follow-up questions to multimodal answers in a QA system

NARCIS (Netherlands)

van Schooten, B.W.; op den Akker, Hendrikus J.A.

2007-01-01

We are developing a dialogue manager (DM) for a multimodal interactive Question Answering (QA) system. Our QA system presents answers using text and pictures, and the user may pose follow-up questions using text or speech, while indicating screen elements with the mouse. We developed a corpus of

Reliability-Based Decision Fusion in Multimodal Biometric Verification Systems

Directory of Open Access Journals (Sweden)

Kryszczuk Krzysztof

2007-01-01

Full Text Available We present a methodology of reliability estimation in the multimodal biometric verification scenario. Reliability estimation has shown to be an efficient and accurate way of predicting and correcting erroneous classification decisions in both unimodal (speech, face, online signature and multimodal (speech and face systems. While the initial research results indicate the high potential of the proposed methodology, the performance of the reliability estimation in a multimodal setting has not been sufficiently studied or evaluated. In this paper, we demonstrate the advantages of using the unimodal reliability information in order to perform an efficient biometric fusion of two modalities. We further show the presented method to be superior to state-of-the-art multimodal decision-level fusion schemes. The experimental evaluation presented in this paper is based on the popular benchmarking bimodal BANCA database.

Teleportation of continuous variable multimode Greeberger-Horne-Zeilinger entangled states

International Nuclear Information System (INIS)

He Guangqiang; Zhang Jingtao; Zeng Guihua

2008-01-01

Quantum teleportation protocols of continuous variable (CV) Greeberger-Horne-Zeilinger (GHZ) and Einstein-Podolsky-Rosen (EPR) entangled states are proposed, and are generalized to teleportation of arbitrary multimode GHZ entangled states described by Van Loock and Braunstein (2000 Phys. Rev. Lett. 84 3482). Each mode of a multimode entangled state is teleported using a CV EPR entangled pair and classical communication. The analytical expression of fidelity for the multimode Gaussian states which evaluates the teleportation quality is presented. The analytical results show that the fidelity is a function of both the squeezing parameter r, which characterizes the multimode entangled state to be teleported, and the channel parameter p, which characterizes the EPR pairs shared by Alice and Bob. The fidelity increases with increasing p, but decreases with increasing r, i.e., it is more difficult to teleport the more perfect multimode entangled states. The entanglement degree of the teleported multimode entangled states increases with increasing both r and p. In addition, the fact is proved that our teleportation protocol of EPR entangled states using parallel EPR pairs as quantum channels is the best case of the protocol using four-mode entangled states (Adhikari et al 2008 Phys. Rev. A 77 012337).

Multimodal surveillance sensors, algorithms, and systems

CERN Document Server

Zhu, Zhigang

2007-01-01

From front-end sensors to systems and environmental issues, this practical resource guides you through the many facets of multimodal surveillance. The book examines thermal, vibration, video, and audio sensors in a broad context of civilian and military applications. This cutting-edge volume provides an in-depth treatment of data fusion algorithms that takes you to the core of multimodal surveillance, biometrics, and sentient computing. The book discusses such people and activity topics as tracking people and vehicles and identifying individuals by their speech.Systems designers benefit from d

Multimode waveguide speckle patterns for compressive sensing.

Science.gov (United States)

Valley, George C; Sefler, George A; Justin Shaw, T

2016-06-01

Compressive sensing (CS) of sparse gigahertz-band RF signals using microwave photonics may achieve better performances with smaller size, weight, and power than electronic CS or conventional Nyquist rate sampling. The critical element in a CS system is the device that produces the CS measurement matrix (MM). We show that passive speckle patterns in multimode waveguides potentially provide excellent MMs for CS. We measure and calculate the MM for a multimode fiber and perform simulations using this MM in a CS system. We show that the speckle MM exhibits the sharp phase transition and coherence properties needed for CS and that these properties are similar to those of a sub-Gaussian MM with the same mean and standard deviation. We calculate the MM for a multimode planar waveguide and find dimensions of the planar guide that give a speckle MM with a performance similar to that of the multimode fiber. The CS simulations show that all measured and calculated speckle MMs exhibit a robust performance with equal amplitude signals that are sparse in time, in frequency, and in wavelets (Haar wavelet transform). The planar waveguide results indicate a path to a microwave photonic integrated circuit for measuring sparse gigahertz-band RF signals using CS.

Development of a Framework for Multimodal Research: Creation of a Bibliographic Database

National Research Council Canada - National Science Library

Coovert, Michael D; Gray, Ashley A; Elliott, Linda R; Redden, Elizabeth S

2007-01-01

.... The results of the overall effort, the multimodal framework and article tracking sheet, bibliographic database, and searchable multimodal database make substantial and valuable contributions to the accumulation and interpretation of multimodal research. References collected in this effort are listed in the appendix.

Multimodal aspects of CSR communication related to gender empowerment and environmental protection

DEFF Research Database (Denmark)

Maier, Carmen Daniela

Purpose – This paper explores how the multimodal persuasive strategies of CSR communication related to Coca-Cola’s “5 by 20” succeed to highlight the company’s continuous commitment to gender empowerment and environmental protection. Launched in 2010, “5 by 20” is a program designed to empower 5...... as the usual textual focus is extended to a multimodal one. Shedding light on how the multimodal interplay contributes to communicate corporate commitment to gender empowerment and environmental protection, this model can also be employed in order to explore multimodally other areas of CSR communication....... a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by the company in their CSR communication. The paper is focused on the analysis of the video series that can be accessed at: http://www.coca-colacompany.com/stories/5by20. Based on a social...

Mode-multiplexed transmission over conventional graded-index multimode fibers

NARCIS (Netherlands)

Ryf, R.; Fontaine, N.K.; Chen, H.; Guan, B.; Huang, B.; Esmaeelpour, M.; Gnauck, A.H.; Randel, S.; Yoo, S.J.B.; Koonen, A.M.J.; Shubochkin, R.; Sun, Yi; Lingle, R.

2015-01-01

We present experimental results for combined mode-multiplexed and wavelength multiplexed transmission over conventional graded-index multimode fibers. We use mode-selective photonic lanterns as mode couplers to precisely excite a subset of the modes of the multimode fiber and additionally to

A Multimodal Database for Affect Recognition and Implicit Tagging

NARCIS (Netherlands)

Soleymani, Mohammad; Lichtenauer, Jeroen; Pun, Thierry; Pantic, Maja

MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research. A multimodal setup was arranged for synchronized recording of face videos, audio signals, eye gaze data, and peripheral/central nervous system

Quantifying Quality Aspects of Multimodal Interactive Systems

CERN Document Server

Kühnel, Christine

2012-01-01

This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.

Gastric Adenocarcinoma: A Multimodal Approach

Directory of Open Access Journals (Sweden)

Humair S. Quadri

2017-08-01

Full Text Available Despite its declining incidence, gastric cancer (GC remains a leading cause of cancer-related deaths worldwide. A multimodal approach to GC is critical to ensure optimal patient outcomes. Pretherapy fine resolution contrast-enhanced cross-sectional imaging, endoscopic ultrasound and staging laparoscopy play an important role in patients with newly diagnosed ostensibly operable GC to avoid unnecessary non-therapeutic laparotomies. Currently, margin negative gastrectomy and adequate lymphadenectomy performed at high volume hospitals remain the backbone of GC treatment. Importantly, adequate GC surgery should be integrated in the setting of a multimodal treatment approach. Treatment for advanced GC continues to expand with the emergence of additional lines of systemic and targeted therapies.

Multimodal Estimation of Distribution Algorithms.

Science.gov (United States)

Yang, Qiang; Chen, Wei-Neng; Li, Yun; Chen, C L Philip; Xu, Xiang-Min; Zhang, Jun

2016-02-15

Taking the advantage of estimation of distribution algorithms (EDAs) in preserving high diversity, this paper proposes a multimodal EDA. Integrated with clustering strategies for crowding and speciation, two versions of this algorithm are developed, which operate at the niche level. Then these two algorithms are equipped with three distinctive techniques: 1) a dynamic cluster sizing strategy; 2) an alternative utilization of Gaussian and Cauchy distributions to generate offspring; and 3) an adaptive local search. The dynamic cluster sizing affords a potential balance between exploration and exploitation and reduces the sensitivity to the cluster size in the niching methods. Taking advantages of Gaussian and Cauchy distributions, we generate the offspring at the niche level through alternatively using these two distributions. Such utilization can also potentially offer a balance between exploration and exploitation. Further, solution accuracy is enhanced through a new local search scheme probabilistically conducted around seeds of niches with probabilities determined self-adaptively according to fitness values of these seeds. Extensive experiments conducted on 20 benchmark multimodal problems confirm that both algorithms can achieve competitive performance compared with several state-of-the-art multimodal algorithms, which is supported by nonparametric tests. Especially, the proposed algorithms are very promising for complex problems with many local optima.

Ultraviolet signals in birds are special.

Science.gov (United States)

Hausmann, Franziska; Arnold, Kathryn E; Marshall, N Justin; Owens, Ian P F

2003-01-07

Recent behavioural experiments have shown that birds use ultraviolet (UV)-reflective and fluorescent plumage as cues in mate choice. It remains controversial, however, whether such UV signals play a special role in sexual communication, or whether they are part of general plumage coloration. We use a comparative approach to test for a general association between sexual signalling and either UV-reflective or fluorescent plumage. Among the species surveyed, 72% have UV colours and there is a significant positive association between UV reflectance and courtship displays. Among parrots (Psittaciformes), 68% of surveyed species have fluorescent plumage, and again there is a strong positive association between courtship displays and fluorescence. These associations are not artefacts of the plumage used in courtship displays, being generally more 'colourful' because there is no association between display and colours lacking UV reflectance or fluorescence. Equally, these associations are not phylogenetic artefacts because all results remain unchanged when families or genera, rather than species, are used as independent data points. We also find that, in parrots, fluorescent plumage is usually found adjacent to UV-reflective plumage. Using a simple visual model to examine one parrot, the budgerigar Melopsittacus undulatus, we show that the juxtaposition of UV-reflective and fluorescent plumage leads to a 25-fold increase in chromatic contrast to the budgerigar's visual system. Taken together, these results suggest that signals based on UV contrast are of special importance in the context of active sexual displays. We review briefly six hypotheses on why this may be the case: suitability for short-range signalling; high contrast with backgrounds; invisibility to predators; exploitation of pre-existing sensory biases; advertisement of feather structure; and amplification of behavioural signals.

Player/Avatar Body Relations in Multimodal Augmented Reality Games

NARCIS (Netherlands)

Rosa, N.E.

2016-01-01

Augmented reality research is finally moving towards multimodal experiences: more and more applications do not only include visuals, but also audio and even haptics. The purpose of multimodality in these applications can be to increase realism or to increase the amount or quality of communicated

Composition at Washington State University: Building a Multimodal Bricolage

Science.gov (United States)

Ericsson, Patricia; Hunter, Leeann Downing; Macklin, Tialitha Michelle; Edwards, Elizabeth Sue

2016-01-01

Multimodal pedagogy is increasingly accepted among composition scholars. However, putting such pedagogy into practice presents significant challenges. In this profile of Washington State University's first-year composition program, we suggest a multi-vocal and multi-theoretical approach to addressing the challenges of multimodal pedagogy. Patricia…

Multifuel multimodal network design; Projeto de redes multicombustiveis multimodal

Energy Technology Data Exchange (ETDEWEB)

Lage, Carolina; Dias, Gustavo; Bahiense, Laura; Ferreira Filho, Virgilio J.M. [Universidade Federal do Rio de Janeiro (UFRJ), RJ (Brazil). Coordenacao dos Programas de Pos-graduacao de Engenharia (COPPE). Programa de Engenharia de Producao

2008-07-01

The objective of the Multi commodity Multimodal Network Project is the development of modeling tools and methodologies for the optimal sizing of production networks and multimodal distribution of multiple fuel and its incomes, considering investments and transportation costs. Given the inherently non-linear combinatory nature of the problem, the resolution of real instances by the complete model, in an exact way, becomes computationally intractable. Thus, the strategy for resolution should contain a combination of exacts and heuristics methods, that must be applied to subdivisions of the original problem. This paper deals with one of these subdivisions, tackling the problem of modeling a network of pipelines in order to drain the production of ethanol away from the producing plants. The objective consists in defining the best network topology, minimizing investment and operational costs, and attending the total demand. In order to do that, the network was considered a tree, where the nodes are the center of producing regions and the edges are the pipelines, trough where the ethanol produced by plants must be drained away. The main objective also includes the decision over the optimal diameter of each pipeline and the optimal size of the bombs, in order to minimize the pumping costs. (author)

MULTIMODAL FEEDBACK PROVISION IN IMPROVING PRE-SERVICE TEACHERS’ COMPETENCE

Directory of Open Access Journals (Sweden)

Fazri Nur Yusuf

2017-09-01

Full Text Available Studies on potentials of feedback over English language teaching seem not to have not been well-revealed, including studies on the use of feedback to improve English pre-service teachers’ competence. The present study investigates to what extent a multimodal feedback can influence pre-service teachers’ teaching, and which teaching aspects are influenced. Twenty five pre-service teachers taking Microteaching Course served as respondents supervised by a course advisor. The data were collected by teacher observation in a rating-scale form, self-appraisal, and interviews. The data were analyzed by using correlated sample t-test and the eight teaching components proposed by Brown (2001. The results showed that after multimodal feedback provision, pre-service teachers indicated an improvement significantly in seven out of eight teaching aspects. The provision of multimodal feedback could improve their teaching competence on preparation, instructional objective elicitation, mastery of instructional materials, use of media, and classroom management, including classroom language. But, the results do not indicate that they perform well on reflection and follow-up due to some reasons. In addition, the results evince that multimodal feedback provision could improve pre-service teachers’ pedagogical competence when the multimodal feedback is integrated with content, interpersonal relationship, and management.

Multimode optical fiber

Science.gov (United States)

Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

2014-11-04

A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

Multimodal versus Unimodal Instruction in a Complex Learning Context.

Science.gov (United States)

Gellevij, Mark; van der Meij, Hans; de Jong, Ton; Pieters, Jules

2002-01-01

Compared multimodal instruction with text and pictures with unimodal text-only instruction as 44 college students used a visual or textual manual to learn a complex software application. Results initially support dual coding theory and indicate that multimodal instruction led to better performance than unimodal instruction. (SLD)

The Big Five: Addressing Recurrent Multimodal Learning Data Challenges

NARCIS (Netherlands)

Di Mitri, Daniele; Schneider, Jan; Specht, Marcus; Drachsler, Hendrik

2018-01-01

The analysis of multimodal data in learning is a growing field of research, which has led to the development of different analytics solutions. However, there is no standardised approach to handle multimodal data. In this paper, we describe and outline a solution for five recurrent challenges in

Facilitating Multiple Intelligences Through Multimodal Learning Analytics

Directory of Open Access Journals (Sweden)

Ayesha PERVEEN

2018-01-01

Full Text Available This paper develops a theoretical framework for employing learning analytics in online education to trace multiple learning variations of online students by considering their potential of being multiple intelligences based on Howard Gardner’s 1983 theory of multiple intelligences. The study first emphasizes the need to facilitate students as multiple intelligences by online education systems and then suggests a framework of the advanced form of learning analytics i.e., multimodal learning analytics for tracing and facilitating multiple intelligences while they are engaged in online ubiquitous learning. As multimodal learning analytics is still an evolving area, it poses many challenges for technologists, educationists as well as organizational managers. Learning analytics make machines meet humans, therefore, the educationists with an expertise in learning theories can help technologists devise latest technological methods for multimodal learning analytics and organizational managers can implement them for the improvement of online education. Therefore, a careful instructional design based on a deep understanding of students’ learning abilities, is required to develop teaching plans and technological possibilities for monitoring students’ learning paths. This is how learning analytics can help design an adaptive instructional design based on a quick analysis of the data gathered. Based on that analysis, the academicians can critically reflect upon the quick or delayed implementation of the existing instructional design based on students’ cognitive abilities or even about the single or double loop learning design. The researcher concludes that the online education is multimodal in nature, has the capacity to endorse multiliteracies and, therefore, multiple intelligences can be tracked and facilitated through multimodal learning analytics in an online mode. However, online teachers’ training both in technological implementations and

The Stability of Multi-modal Traffic Network

International Nuclear Information System (INIS)

Han Linghui; Sun Huijun; Zhu Chengjuan; Jia Bin; Wu Jianjun

2013-01-01

There is an explicit and implicit assumption in multimodal traffic equilibrium models, that is, if the equilibrium exists, then it will also occur. The assumption is very idealized; in fact, it may be shown that the quite contrary could happen, because in multimodal traffic network, especially in mixed traffic conditions the interaction among traffic modes is asymmetric and the asymmetric interaction may result in the instability of traffic system. In this paper, to study the stability of multimodal traffic system, we respectively present the travel cost function in mixed traffic conditions and in traffic network with dedicated bus lanes. Based on a day-to-day dynamical model, we study the evolution of daily route choice of travelers in multimodal traffic network using 10000 random initial values for different cases. From the results of simulation, it can be concluded that the asymmetric interaction between the cars and buses in mixed traffic conditions can lead the traffic system to instability when traffic demand is larger. We also study the effect of travelers' perception error on the stability of multimodal traffic network. Although the larger perception error can alleviate the effect of interaction between cars and buses and improve the stability of traffic system in mixed traffic conditions, the traffic system also become instable when the traffic demand is larger than a number. For all cases simulated in this study, with the same parameters, traffic system with dedicated bus lane has better stability for traffic demand than that in mixed traffic conditions. We also find that the network with dedicated bus lane has higher portion of travelers by bus than it of mixed traffic network. So it can be concluded that building dedicated bus lane can improve the stability of traffic system and attract more travelers to choose bus reducing the traffic congestion. (general)

Analyzing Multimode Wireless Sensor Networks Using the Network Calculus

Directory of Open Access Journals (Sweden)

Xi Jin

2015-01-01

Full Text Available The network calculus is a powerful tool to analyze the performance of wireless sensor networks. But the original network calculus can only model the single-mode wireless sensor network. In this paper, we combine the original network calculus with the multimode model to analyze the maximum delay bound of the flow of interest in the multimode wireless sensor network. There are two combined methods A-MM and N-MM. The method A-MM models the whole network as a multimode component, and the method N-MM models each node as a multimode component. We prove that the maximum delay bound computed by the method A-MM is tighter than or equal to that computed by the method N-MM. Experiments show that our proposed methods can significantly decrease the analytical delay bound comparing with the separate flow analysis method. For the large-scale wireless sensor network with 32 thousands of sensor nodes, our proposed methods can decrease about 70% of the analytical delay bound.

Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

Science.gov (United States)

Gao, Duyang; Yuan, Zhen

2017-01-01

Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

PET-MRI and multimodal cancer imaging

International Nuclear Information System (INIS)

Wang Taisong; Zhao Jinhua; Song Jianhua

2011-01-01

Multimodality imaging, specifically PET-CT, brought a new perspective into the fields of clinical imaging. Clinical cases have shown that PET-CT has great value in clinical diagnosis and experimental research. But PET-CT still bears some limitations. A major drawback is that CT provides only limited soft tissue contrast and exposes the patient to a significant radiation dose. MRI overcome these limitations, it has excellent soft tissue contrast, high temporal and spatial resolution and no radiation damage. Additionally, since MRI provides also functional information, PET-MRI will show a new direction of multimodality imaging in the future. (authors)

Multimodal training between agents

DEFF Research Database (Denmark)

Rehm, Matthias

2003-01-01

In the system Locator1, agents are treated as individual and autonomous subjects that are able to adapt to heterogenous user groups. Applying multimodal information from their surroundings (visual and linguistic), they acquire the necessary concepts for a successful interaction. This approach has...

A Multimodal Discourse Analysis of Tmall's Double Eleven Advertisement

Science.gov (United States)

Hu, Chunyu; Luo, Mengxi

2016-01-01

From the 1990s, the multimodal turn in discourse studies makes multimodal discourse analysis a popular topic in linguistics and communication studies. An important approach to applying Systemic Functional Linguistics to non-verbal modes is Visual Grammar initially proposed by Kress and van Leeuwen (1996). Considering that commercial advertisement…

Agrupador de imágenes multimodal no supervisado

OpenAIRE

Pérez Hernando, Jesús

2013-01-01

Trabajo Fin de Máster donde se implementa un método multimodal para la clasificación de imágenes sin etiquetar y sin intervención humana. Treball Fi de Màster on s'implementa un mètode multimodal per a la classificació d'imatges sense etiquetar i sense intervenció humana. Master thesis for the Computer Science Engineering program.

Multimodal news framing effects

NARCIS (Netherlands)

Powell, T.E.

2017-01-01

Visuals in news media play a vital role in framing citizens’ political preferences. Yet, compared to the written word, visual images are undervalued in political communication research. Using framing theory, this thesis redresses the balance by studying the combined, or multimodal, effects of visual

Object recognition through a multi-mode fiber

Science.gov (United States)

Takagi, Ryosuke; Horisaki, Ryoichi; Tanida, Jun

2017-04-01

We present a method of recognizing an object through a multi-mode fiber. A number of speckle patterns transmitted through a multi-mode fiber are provided to a classifier based on machine learning. We experimentally demonstrated binary classification of face and non-face targets based on the method. The measurement process of the experimental setup was random and nonlinear because a multi-mode fiber is a typical strongly scattering medium and any reference light was not used in our setup. Comparisons between three supervised learning methods, support vector machine, adaptive boosting, and neural network, are also provided. All of those learning methods achieved high accuracy rates at about 90% for the classification. The approach presented here can realize a compact and smart optical sensor. It is practically useful for medical applications, such as endoscopy. Also our study indicated a promising utilization of artificial intelligence, which has rapidly progressed, for reducing optical and computational costs in optical sensing systems.

The dynamics of multimodal integration: The averaging diffusion model.

Science.gov (United States)

Turner, Brandon M; Gao, Juan; Koenig, Scott; Palfy, Dylan; L McClelland, James

2017-12-01

We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects' data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.

Operative and economic evaluation of a 'Laser Printer Multimodality' System

International Nuclear Information System (INIS)

Battaglia, G.; Moscatelli, G.; Maroldi, R.; Chiesa, A.

1991-01-01

The increasing application of digital techniques to diagnostic imaging is causing significant changes in several related activities, such as a reproduction of digital images on film. In the Department of Diagnostic Imaging of the University of Brescia, about 70% of the whole of images are produced by digital techniques; at present, most of these images are reproduced on film with a Multimodality System interfacing CT, MR, DSA, and DR units with a single laser printer. Our analysis evaluates the operative and economics aspects of image reproduction, by comparing the 'single cassette' multiformat Camera and the Laser Printer Multimodality SAystem. Our results point out the advantages obtained by reproducing images with a Laser Printer Multimodality System: outstanding quality, reproduction of multiple originals, and marked reduction in the time needed for both image archiving and film handling. The Laser Printer Multimodality System allows over 5 hours/day to be saved -that is to say the working day of an operator, who can be thus shifted to other functions. The important economic aspect of the reproduction of digital images on film proves the Laser Printer Multimodality System to have some advantage over Cameras

Strategy development management of Multimodal Transport Network

Directory of Open Access Journals (Sweden)

Nesterova Natalia S.

2016-01-01

Full Text Available The article gives a brief overview of works on the development of transport infrastructure for multimodal transportation and integration of Russian transport system into the international transport corridors. The technology for control of the strategy, that changes shape and capacity of Multi-modal Transport Network (MTN, is considered as part of the methodology for designing and development of MTN. This technology allows to carry out strategic and operational management of the strategy implementation based on the use of the balanced scorecard.

Multimodal Behavior Therapy: Case Study of a High School Student.

Science.gov (United States)

Seligman, Linda

1981-01-01

A case study of a high school student concerned with weight problems illustrates multimodal behavior therapy and its use in a high school setting. Multimodal therapy allows the school counselor to maximize referral sources while emphasizing growth and actualization. (JAC)

Acting rehearsal in collaborative multimodal mixed reality environments

OpenAIRE

Steptoe, William; Normand, Jean-Marie; Oyekoya, Oyewole; Pece, Fabrizio; Giannopoulos, Elias; Tecchia, Franco; Steed, Anthony; Weyrich, Tim; Kautz, Jan; Slater, Mel

2012-01-01

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which sp...

MIDA - Optimizing control room performance through multi-modal design

International Nuclear Information System (INIS)

Ronan, A. M.

2006-01-01

Multi-modal interfaces can support the integration of humans with information processing systems and computational devices to maximize the unique qualities that comprise a complex system. In a dynamic environment, such as a nuclear power plant control room, multi-modal interfaces, if designed correctly, can provide complementary interaction between the human operator and the system which can improve overall performance while reducing human error. Developing such interfaces can be difficult for a designer without explicit knowledge of Human Factors Engineering principles. The Multi-modal Interface Design Advisor (MIDA) was developed as a support tool for system designers and developers. It provides design recommendations based upon a combination of Human Factors principles, a knowledge base of historical research, and current interface technologies. MIDA's primary objective is to optimize available multi-modal technologies within a human computer interface in order to balance operator workload with efficient operator performance. The purpose of this paper is to demonstrate MIDA and illustrate its value as a design evaluation tool within the nuclear power industry. (authors)

[Multimodal pain therapy - implementation of process management - an attempt to consider management approaches].

Science.gov (United States)

Dunkel, Marion; Kramp, Melanie

2012-07-01

The combination of medical and economical proceedings allows new perspectives in the illustration of medical workflows. Considering structural and developmental aspects multimodal therapy programs show similarities with typical subjects of economic process systems. By pointing out the strategic appearance of the multimodal pain therapy concept multimodal approaches can be described to some extent by using management approaches. E. g., an economic process landscape can be used to represent procedures of a multimodal pain therapy program. © Georg Thieme Verlag Stuttgart · New York.

Pattern recognition of neurotransmitters using multimode sensing.

Science.gov (United States)

Stefan-van Staden, Raluca-Ioana; Moldoveanu, Iuliana; van Staden, Jacobus Frederick

2014-05-30

Pattern recognition is essential in chemical analysis of biological fluids. Reliable and sensitive methods for neurotransmitters analysis are needed. Therefore, we developed for pattern recognition of neurotransmitters: dopamine, epinephrine, norepinephrine a method based on multimode sensing. Multimode sensing was performed using microsensors based on diamond paste modified with 5,10,15,20-tetraphenyl-21H,23H-porphyrine, hemin and protoporphyrin IX in stochastic and differential pulse voltammetry modes. Optimized working conditions: phosphate buffer solution of pH 3.01 and KCl 0.1mol/L (as electrolyte support), were determined using cyclic voltammetry and used in all measurements. The lowest limits of quantification were: 10(-10)mol/L for dopamine and epinephrine, and 10(-11)mol/L for norepinephrine. The multimode microsensors were selective over ascorbic and uric acids and the method facilitated reliable assay of neurotransmitters in urine samples, and therefore, the pattern recognition showed high reliability (RSDneurotransmitters on biological fluids at a lower determination level than chromatographic methods. The sampling of the biological fluids referees only to the buffering (1:1, v/v) with a phosphate buffer pH 3.01, while for chromatographic methods the sampling is laborious. Accordingly with the statistic evaluation of the results at 99.00% confidence level, both modes can be used for pattern recognition and quantification of neurotransmitters with high reliability. The best multimode microsensor was the one based on diamond paste modified with protoporphyrin IX. Copyright © 2014 Elsevier B.V. All rights reserved.

Content-based TV sports video retrieval using multimodal analysis

Science.gov (United States)

Yu, Yiqing; Liu, Huayong; Wang, Hongbin; Zhou, Dongru

2003-09-01

In this paper, we propose content-based video retrieval, which is a kind of retrieval by its semantical contents. Because video data is composed of multimodal information streams such as video, auditory and textual streams, we describe a strategy of using multimodal analysis for automatic parsing sports video. The paper first defines the basic structure of sports video database system, and then introduces a new approach that integrates visual stream analysis, speech recognition, speech signal processing and text extraction to realize video retrieval. The experimental results for TV sports video of football games indicate that the multimodal analysis is effective for video retrieval by quickly browsing tree-like video clips or inputting keywords within predefined domain.

Validation of a multimodal travel simulator with travel information provision

NARCIS (Netherlands)

Chorus, C.G.; Molin, E.J.E.; Arentze, T.A.; Hoogendoorn, S.P.; Timmermans, H.J.P.; Wee, van G.P.

2007-01-01

This paper presents a computer based travel simulator for collecting data concerning the use of next-generation ATIS and their effects on traveler decision making in a multimodal travel environment. The tool distinguishes itself by presenting a completely abstract multimodal transport network, where

Joint sparse representation for robust multimodal biometrics recognition.

Science.gov (United States)

Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

2014-01-01

Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

OSM-ORIENTED METHOD OF MULTIMODAL ROUTE PLANNING

Directory of Open Access Journals (Sweden)

X. Li

2015-07-01

Full Text Available With the increasing pervasiveness of basic facilitate of transportation and information, the need of multimodal route planning is becoming more essential in the fields of communication and transportation, urban planning, logistics management, etc. This article mainly described an OSM-oriented method of multimodal route planning. Firstly, it introduced how to extract the information we need from OSM data and build proper network model and storage model; then it analysed the accustomed cost standard adopted by most travellers; finally, we used shortest path algorithm to calculate the best route with multiple traffic means.

An atlas-based multimodal registration method for 2D images with discrepancy structures.

Science.gov (United States)

Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

2018-06-04

An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

A new piezoelectric energy harvesting design concept: multimodal energy harvesting skin.

Science.gov (United States)

Lee, Soobum; Youn, Byeng D

2011-03-01

This paper presents an advanced design concept for a piezoelectric energy harvesting (EH), referred to as multimodal EH skin. This EH design facilitates the use of multimodal vibration and enhances power harvesting efficiency. The multimodal EH skin is an extension of our previous work, EH skin, which was an innovative design paradigm for a piezoelectric energy harvester: a vibrating skin structure and an additional thin piezoelectric layer in one device. A computational (finite element) model of the multilayered assembly - the vibrating skin structure and piezoelectric layer - is constructed and the optimal topology and/or shape of the piezoelectric layer is found for maximum power generation from multiple vibration modes. A design rationale for the multimodal EH skin was proposed: designing a piezoelectric material distribution and external resistors. In the material design step, the piezoelectric material is segmented by inflection lines from multiple vibration modes of interests to minimize voltage cancellation. The inflection lines are detected using the voltage phase. In the external resistor design step, the resistor values are found for each segment to maximize power output. The presented design concept, which can be applied to any engineering system with multimodal harmonic-vibrating skins, was applied to two case studies: an aircraft skin and a power transformer panel. The excellent performance of multimodal EH skin was demonstrated, showing larger power generation than EH skin without segmentation or unimodal EH skin.

Multimodal Observation and Classification of People Engaged in Problem Solving: Application to Chess Players

Directory of Open Access Journals (Sweden)

Thomas Guntz

2018-03-01

Full Text Available In this paper we present the first results of a pilot experiment in the interpretation of multimodal observations of human experts engaged in solving challenging chess problems. Our goal is to investigate the extent to which observations of eye-gaze, posture, emotion and other physiological signals can be used to model the cognitive state of subjects, and to explore the integration of multiple sensor modalities to improve the reliability of detection of human displays of awareness and emotion. Domains of application for such cognitive model based systems are, for instance, healthy autonomous ageing or automated training systems. Abilities to observe cognitive abilities and emotional reactions can allow artificial systems to provide appropriate assistance in such contexts. We observed chess players engaged in problems of increasing difficulty while recording their behavior. Such recordings can be used to estimate a participant’s awareness of the current situation and to predict ability to respond effectively to challenging situations. Feature selection has been performed to construct a multimodal classifier relying on the most relevant features from each modality. Initial results indicate that eye-gaze, body posture and emotion are good features to capture such awareness. This experiment also validates the use of our equipment as a general and reproducible tool for the study of participants engaged in screen-based interaction and/or problem solving.

Increased discriminability of authenticity from multimodal laughter is driven by auditory information.

Science.gov (United States)

Lavan, Nadine; McGettigan, Carolyn

2017-10-01

We present an investigation of the perception of authenticity in audiovisual laughter, in which we contrast spontaneous and volitional samples and examine the contributions of unimodal affective information to multimodal percepts. In a pilot study, we demonstrate that listeners perceive spontaneous laughs as more authentic than volitional ones, both in unimodal (audio-only, visual-only) and multimodal contexts (audiovisual). In the main experiment, we show that the discriminability of volitional and spontaneous laughter is enhanced for multimodal laughter. Analyses of relationships between affective ratings and the perception of authenticity show that, while both unimodal percepts significantly predict evaluations of audiovisual laughter, it is auditory affective cues that have the greater influence on multimodal percepts. We discuss differences and potential mismatches in emotion signalling through voices and faces, in the context of spontaneous and volitional behaviour, and highlight issues that should be addressed in future studies of dynamic multimodal emotion processing.

Interactivity in Educational Apps for Young Children: A Multimodal Analysis

Science.gov (United States)

Blitz-Raith, Alexandra H.; Liu, Jianxin

2017-01-01

Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm…

Multimodal Desktop Interaction: The Face –Object-Gesture–Voice Example

DEFF Research Database (Denmark)

Vidakis, Nikolas; Vlasopoulos, Anastasios; Kounalakis, Tsampikos

2013-01-01

This paper presents a natural user interface system based on multimodal human computer interaction, which operates as an intermediate module between the user and the operating system. The aim of this work is to demonstrate a multimodal system which gives users the ability to interact with desktop...

Applications of Elpasolites as a Multimode Radiation Sensor

Science.gov (United States)

Guckes, Amber

This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode

Multimodality imaging of the postoperative shoulder

Energy Technology Data Exchange (ETDEWEB)

Woertler, Klaus [Technische Universitaet Muenchen, Department of Radiology, Munich (Germany)

2007-12-15

Multimodality imaging of the postoperative shoulder includes radiography, magnetic resonance (MR) imaging, MR arthrography, computed tomography (CT), CT arthrography, and ultrasound. Target-oriented evaluation of the postoperative shoulder necessitates familiarity with surgical techniques, their typical complications and sources of failure, knowledge of normal and abnormal postoperative findings, awareness of the advantages and weaknesses with the different radiologic techniques, and clinical information on current symptoms and function. This article reviews the most commonly used surgical procedures for treatment of anterior glenohumeral instability, lesions of the labral-bicipital complex, subacromial impingement, and rotator cuff lesions and highlights the significance of imaging findings with a view to detection of recurrent lesions and postoperative complications in a multimodality approach. (orig.)

New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

Science.gov (United States)

Williams, Wendy R.

2014-01-01

This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

Multi-modal RGB–Depth–Thermal Human Body Segmentation

DEFF Research Database (Denmark)

Palmero, Cristina; Clapés, Albert; Bahnsen, Chris

2016-01-01

This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis. We propose a novel RGB-Depth-Thermal dataset along with a multi-modal seg- mentation baseline. The several modalities are registered us- ing a calibration...... to other state-of-the-art meth- ods, obtaining an overlap above 75% on the novel dataset when compared to the manually annotated ground-truth of human segmentations....

Multimodal Strategies of Theorization

DEFF Research Database (Denmark)

Cartel, Melodie; Colombero, Sylvain; Boxenbaum, Eva

This paper examines the role of multimodal strategies in processes of theorization. Empirically, we investigate the theorization process of a highly disruptive innovation in the history of architecture: reinforced concrete. Relying on archival data from a dominant French architectural journal from...... with well-known rhetorical strategies and develop a process model of theorization....

Covert Sexual Signaling: Human Flirtation and Implications for other Social Species

Directory of Open Access Journals (Sweden)

Andrew Gersick

2014-07-01

Full Text Available According to signaling theory and a large body of supporting evidence, males across many taxa produce courtship signals that honestly advertise their quality. The cost of producing or performing these signals maintains signal honesty, such that females are typically able to choose the best males by selecting those that produce the loudest, brightest, longest, or otherwise highest-intensity signals, using signal strength as a measure of quality. Set against this background, human flirting behavior, characterized by its frequent subtlety or covertness, is mysterious. Here we propose that the explanation for subtle and ambiguous signals in human courtship lies in socially imposed costs that (a vary with social context and (b are amplified by the unusual ways in which language makes all interactions potentially public. Flirting is a class of courtship signaling that conveys the signaler's intentions and desirability to the intended receiver while minimizing the costs that would accompany an overt courtship attempt. This proposal explains humans' taxonomically unusual courtship displays and generates a number of novel predictions for both humans and non-human social animals. Individuals who are courting should vary the intensity of their signals to suit the level of risk attached to the particular social configuration, and receivers may assess this flexible matching of signal to context as an indicator of the signaler's broader behavioral flexibility and social intelligence.

Quantitative multimodality imaging in cancer research and therapy.

Science.gov (United States)

Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

2014-11-01

Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

Toward multimodal signal detection of adverse drug reactions.

Science.gov (United States)

Harpaz, Rave; DuMouchel, William; Schuemie, Martijn; Bodenreider, Olivier; Friedman, Carol; Horvitz, Eric; Ripple, Anna; Sorbello, Alfred; White, Ryen W; Winnenburg, Rainer; Shah, Nigam H

2017-12-01

Improving mechanisms to detect adverse drug reactions (ADRs) is key to strengthening post-marketing drug safety surveillance. Signal detection is presently unimodal, relying on a single information source. Multimodal signal detection is based on jointly analyzing multiple information sources. Building on, and expanding the work done in prior studies, the aim of the article is to further research on multimodal signal detection, explore its potential benefits, and propose methods for its construction and evaluation. Four data sources are investigated; FDA's adverse event reporting system, insurance claims, the MEDLINE citation database, and the logs of major Web search engines. Published methods are used to generate and combine signals from each data source. Two distinct reference benchmarks corresponding to well-established and recently labeled ADRs respectively are used to evaluate the performance of multimodal signal detection in terms of area under the ROC curve (AUC) and lead-time-to-detection, with the latter relative to labeling revision dates. Limited to our reference benchmarks, multimodal signal detection provides AUC improvements ranging from 0.04 to 0.09 based on a widely used evaluation benchmark, and a comparative added lead-time of 7-22 months relative to labeling revision dates from a time-indexed benchmark. The results support the notion that utilizing and jointly analyzing multiple data sources may lead to improved signal detection. Given certain data and benchmark limitations, the early stage of development, and the complexity of ADRs, it is currently not possible to make definitive statements about the ultimate utility of the concept. Continued development of multimodal signal detection requires a deeper understanding the data sources used, additional benchmarks, and further research on methods to generate and synthesize signals. Copyright © 2017 Elsevier Inc. All rights reserved.

Multimodal treatment for unresectable pancreatic cancer

International Nuclear Information System (INIS)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori

1998-01-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Multimodal treatment for unresectable pancreatic cancer

Energy Technology Data Exchange (ETDEWEB)

Katayama, Kanji; Iida, Atsushi; Fujita, Takashi; Kobayashi, Taizo; Shinmoto, Syuichi; Hirose, Kazuo; Yamaguchi, Akio; Yoshida, Masanori [Fukui Medical School, Matsuoka (Japan)

1998-07-01

In order to improve in prognosis and quality of life (QOL), the multimodal treatment for unresectable pancreatic cancers were performed. Bypass surgery was carried out for unresectable pancreatic cancer with intraoperative irradiation (IOR). After surgery, patients were treated with the combination of CDDP (25 mg) and MMC (4 mg) administration, intravenously continuous injection of 5-FU (250 mg for 24 hours), external radiation by the high voltage X-ray (1.5 Gy per irradiation, 4 times a week, and during hyperthermia 3 Gy per irradiation) and hyperthermia using the Thermotron RF-8 warmer. Six out of 13 patients received hyperthermia at over 40degC, were obtained PR, and their survival periods were 22, 21, 19, 18, 11 and 8 months and they could return to work. For all patients with pain, the symptom was abolished or reduced. The survival periods in cases of the multimodal treatment were longer than those of only bypass-surgery or of the resective cases with the curability C. The multimodal treatment combined with radiation, hyperthermia and surgery is more useful for the removal of pain and the improvement of QOL, and also expected the improvement of the prognosis than pancreatectomy. And hyperthermia has an important role on the effect of this treatment. (K.H.)

Multimodal quantitative phase and fluorescence imaging of cell apoptosis

Science.gov (United States)

Fu, Xinye; Zuo, Chao; Yan, Hao

2017-06-01

Fluorescence microscopy, utilizing fluorescence labeling, has the capability to observe intercellular changes which transmitted and reflected light microscopy techniques cannot resolve. However, the parts without fluorescence labeling are not imaged. Hence, the processes simultaneously happen in these parts cannot be revealed. Meanwhile, fluorescence imaging is 2D imaging where information in the depth is missing. Therefore the information in labeling parts is also not complete. On the other hand, quantitative phase imaging is capable to image cells in 3D in real time through phase calculation. However, its resolution is limited by the optical diffraction and cannot observe intercellular changes below 200 nanometers. In this work, fluorescence imaging and quantitative phase imaging are combined to build a multimodal imaging system. Such system has the capability to simultaneously observe the detailed intercellular phenomenon and 3D cell morphology. In this study the proposed multimodal imaging system is used to observe the cell behavior in the cell apoptosis. The aim is to highlight the limitations of fluorescence microscopy and to point out the advantages of multimodal quantitative phase and fluorescence imaging. The proposed multimodal quantitative phase imaging could be further applied in cell related biomedical research, such as tumor.

Nucleophosmin integrates within the nucleolus via multi-modal interactions with proteins displaying R-rich linear motifs and rRNA.

Science.gov (United States)

Mitrea, Diana M; Cika, Jaclyn A; Guy, Clifford S; Ban, David; Banerjee, Priya R; Stanley, Christopher B; Nourse, Amanda; Deniz, Ashok A; Kriwacki, Richard W

2016-02-02

The nucleolus is a membrane-less organelle formed through liquid-liquid phase separation of its components from the surrounding nucleoplasm. Here, we show that nucleophosmin (NPM1) integrates within the nucleolus via a multi-modal mechanism involving multivalent interactions with proteins containing arginine-rich linear motifs (R-motifs) and ribosomal RNA (rRNA). Importantly, these R-motifs are found in canonical nucleolar localization signals. Based on a novel combination of biophysical approaches, we propose a model for the molecular organization within liquid-like droplets formed by the N-terminal domain of NPM1 and R-motif peptides, thus providing insights into the structural organization of the nucleolus. We identify multivalency of acidic tracts and folded nucleic acid binding domains, mediated by N-terminal domain oligomerization, as structural features required for phase separation of NPM1 with other nucleolar components in vitro and for localization within mammalian nucleoli. We propose that one mechanism of nucleolar localization involves phase separation of proteins within the nucleolus.

A multimodal image sensor system for identifying water stress in grapevines

Science.gov (United States)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

Cultural Shifts, Multimodal Representations, and Assessment Practices: A Case Study

Science.gov (United States)

Curwood, Jen Scott

2012-01-01

Multimodal texts involve the presence, absence, and co-occurrence of alphabetic text with visual, audio, tactile, gestural, and spatial representations. This article explores how teachers' evaluation of students' multimodal work can be understood in terms of cognition and culture. When teachers apply a paradigm of assessment rooted in print-based…

Multiscale climate emulator of multimodal wave spectra: MUSCLE-spectra

Science.gov (United States)

Rueda, Ana; Hegermiller, Christie A.; Antolinez, Jose A. A.; Camus, Paula; Vitousek, Sean; Ruggiero, Peter; Barnard, Patrick L.; Erikson, Li H.; Tomás, Antonio; Mendez, Fernando J.

2017-02-01

Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this complex problem tractable using computationally expensive numerical models. So far, the skill of statistical-downscaling model-based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

Science.gov (United States)

Scanlon, Molly J.

2015-01-01

Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

The semiotics of typography in literary texts. A multimodal approach

DEFF Research Database (Denmark)

Nørgaard, Nina

2009-01-01

to multimodal discourse proposed, for instance, by Kress & Van Leeuwen (2001) and Baldry & Thibault (2006), and, more specifically, the multimodal approach to typography suggested by Van Leeuwen (2005b; 2006), in order to sketch out a methodological framework applicable to the description and analysis...... of the semiotic potential of typography in literary texts....

A Multimodal Search Engine for Medical Imaging Studies.

Science.gov (United States)

Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

2017-02-01

The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

Multimodal designs for learning in contexts of diversity

Directory of Open Access Journals (Sweden)

Arlene Archer

2014-12-01

Full Text Available This paper aims to identify multimodal designs for learning in diverse and developing contexts, where access to resources remains vastly unequal. Using case studies from South African education, the paper explores ways of surfacing the range of students’ resources which are often not noticed or valued in formal educational settings. The studies showcased here demonstrate how ethnographic and textually-based approaches can be combined. Opening up the semiotic space of the classroom through multimodal designs for learning is important for finding innovative ways of addressing access, diversity, and past inequalities. This is of relevance not only to South Africa, but a range of global contexts. The paper argues that multimodal designs for learning can involve interrogating the relation between ‘tradition’ and ‘modernity’; harnessing students’ creative practices as resources for pedagogy; developing metalanguages for critical reflection; creating less regulated pedagogical spaces in order to enable useful teaching and learning practices.

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells; Estudo de internalizacao e viabilidade de nanoparticulas multimodal para marcacao de celulas-tronco mesenquimais de cordao umbilical humano

Energy Technology Data Exchange (ETDEWEB)

Miyaki, Liza Aya Mabuchi [Faculdade de Enfermagem, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil); Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel, E-mail: tatianats@einstein.br [Instituto do Cerebro - InCe, Hospital Israelita Albert Einstein - HIAE, Sao Paulo, SP (Brazil)

2012-04-15

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 {mu}g Fe/mL and 100{mu}g Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

Optical sensor in planar configuration based on multimode interference

Science.gov (United States)

Blahut, Marek

2017-08-01

In the paper a numerical analysis of optical sensors based on multimode interference in planar one-dimensional step-index configuration is presented. The structure consists in single-mode input and output waveguides and multimode waveguide which guide only few modes. Material parameters discussed refer to a SU8 polymer waveguide on SiO2 substrate. The optical system described will be designed to the analysis of biological substances.

Multimodality imaging of pulmonary infarction

International Nuclear Information System (INIS)

Bray, T.J.P.; Mortensen, K.H.; Gopalan, D.

2014-01-01

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis

Multimodality imaging of pulmonary infarction

Energy Technology Data Exchange (ETDEWEB)

Bray, T.J.P., E-mail: timothyjpbray@gmail.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); Mortensen, K.H., E-mail: mortensen@doctors.org.uk [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom); University Department of Radiology, Addenbrookes Hospital, Cambridge University Hospitals NHS Foundation Trust, Hills Road, Box 318, Cambridge CB2 0QQ (United Kingdom); Gopalan, D., E-mail: deepa.gopalan@btopenworld.com [Department of Radiology, Papworth Hospital NHS Foundation Trust, Ermine Street, Papworth Everard, Cambridge CB23 3RE (United Kingdom)

2014-12-15

Highlights: • A plethora of pulmonary and systemic disorders, often associated with grave outcomes, may cause pulmonary infarction. • A stereotypical infarct is a peripheral wedge shaped pleurally based opacity but imaging findings can be highly variable. • Multimodality imaging is key to diagnosing the presence, aetiology and complications of pulmonary infarction. • Multimodality imaging of pulmonary infarction together with any ancillary features often guide to early targeted treatment. • CT remains the principal imaging modality with MRI increasingly used alongside nuclear medicine studies and ultrasound. - Abstract: The impact of absent pulmonary arterial and venous flow on the pulmonary parenchyma depends on a host of factors. These include location of the occlusive insult, the speed at which the occlusion develops and the ability of the normal dual arterial supply to compensate through increased bronchial arterial flow. Pulmonary infarction occurs when oxygenation is cut off secondary to sudden occlusion with lack of recruitment of the dual supply arterial system. Thromboembolic disease is the commonest cause of such an insult but a whole range of disease processes intrinsic and extrinsic to the pulmonary arterial and venous lumen may also result in infarcts. Recognition of the presence of infarction can be challenging as imaging manifestations often differ from the classically described wedge shaped defect and a number of weighty causes need consideration. This review highlights aetiologies and imaging appearances of pulmonary infarction, utilising cases to illustrate the essential role of a multimodality imaging approach in order to arrive at the appropriate diagnosis.

Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

Science.gov (United States)

Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

2015-11-01

In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

Multimodal network design and assessment

NARCIS (Netherlands)

Brands, Ties; Alkim, T.P.; van Eck, Gijs; van Arem, Bart; Arentze, T.

2010-01-01

A framework is proposed for the design of an optimal multimodal transport network for the Randstad area. This research framework consists of a multi-objective optimization heuristic and a fast network assessment module, which results in a set of Pareto optimal solutions. Subsequently, a proper

Multimodal Hyper-connectivity Networks for MCI Classification.

Science.gov (United States)

Li, Yang; Gao, Xinqiang; Jie, Biao; Yap, Pew-Thian; Kim, Min-Jeong; Wee, Chong-Yaw; Shen, Dinggang

2017-09-01

Hyper-connectivity network is a network where every edge is connected to more than two nodes, and can be naturally denoted using a hyper-graph. Hyper-connectivity brain network, either based on structural or functional interactions among the brain regions, has been used for brain disease diagnosis. However, the conventional hyper-connectivity network is constructed solely based on single modality data, ignoring potential complementary information conveyed by other modalities. The integration of complementary information from multiple modalities has been shown to provide a more comprehensive representation about the brain disruptions. In this paper, a novel multimodal hyper-network modelling method was proposed for improving the diagnostic accuracy of mild cognitive impairment (MCI). Specifically, we first constructed a multimodal hyper-connectivity network by simultaneously considering information from diffusion tensor imaging and resting-state functional magnetic resonance imaging data. We then extracted different types of network features from the hyper-connectivity network, and further exploited a manifold regularized multi-task feature selection method to jointly select the most discriminative features. Our proposed multimodal hyper-connectivity network demonstrated a better MCI classification performance than the conventional single modality based hyper-connectivity networks.

Multimodal information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Displays

Science.gov (United States)

Begault, Durand R.; Bittner, Rachel M.; Anderson, Mark R.

2012-01-01

Auditory communication displays within the NextGen data link system may use multiple synthetic speech messages replacing traditional ATC and company communications. The design of an interface for selecting amongst multiple incoming messages can impact both performance (time to select, audit and release a message) and preference. Two design factors were evaluated: physical pressure-sensitive switches versus flat panel "virtual switches", and the presence or absence of auditory feedback from switch contact. Performance with stimuli using physical switches was 1.2 s faster than virtual switches (2.0 s vs. 3.2 s); auditory feedback provided a 0.54 s performance advantage (2.33 s vs. 2.87 s). There was no interaction between these variables. Preference data were highly correlated with performance.

Discrimination of skin diseases using the multimodal imaging approach

Science.gov (United States)

Vogler, N.; Heuke, S.; Akimov, D.; Latka, I.; Kluschke, F.; Röwert-Huber, H.-J.; Lademann, J.; Dietzek, B.; Popp, J.

2012-06-01

Optical microspectroscopic tools reveal great potential for dermatologic diagnostics in the clinical day-to-day routine. To enhance the diagnostic value of individual nonlinear optical imaging modalities such as coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) or two-photon excited fluorescence (TPF), the approach of multimodal imaging has recently been developed. Here, we present an application of nonlinear optical multimodal imaging with Raman-scattering microscopy to study sizable human-tissue cross-sections. The samples investigated contain both healthy tissue and various skin tumors. This contribution details the rich information content, which can be obtained from the multimodal approach: While CARS microscopy, which - in contrast to spontaneous Raman-scattering microscopy - is not hampered by single-photon excited fluorescence, is used to monitor the lipid and protein distribution in the samples, SHG imaging selectively highlights the distribution of collagen structures within the tissue. This is due to the fact, that SHG is only generated in structures which lack inversion geometry. Finally, TPF reveals the distribution of autofluorophores in tissue. The combination of these techniques, i.e. multimodal imaging, allows for recording chemical images of large area samples and is - as this contribution will highlight - of high clinically diagnostic value.

Cycling in multimodal transport behaviours: Exploring modality styles in the Danish population

DEFF Research Database (Denmark)

Olafsson, Anton Stahl; Nielsen, Thomas Alexander Sick; Carstensen, Trine Agervig

2016-01-01

and small towns. Thus, the way in which travel modes relate to the urban environment and variations in modality styles must serve as the starting point for policies aiming to fulfil the potential of multimodal transport behaviour and promote cycling. (C) 2016 Elsevier Ltd. All rights reserved....... explores how cycling forms part of multimodal transport behaviour based on survey data on transport modes and travel purposes and the weekly frequency of out-of-home activities and travel mode use in a representative sample of adult Danes (n = 1957). The following five distinct multimodal travel segments...... or 'modality styles' are identified: 'education transport'; 'public-based transport'; 'limited transport'; 'bicycle-based transport'; and 'car-based transport'. Travel behaviour is predominantly multimodal with few unimodal car-drivers being identified. Substantial cycling takes place in all modality styles...

Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

Directory of Open Access Journals (Sweden)

Shujie Deng

2014-10-01

Full Text Available The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.

Design, Performance and Optimization for Multimodal Radar Operation

Directory of Open Access Journals (Sweden)

Surendra S. Bhat

2012-09-01

Full Text Available This paper describes the underlying methodology behind an adaptive multimodal radar sensor that is capable of progressively optimizing its range resolution depending upon the target scattering features. It consists of a test-bed that enables the generation of linear frequency modulated waveforms of various bandwidths. This paper discusses a theoretical approach to optimizing the bandwidth used by the multimodal radar. It also discusses the various experimental results obtained from measurement. The resolution predicted from theory agrees quite well with that obtained from experiments for different target arrangements.

Spectral space-time coding for optical communications through a multimode fiber

NARCIS (Netherlands)

Alonso, A.; Berghmans, F.; Thienpont, H.; Danckaert, J.; Desmet, L.

2001-01-01

We propose a method for coding the mode structure of a multimode optical fiber by spectral coding mixed with space-time modulation. With this system we can improve the data carrying capacity of a multimode fiber for optical communications and optical interconnects, and encode and decode the

Semiconductor laser using multimode interference principle

Science.gov (United States)

Gong, Zisu; Yin, Rui; Ji, Wei; Wu, Chonghao

2018-01-01

Multimode interference (MMI) structure is introduced in semiconductor laser used in optical communication system to realize higher power and better temperature tolerance. Using beam propagation method (BPM), Multimode interference laser diode (MMI-LD) is designed and fabricated in InGaAsP/InP based material. As a comparison, conventional semiconductor laser using straight single-mode waveguide is also fabricated in the same wafer. With a low injection current (about 230 mA), the output power of the implemented MMI-LD is up to 2.296 mW which is about four times higher than the output power of the conventional semiconductor laser. The implemented MMI-LD exhibits stable output operating at the wavelength of 1.52 μm and better temperature tolerance when the temperature varies from 283.15 K to 293.15 K.

Dangerous mating systems: signal complexity, signal content and neural capacity in spiders.

Science.gov (United States)

Herberstein, M E; Wignall, A E; Hebets, E A; Schneider, J M

2014-10-01

Spiders are highly efficient predators in possession of exquisite sensory capacities for ambushing prey, combined with machinery for launching rapid and determined attacks. As a consequence, any sexually motivated approach carries a risk of ending up as prey rather than as a mate. Sexual selection has shaped courtship to effectively communicate the presence, identity, motivation and/or quality of potential mates, which help ameliorate these risks. Spiders communicate this information via several sensory channels, including mechanical (e.g. vibrational), visual and/or chemical, with examples of multimodal signalling beginning to emerge in the literature. The diverse environments that spiders inhabit have further shaped courtship content and form. While our understanding of spider neurobiology remains in its infancy, recent studies are highlighting the unique and considerable capacities of spiders to process and respond to complex sexual signals. As a result, the dangerous mating systems of spiders are providing important insights into how ecology shapes the evolution of communication systems, with future work offering the potential to link this complex communication with its neural processes. Copyright © 2014 Elsevier Ltd. All rights reserved.

Driver Education for New Multimodal Facilities

Science.gov (United States)

2016-05-24

Local and state transportation agencies are redesigning roads to accommodate multimodal travel, including the addition of new configurations, infrastructures, and rules that may be unfamiliar to current drivers and other road users. Education and out...

Multimodal Approach for Automatic Emotion Recognition Applied to the Tension Levels Study in TV Newscasts

Directory of Open Access Journals (Sweden)

Moisés Henrique Ramos Pereira

2015-12-01

Full Text Available This article addresses a multimodal approach to automatic emotion recognition in participants of TV newscasts (presenters, reporters, commentators and others able to assist the tension levels study in narratives of events in this television genre. The methodology applies state-of-the-art computational methods to process and analyze facial expressions, as well as speech signals. The proposed approach contributes to semiodiscoursive study of TV newscasts and their enunciative praxis, assisting, for example, the identification of the communication strategy of these programs. To evaluate the effectiveness of the proposed approach was applied it in a video related to a report displayed on a Brazilian TV newscast great popularity in the state of Minas Gerais. The experimental results are promising on the recognition of emotions on the facial expressions of tele journalists and are in accordance with the distribution of audiovisual indicators extracted over a TV newscast, demonstrating the potential of the approach to support the TV journalistic discourse analysis.This article addresses a multimodal approach to automatic emotion recognition in participants of TV newscasts (presenters, reporters, commentators and others able to assist the tension levels study in narratives of events in this television genre. The methodology applies state-of-the-art computational methods to process and analyze facial expressions, as well as speech signals. The proposed approach contributes to semiodiscoursive study of TV newscasts and their enunciative praxis, assisting, for example, the identification of the communication strategy of these programs. To evaluate the effectiveness of the proposed approach was applied it in a video related to a report displayed on a Brazilian TV newscast great popularity in the state of Minas Gerais. The experimental results are promising on the recognition of emotions on the facial expressions of tele journalists and are in accordance

Cryptic confounding compounds: A brief consideration of the influences of anthropogenic contaminants on courtship and mating behavior

Science.gov (United States)

Blocker, Tomica D.; Ophir, Alexander G.

2012-01-01

Contaminants, like pesticides, polychlorinated biphenyls (PCBs), dioxins and metals, are persistent and ubiquitous and are known to threaten the environment. Traditionally, scientists have considered the direct physiological risks that these contaminants pose. However, scientists have just begun to integrate ethology and toxicology to investigate the effects that contaminants have on behavior. This review considers the potential for contaminant effects on mating behavior. Here we assess the growing body of research concerning disruptions in sexual differentiation, courtship, sexual receptivity, arousal, and mating. We discuss the implications of these disruptions on conservation efforts and highlight the importance of recognizing the potential for environmental stressors to affect behavioral experimentation. More specifically, we consider the negative implications for anthropogenic contaminants to affect the immediate behavior of animals, and their potential to have cascading and/or long-term effects on the behavioral ecology and evolution of populations. Overall, we aim to raise awareness of the confounding influence that contaminants can have, and promote caution when interpreting results where the potential for cryptic affects are possible. PMID:24244068

Multimode-singlemode-multimode optical fiber sensor coated with novolac resin for detecting liquid phase alcohol

Science.gov (United States)

Marfu'ah, Amalia, Niza Rosyda; Hatta, Agus Muhamad; Pratama, Detak Yan

2018-04-01

Alcohol sensor based on multimode-singlemode-multimode (MSM) optical fiber with novolac resin as the external medium is proposed and demonstrated experimentally. Novolac resin swells when it is exposed by the alcohol. This effect causes a change in the polymer density leading to the refractive index's variation. The transmission light of the sensor depends on the refractive index of external medium. Based on the results, alcohol sensor based on MSM optical fiber structure using novolac resin has a higher sensitivity compared to the sensor without using novolac resin in the mixture of alcohol and distilled water. Alcohol sensor based on MSM optical fiber structure using novolac resin in the mixture of alcohol and distilled water with a singlemode fiber length of 5 mm has a sensitivity of 0.028972 dBm per % V/V, and in the mixture of alcohol and sugar solution of 10% w/w has a sensitivity of 0.005005 dBm per % V/V.

High-resolution multimodal clinical multiphoton tomography of skin

Science.gov (United States)

König, Karsten

2011-03-01

This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

Modelling multimodal expression of emotion in a virtual agent.

Science.gov (United States)

Pelachaud, Catherine

2009-12-12

Over the past few years we have been developing an expressive embodied conversational agent system. In particular, we have developed a model of multimodal behaviours that includes dynamism and complex facial expressions. The first feature refers to the qualitative execution of behaviours. Our model is based on perceptual studies and encompasses several parameters that modulate multimodal behaviours. The second feature, the model of complex expressions, follows a componential approach where a new expression is obtained by combining facial areas of other expressions. Lately we have been working on adding temporal dynamism to expressions. So far they have been designed statically, typically at their apex. Only full-blown expressions could be modelled. To overcome this limitation, we have defined a representation scheme that describes the temporal evolution of the expression of an emotion. It is no longer represented by a static definition but by a temporally ordered sequence of multimodal signals.

[Multimodal medical image registration using cubic spline interpolation method].

Science.gov (United States)

He, Yuanlie; Tian, Lianfang; Chen, Ping; Wang, Lifei; Ye, Guangchun; Mao, Zongyuan

2007-12-01

Based on the characteristic of the PET-CT multimodal image series, a novel image registration and fusion method is proposed, in which the cubic spline interpolation method is applied to realize the interpolation of PET-CT image series, then registration is carried out by using mutual information algorithm and finally the improved principal component analysis method is used for the fusion of PET-CT multimodal images to enhance the visual effect of PET image, thus satisfied registration and fusion results are obtained. The cubic spline interpolation method is used for reconstruction to restore the missed information between image slices, which can compensate for the shortage of previous registration methods, improve the accuracy of the registration, and make the fused multimodal images more similar to the real image. Finally, the cubic spline interpolation method has been successfully applied in developing 3D-CRT (3D Conformal Radiation Therapy) system.

Study on multimodal transport route under low carbon background

Science.gov (United States)

Liu, Lele; Liu, Jie

2018-06-01

Low-carbon environmental protection is the focus of attention around the world, scientists are constantly researching on production of carbon emissions and living carbon emissions. However, there is little literature about multimodal transportation based on carbon emission at home and abroad. Firstly, this paper introduces the theory of multimodal transportation, the multimodal transport models that didn't consider carbon emissions and consider carbon emissions are analyzed. On this basis, a multi-objective programming 0-1 programming model with minimum total transportation cost and minimum total carbon emission is proposed. The idea of weight is applied to Ideal point method for solving problem, multi-objective programming is transformed into a single objective function. The optimal solution of carbon emission to transportation cost under different weights is determined by a single objective function with variable weights. Based on the model and algorithm, an example is given and the results are analyzed.

Interactivity in Educational Apps for Young children: A Multimodal Analysis

Directory of Open Access Journals (Sweden)

Alexandra H. Blitz-Raith

2017-11-01

Full Text Available Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm construct and user feedback rather than on multimodal interactions, especially from a social semiotics perspective. Drawing from social semiotics approaches, this article proposes a multimodal analytic framework to examine three layers of mode in engendering interaction; namely, multiplicity, function, and relationship. Using the analytic framework in an analysis of The Farm Adventure for Kids, a popular educational app for pre-school children, we found that still images are dominant proportionally and are central in the interactive process. We also found that tapping still images of animals on screen is the main action, with other screen actions deliberately excluded. Such findings suggest that aligning children’s cognitive and physical capabilities to the use of mode become the primary consideration in educational app design and that consistent attendance to this alignment in mobilizing modes significantly affect an educational app’s interactivity, and consequently its reception by young children

MODELING PARTICLE SIZE DISTRIBUTION IN HETEROGENEOUS POLYMERIZATION SYSTEMS USING MULTIMODAL LOGNORMAL FUNCTION

Directory of Open Access Journals (Sweden)

J. C. Ferrari

Full Text Available Abstract This work evaluates the usage of the multimodal lognormal function to describe Particle Size Distributions (PSD of emulsion and suspension polymerization processes, including continuous reactions with particle re-nucleation leading to complex multimodal PSDs. A global optimization algorithm, namely Particle Swarm Optimization (PSO, was used for parameter estimation of the proposed model, minimizing the objective function defined by the mean squared errors. Statistical evaluation of the results indicated that the multimodal lognormal function could describe distinctive features of different types of PSDs with accuracy and consistency.

An evaluation framework for multimodal interaction determining quality aspects and modality choice

CERN Document Server

Wechsung, Ina

2014-01-01

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

On the effects of multimodal information integration in multitasking.

Science.gov (United States)

Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

2017-07-07

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

EXPLICITATION AND ADDITION TECHNIQUES IN AUDIOVISUAL TRANSLATION: A MULTIMODAL APPROACH OF ENGLISHINDONESIAN SUBTITLES

Directory of Open Access Journals (Sweden)

Ichwan Suyudi

2017-12-01

Full Text Available In audiovisual translation, the multimodality of the audiovisual text is both a challenge and a resource for subtitlers. This paper illustrates how multi-modes provide information that helps subtitlers to gain a better understanding of meaning-making practices that will influence them to make a decision-making in translating a certain verbal text. Subtitlers may explicit, add, and condense the texts based on the multi-modes as seen on the visual frames. Subtitlers have to consider the distribution and integration of the meanings of multi-modes in order to create comprehensive equivalence between the source and target texts. Excerpts of visual frames in this paper are taken from English films Forrest Gump (drama, 1996, and James Bond (thriller, 2010.

Multimodal Representations: A Fifth-Grade Teacher Influences Students' Design and Production

Science.gov (United States)

Shanahan, Lynn E.

2013-01-01

The purpose of this interpretive case study is to explore--through a close analysis of one fifth-grade class project--teacher's scaffolding and students' use of visual and linguistic modes when composing multimodally. Using Kress and van Leeuwen's multimodal theory of communication as a framework, this case study examines why teachers, whose…

Study of internalization and viability of multimodal nanoparticles for labeling of human umbilical cord mesenchymal stem cells

International Nuclear Information System (INIS)

Miyaki, Liza Aya Mabuchi; Sibov, Tatiana Tais; Pavon, Lorena Favaro; Mamani, Javier Bustamante; Gamarra, Lionel Fernel

2012-01-01

Objective: To analyze multimodal magnetic nanoparticles-Rhodamine B in culture media for cell labeling, and to establish a study of multimodal magnetic nanoparticles-Rhodamine B detection at labeled cells evaluating they viability at concentrations of 10 μg Fe/mL and 100μg Fe/mL. Methods: We performed the analysis of stability of multimodal magnetic nanoparticles-Rhodamine B in different culture media; the mesenchymal stem cells labeling with multimodal magnetic nanoparticles-Rhodamine B; the intracellular detection of multimodal magnetic nanoparticles-Rhodamine B in mesenchymal stem cells, and assessment of the viability of labeled cells by kinetic proliferation. Results: The stability analysis showed that multimodal magnetic nanoparticles-Rhodamine B had good stability in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium. The mesenchymal stem cell with multimodal magnetic nanoparticles-Rhodamine B described location of intracellular nanoparticles, which were shown as blue granules co-localized in fluorescent clusters, thus characterizing magnetic and fluorescent properties of multimodal magnetic nanoparticles Rhodamine B. Conclusion: The stability of multimodal magnetic nanoparticles-Rhodamine B found in cultured Dulbecco's Modified Eagle's-Low Glucose medium and RPMI 1640 medium assured intracellular mesenchymal stem cells labeling. This cell labeling did not affect viability of labeled mesenchymal stem cells since they continued to proliferate for five days. (author)

Multimodal approaches to use mobile, digital devices in learning practies

DEFF Research Database (Denmark)

Buhl, Mie

, anthropology, psychology and sociology) and outlines the prospect of a trans-disciplinary learning mode. The learning mode reflects the current society where knowledge production is social collaborative process and is produced in formal as well as informal and non-formal contexts. My discussion’s theoretical......In this paper, I discuss the potential of multimodal approaches to enhance learning processes. I draw on a case based on Danish Master Courses in ICT and didactic designs where multimodal approaches are in the center of students’ practical design experience as well as in generation of theoretical...... knowledge. The design of the master courses takes its starting point in the assumption that theoretical knowledge generates from practical experiences. Thus, the organization of the students’ learning processes revolves around practical multimodal experiences followed by iterative reflexive sessions...

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval

Science.gov (United States)

Bonnici, Heidi M.; Richter, Franziska R.; Yazar, Yasemin

2016-01-01

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. SIGNIFICANCE STATEMENT Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (An

Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval.

Science.gov (United States)

Bonnici, Heidi M; Richter, Franziska R; Yazar, Yasemin; Simons, Jon S

2016-05-18

Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (AnG) contribute to the retrieval of

Multi-Modal Intelligent Traffic Signal Systems GPS

Data.gov (United States)

Department of Transportation — Data were collected during the Multi-Modal Intelligent Transportation Signal Systems (MMITSS) study. MMITSS is a next-generation traffic signal system that seeks to...

3D display system using monocular multiview displays

Science.gov (United States)

Sakamoto, Kunio; Saruta, Kazuki; Takeda, Kazutoki

2002-05-01

A 3D head mounted display (HMD) system is useful for constructing a virtual space. The authors have researched the virtual-reality systems connected with computer networks for real-time remote control and developed a low-priced real-time 3D display for building these systems. We developed a 3D HMD system using monocular multi-view displays. The 3D displaying technique of this monocular multi-view display is based on the concept of the super multi-view proposed by Kajiki at TAO (Telecommunications Advancement Organization of Japan) in 1996. Our 3D HMD has two monocular multi-view displays (used as a visual display unit) in order to display a picture to the left eye and the right eye. The left and right images are a pair of stereoscopic images for the left and right eyes, then stereoscopic 3D images are observed.

Exploring Multimodal Registers in and Across Organizations and Institutional Fields

DEFF Research Database (Denmark)

Meyer, Renate; Jancsary, Dennis; Höllerer, Markus

In this article, we develop methodology that enables a systematic analysis of the structuralaspects of multimodal discourse from larger amounts of data. While existing research in visualorganization studies has provided interesting insights into the content and meaning(s) of visualand multimodal ......Responsibility (CSR), a complex and multivocal management idea that touches a variety oftopics and incorporates multiple levels of audience engagement with regard to a substantialdiversity of audiences....

Approaching Athenian Graffiti as a Multimodal Genre with GIS Application

OpenAIRE

Stampoulidis, Georgios

2017-01-01

Graffiti as an ever-changing form of urban art and visual communication is naturally multimodal, focusing on text–image relations (Bateman 2014; Forceville 2008; Kress 2006), which owe their existence mainly to the sociocultural and historical knowledge of the represented world of our experience – Husserlian Lebenswelt [Lifeworld] (Sonesson 2008; 2015). These relations constitute an interesting challenge to multimodal interpretations, because both verbal and/or pictorial representations can i...

Circular displays: control/display arrangements and stereotype strength with eight different display locations.

Science.gov (United States)

Chan, Alan H S; Hoffmann, Errol R

2015-01-01

Two experiments are reported that were designed to investigate control/display arrangements having high stereotype strengths when using circular displays. Eight display locations relative to the operator and control were tested with rotational and translational controls situated on different planes according to the Frame of Reference Transformation Tool (FORT) model of Wickens et al. (2010). (Left. No, Right! Development of the Frame of Reference Transformation Tool (FORT), Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting, 54: 1022-1026). In many cases, there was little effect of display locations, indicating the importance of the Worringham and Beringer (1998. Directional stimulus-response compatibility: a test of three alternative principles. Ergonomics, 41(6), 864-880) Visual Field principle and an extension of this principle for rotary controls (Hoffmann and Chan (2013). The Worringham and Beringer 'visual field' principle for rotary controls. Ergonomics, 56(10), 1620-1624). The initial indicator position (12, 3, 6 and 9 o'clock) had a major effect on control/display stereotype strength for many of the six controls tested. Best display/control arrangements are listed for each of the different control types (rotational and translational) and for the planes on which they are mounted. Data have application where a circular display is used due to limited display panel space and applies to space-craft, robotics operators, hospital equipment and home appliances. Practitioner Summary: Circular displays are often used when there is limited space available on a control panel. Display/control arrangements having high stereotype strength are listed for four initial indicator positions. These arrangements are best for design purposes.

Social behavior of the ruff Philomachus pugnax (L.)

NARCIS (Netherlands)

Hogan-Warburg, Alida Johanna

1965-01-01

INTRODUCTION A. SCOPE OF THE STUDY The Ruff, Philomachus pugnax(L.), differs from other waders in its breeding behavior: courtship and mating take place on a communal display ground or lek; no sounds are uttered during these activities; nesting behavior, incubation, and parental care are the

Multimodal human-machine interaction for service robots in home-care environments

OpenAIRE

Goetze, Stefan; Fischer, S.; Moritz, Niko; Appell, Jens-E.; Wallhoff, Frank

2012-01-01

This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.

Drusen Characterization with Multimodal Imaging

Science.gov (United States)

Spaide, Richard F.; Curcio, Christine A.

2010-01-01

Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

Bi-objective optimization for multi-modal transportation routing planning problem based on Pareto optimality

Directory of Open Access Journals (Sweden)

Yan Sun

2015-09-01

Full Text Available Purpose: The purpose of study is to solve the multi-modal transportation routing planning problem that aims to select an optimal route to move a consignment of goods from its origin to its destination through the multi-modal transportation network. And the optimization is from two viewpoints including cost and time. Design/methodology/approach: In this study, a bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. Minimizing the total transportation cost and the total transportation time are set as the optimization objectives of the model. In order to balance the benefit between the two objectives, Pareto optimality is utilized to solve the model by gaining its Pareto frontier. The Pareto frontier of the model can provide the multi-modal transportation operator (MTO and customers with better decision support and it is gained by the normalized normal constraint method. Then, an experimental case study is designed to verify the feasibility of the model and Pareto optimality by using the mathematical programming software Lingo. Finally, the sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case. Findings: The calculation results indicate that the proposed model and Pareto optimality have good performance in dealing with the bi-objective optimization. The sensitivity analysis also shows the influence of the variation of the demand and supply on the multi-modal transportation organization clearly. Therefore, this method can be further promoted to the practice. Originality/value: A bi-objective mixed integer linear programming model is proposed to optimize the multi-modal transportation routing planning problem. The Pareto frontier based sensitivity analysis of the demand and supply in the multi-modal transportation organization is performed based on the designed case.

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress.

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-07-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress.

Adhesion of multimode adhesives to enamel and dentin after one year of water storage.

Science.gov (United States)

Vermelho, Paulo Moreira; Reis, André Figueiredo; Ambrosano, Glaucia Maria Bovi; Giannini, Marcelo

2017-06-01

This study aimed to evaluate the ultramorphological characteristics of tooth-resin interfaces and the bond strength (BS) of multimode adhesive systems to enamel and dentin. Multimode adhesives (Scotchbond Universal (SBU) and All-Bond Universal) were tested in both self-etch and etch-and-rinse modes and compared to control groups (Optibond FL and Clearfil SE Bond (CSB)). Adhesives were applied to human molars and composite blocks were incrementally built up. Teeth were sectioned to obtain specimens for microtensile BS and TEM analysis. Specimens were tested after storage for either 24 h or 1 year. SEM analyses were performed to classify the failure pattern of beam specimens after BS testing. Etching increased the enamel BS of multimode adhesives; however, BS decreased after storage for 1 year. No significant differences in dentin BS were noted between multimode and control in either evaluation period. Storage for 1 year only reduced the dentin BS for SBU in self-etch mode. TEM analysis identified hybridization and interaction zones in dentin and enamel for all adhesives. Silver impregnation was detected on dentin-resin interfaces after storage of specimens for 1 year only with the SBU and CSB. Storage for 1 year reduced enamel BS when adhesives are applied on etched surface; however, BS of multimode adhesives did not differ from those of the control group. In dentin, no significant difference was noted between the multimode and control group adhesives, regardless of etching mode. In general, multimode adhesives showed similar behavior when compared to traditional adhesive techniques. Multimode adhesives are one-step self-etching adhesives that can also be used after enamel/dentin phosphoric acid etching, but each product may work better in specific conditions.

Preferential loss of dorsal-hippocampus synapses underlies memory impairments provoked by short, multimodal stress

Science.gov (United States)

Maras, P M; Molet, J; Chen, Y; Rice, C; Ji, S G; Solodkin, A; Baram, T Z

2014-01-01

The cognitive effects of stress are profound, yet it is unknown if the consequences of concurrent multiple stresses on learning and memory differ from those of a single stress of equal intensity and duration. We compared the effects on hippocampus-dependent memory of concurrent, hours-long light, loud noise, jostling and restraint (multimodal stress) with those of restraint or of loud noise alone. We then examined if differences in memory impairment following these two stress types might derive from their differential impact on hippocampal synapses, distinguishing dorsal and ventral hippocampus. Mice exposed to hours-long restraint or loud noise were modestly or minimally impaired in novel object recognition, whereas similar-duration multimodal stress provoked severe deficits. Differences in memory were not explained by differences in plasma corticosterone levels or numbers of Fos-labeled neurons in stress-sensitive hypothalamic neurons. However, although synapses in hippocampal CA3 were impacted by both restraint and multimodal stress, multimodal stress alone reduced synapse numbers severely in dorsal CA1, a region crucial for hippocampus-dependent memory. Ventral CA1 synapses were not significantly affected by either stress modality. Probing the basis of the preferential loss of dorsal synapses after multimodal stress, we found differential patterns of neuronal activation by the two stress types. Cross-correlation matrices, reflecting functional connectivity among activated regions, demonstrated that multimodal stress reduced hippocampal correlations with septum and thalamus and increased correlations with amygdala and BST. Thus, despite similar effects on plasma corticosterone and on hypothalamic stress-sensitive cells, multimodal and restraint stress differ in their activation of brain networks and in their impact on hippocampal synapses. Both of these processes might contribute to amplified memory impairments following short, multimodal stress. PMID:24589888

Alternative modalities – A Review of Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy

Directory of Open Access Journals (Sweden)

Aaron Scott Humphrey

2014-05-01

Full Text Available Research exploring the multimodal characteristics of comics has recently flourished, and Dale Jacobs has been one of the early prolific authors on this topic. Jacobs expands these ideas further in 'Graphic Encounters: Comics and the Sponsorship of Multimodal Literacy', a monograph which engages with theories of multimodality, but shifts its focus primarily to literacy sponsorship.

Analysis and synthesis of multi-qubit, multi-mode quantum devices

Energy Technology Data Exchange (ETDEWEB)

Solgun, Firat

2015-03-27

In this thesis we propose new methods in multi-qubit multi-mode circuit quantum electrodynamics (circuit-QED) architectures. First we describe a direct parity measurement method for three qubits, which can be realized in 2D circuit-QED with a possible extension to four qubits in a 3D circuit-QED setup for the implementation of the surface code. In Chapter 3 we show how to derive Hamiltonians and compute relaxation rates of the multi-mode superconducting microwave circuits consisting of single Josephson junctions using an exact impedance synthesis technique (the Brune synthesis) and applying previous formalisms for lumped element circuit quantization. In the rest of the thesis we extend our method to multi-junction (multi-qubit) multi-mode circuits through the use of state-space descriptions which allows us to quantize any multiport microwave superconducting circuit with a reciprocal lossy impedance response.

Multimodality image registration with software: state-of-the-art

International Nuclear Information System (INIS)

Slomka, Piotr J.; Baum, Richard P.

2009-01-01

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Experimental Study on Bioluminescence Tomography with Multimodality Fusion

Directory of Open Access Journals (Sweden)

Yujie Lv

2007-01-01

Full Text Available To verify the influence of a priori information on the nonuniqueness problem of bioluminescence tomography (BLT, the multimodality imaging fusion based BLT experiment is performed by multiview noncontact detection mode, which incorporates the anatomical information obtained by the microCT scanner and the background optical properties based on diffuse reflectance measurements. In the reconstruction procedure, the utilization of adaptive finite element methods (FEMs and a priori permissible source region refines the reconstructed results and improves numerical robustness and efficiency. The comparison between the absence and employment of a priori information shows that multimodality imaging fusion is essential to quantitative BLT reconstruction.

Multimodal medical information retrieval with unsupervised rank fusion.

Science.gov (United States)

Mourão, André; Martins, Flávio; Magalhães, João

2015-01-01

Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

Current and future multimodal learning analytics data challenges

DEFF Research Database (Denmark)

Spikol, Daniel; Prieto, Luis P.; Rodriguez-Triana, M.J.

2017-01-01

Multimodal Learning Analytics (MMLA) captures, integrates and analyzes learning traces from different sources in order to obtain a more holistic understanding of the learning process, wherever it happens. MMLA leverages the increasingly widespread availability of diverse sensors, high......-frequency data collection technologies and sophisticated machine learning and artificial intelligence techniques. The aim of this workshop is twofold: first, to expose participants to, and develop, different multimodal datasets that reflect how MMLA can bring new insights and opportunities to investigate complex...... learning processes and environments; second, to collaboratively identify a set of grand challenges for further MMLA research, built upon the foundations of previous workshops on the topic....

Effects of Multimodal Presentation and Stimulus Familiarity on Auditory and Visual Processing

Science.gov (United States)

Robinson, Christopher W.; Sloutsky, Vladimir M.

2010-01-01

Two experiments examined the effects of multimodal presentation and stimulus familiarity on auditory and visual processing. In Experiment 1, 10-month-olds were habituated to either an auditory stimulus, a visual stimulus, or an auditory-visual multimodal stimulus. Processing time was assessed during the habituation phase, and discrimination of…

Multimodal Teacher Input and Science Learning in a Middle School Sheltered Classroom

Science.gov (United States)

Zhang, Ying

2016-01-01

This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization.

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Science.gov (United States)

Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

2012-01-01

When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance. PMID:22778600

11-Ketotestosterone inhibits the alternative mating tactic in sneaker males of the peacock blenny, Salaria pavo.

Science.gov (United States)

Oliveira, R F; Carneiro, L A; Gonçalves, D M; Canario, A V; Grober, M S

2001-01-01

In the peacock blenny, Salaria pavo, a species with courtship sex-role reversal, smaller, younger males mimic the courtship behavior and the nuptial coloration of females in order to get access to nests during spawning and to parasitize egg fertilization from nest-holder males. Later in their life, sneakers transform both morphologically and behaviorally into nest-holder males. In the present paper we investigate the activational role of 11-ketotestosterone (KT), the most potent androgen in most teleost species, to promote the switch between tactics in sneaker males of S. pavo. Sneakers were implanted either with KT or with control (i.e. castor oil) silastic implants. A week after implantation they were subjected to a set of behavioral tests and morphometric measurements. KT treatment promoted the differentiation of secondary sex characters, such as the anal glands, and inhibited the expression of female courtship behavior. KT-treated sneakers also showed a trend toward less frequent display of female nuptial coloration. There was no effect of KT treatment on the expression of typical nest-holder male behavior. Finally, there was no effect of KT treatment on the number or soma size of arginine vasotocin neurons in the preoptic area, which are often associated with the expression of vertebrate sexual behavior. Thus, KT seems to play a key role in mating tactic switching by inhibiting the expression of female courtship behavior and by promoting the development of male displaying traits (e.g. anal glands). The lack of a KT effect on behavior typical of nest-holding males and vasotocinergic preoptic neurons suggests that a longer time frame or other endocrine/social signals are needed for the initiation of these traits in males that are switching tactics. Copyright 2001 S. Karger AG, Basel

Multimodal representations in collaborative history learning

NARCIS (Netherlands)

Prangsma, M.E.

2007-01-01

This dissertation focuses on the question: How does making and connecting different types of multimodal representations affect the collaborative learning process and the acquisition of a chronological frame of reference in 12 to 14-year olds in pre vocational education? A chronological frame of

Behaviour of Red-necked Spurfowl Pternistis afer in the Boknes and ...

African Journals Online (AJOL)

The social behaviour of marked Red-necked Spurfowls Pternistis afer was studied at Boknes and Cannon Rock coastal resorts near Alexandria in the Eastern Cape province between January 2001 and June 2008. Red-necked Spurfowls form breeding pairs. Courtship displays contribute to pair formation, but are also ...

The effect of display movement angle, indicator type and display location on control/display stereotype strength.

Science.gov (United States)

Hoffmann, Errol R; Chan, Alan H S

2017-08-01

Much research on stereotype strength relating display and control movements for displays moving in the vertical or horizontal directions has been reported. Here we report effects of display movement angle, where the display moves at angles (relative to the vertical) of between 0° and 180°. The experiment used six different controls, four display locations relative to the operator and three types of indicator. Indicator types were included because of the strong effects of the 'scale-side principle' that are variable with display angle. A directional indicator had higher stereotype strength than a neutral indicator, and showed an apparent reversal in control/display stereotype direction beyond an angle of 90°. However, with a neutral indicator this control reversal was not present. Practitioner Summary: The effects of display moving at angles other than the four cardinal directions, types of control, location of display and types of indicator are investigated. Indicator types (directional and neutral) have an effect on stereotype strength and may cause an apparent control reversal with change of display movement angle.

Super-Gaussian, super-diffusive transport of multi-mode active matter

OpenAIRE

Hahn, Seungsoo; Song, Sanggeun; Kim, Dae Hyun; Yang, Gil-Suk; Lee, Kang Taek; Sung, Jaeyoung

2017-01-01

Living cells exhibit multi-mode transport that switches between an active, self-propelled motion and a seemingly passive, random motion. Cellular decision-making over transport mode switching is a stochastic process that depends on the dynamics of the intracellular chemical network regulating the cell migration process. Here, we propose a theory and an exactly solvable model of multi-mode active matter. Our exact model study shows that the reversible transition between a passive mode and an a...

Mn-doped near-infrared quantum dots as multimodal targeted probes for pancreatic cancer imaging

Science.gov (United States)

Yong, Ken-Tye

2009-01-01

This work presents a novel approach to producing manganese (Mn)-doped quantum dots (Mnd-QDs) emitting in the near-infrared (NIR). Surface functionalization of Mnd-QDs with lysine makes them stably disperse in aqueous media and able to conjugate with targeting molecules. The nanoparticles were structurally and compositionally characterized and maintained a high photoluminescence quantum yield and displayed paramagnetism in water. The receptor-mediated delivery of bioconjugated Mnd-QDs into pancreatic cancer cells was demonstrated using the confocal microscopy technique. Cytotoxicity of Mnd-QDs on live cells has been evaluated. The NIR-emitting characteristic of the QDs has been exploited to acquire whole animal body imaging with high contrast signals. In addition, histological and blood analysis of mice have revealed that no long-term toxic effects arise from MnD-QDs. These studies suggest multimodal Mnd-QDs have the potentials as probes for early pancreatic cancer imaging and detection.

Design of a Multi-mode Flight Deck Decision Support System for Airborne Conflict Management

Science.gov (United States)

Barhydt, Richard; Krishnamurthy, Karthik

2004-01-01

NASA Langley has developed a multi-mode decision support system for pilots operating in a Distributed Air-Ground Traffic Management (DAG-TM) environment. An Autonomous Operations Planner (AOP) assists pilots in performing separation assurance functions, including conflict detection, prevention, and resolution. Ongoing AOP design has been based on a comprehensive human factors analysis and evaluation results from previous human-in-the-loop experiments with airline pilot test subjects. AOP considers complex flight mode interactions and provides flight guidance to pilots consistent with the current aircraft control state. Pilots communicate goals to AOP by setting system preferences and actively probing potential trajectories for conflicts. To minimize training requirements and improve operational use, AOP design leverages existing alerting philosophies, displays, and crew interfaces common on commercial aircraft. Future work will consider trajectory prediction uncertainties, integration with the TCAS collision avoidance system, and will incorporate enhancements based on an upcoming air-ground coordination experiment.

Multimodality instrument for tissue characterization

Science.gov (United States)

Mah, Robert W. (Inventor); Andrews, Russell J. (Inventor)

2004-01-01

A system with multimodality instrument for tissue identification includes a computer-controlled motor driven heuristic probe with a multisensory tip. For neurosurgical applications, the instrument is mounted on a stereotactic frame for the probe to penetrate the brain in a precisely controlled fashion. The resistance of the brain tissue being penetrated is continually monitored by a miniaturized strain gauge attached to the probe tip. Other modality sensors may be mounted near the probe tip to provide real-time tissue characterizations and the ability to detect the proximity of blood vessels, thus eliminating errors normally associated with registration of pre-operative scans, tissue swelling, elastic tissue deformation, human judgement, etc., and rendering surgical procedures safer, more accurate, and efficient. A neural network program adaptively learns the information on resistance and other characteristic features of normal brain tissue during the surgery and provides near real-time modeling. A fuzzy logic interface to the neural network program incorporates expert medical knowledge in the learning process. Identification of abnormal brain tissue is determined by the detection of change and comparison with previously learned models of abnormal brain tissues. The operation of the instrument is controlled through a user friendly graphical interface. Patient data is presented in a 3D stereographics display. Acoustic feedback of selected information may optionally be provided. Upon detection of the close proximity to blood vessels or abnormal brain tissue, the computer-controlled motor immediately stops probe penetration. The use of this system will make surgical procedures safer, more accurate, and more efficient. Other applications of this system include the detection, prognosis and treatment of breast cancer, prostate cancer, spinal diseases, and use in general exploratory surgery.

Systemic multimodal approach to speech therapy treatment in autistic children.

Science.gov (United States)

Tamas, Daniela; Marković, Slavica; Milankov, Vesela

2013-01-01

Conditions in which speech therapy treatment is applied in autistic children are often not in accordance with characteristics of opinions and learning of people with autism. A systemic multimodal approach means motivating autistic people to develop their language speech skill through the procedure which allows reliving of their personal experience according to the contents that are presented in the their natural social environment. This research was aimed at evaluating the efficiency of speech treatment based on the systemic multimodal approach to the work with autistic children. The study sample consisted of 34 children, aged from 8 to 16 years, diagnosed to have different autistic disorders, whose results showed a moderate and severe clinical picture of autism on the Childhood Autism Rating Scale. The applied instruments for the evaluation of ability were the Childhood Autism Rating Scale and Ganzberg II test. The study subjects were divided into two groups according to the type of treatment: children who were covered by the continuing treatment and systemic multimodal approach in the treatment, and children who were covered by classical speech treatment. It is shown that the systemic multimodal approach in teaching autistic children affects the stimulation of communication, socialization, self-service and work as well as that the progress achieved in these areas of functioning was retainable after long time, too. By applying the systemic multimodal approach when dealing with autistic children and by comparing their achievements on tests applied before, during and after the application of this mode, it has been concluded that certain improvement has been achieved in the functionality within the diagnosed category. The results point to a possible direction in the creation of new methods, plans and programs in dealing with autistic children based on empirical and interactive learning.

Multimodality therapy of local regional esophageal cancer.

Science.gov (United States)

Kelsen, David P

2005-12-01

Recent trials regarding the use of multimodality therapy for patients with cancers of the esophagus and gastroesophageal junction have not conclusively shown benefit. Regimens containing cisplatin and fluorouracil administered preoperatively appear to be tolerable and do not increase operative morbidity or mortality when compared with surgery alone. Yet clinical trials have not clearly shown that such regimens improve outcome as measured by survival. Likewise, trials of postoperative chemoradiation have not reported a significant improvement in median or overall survival. The reasons for the lack of clinical benefit from multimodality therapy are not completely understood, but improvements in systemic therapy will probably be necessary before disease-free or overall survival improves substantially. Some new single agents such as the taxanes (docetaxel or paclitaxel) and the camptothecan analog irinotecan have shown modest activity for palliative therapy.

New two-port multimode interference reflectors

NARCIS (Netherlands)

Kleijn, E.; Smit, M.K.; Wale, M.J.; Leijtens, X.J.M.

2012-01-01

Multi-mode interference reflectors (MIRs) are versatile components. Two new MIR designs with a fixed 50/50 reflection to transmission ratio are introduced. Measurements on these new devices and on devices similar to those in [1] are presented and compared to the design values. Measured losses are

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

2018-01-30

Jan 30, 2018 ... (μTBS) of multimode adhesives to dentin when using the self‑etch approach. Materials and Methods: ... adhesion, the collagen fibers collapse during the. Introduction ..... The failure mode was determined using an optical.

Multimodal mechanisms of food creaminess sensation.

Science.gov (United States)

Chen, Jianshe; Eaton, Louise

2012-12-01

In this work, the sensory creaminess of a set of four viscosity-matched fluid foods (single cream, evaporated milk, corn starch solution, and corn starch solution containing long chain free fatty acids) was tested by a panel of 16 assessors via controlled sensation mechanisms of smell only, taste only, taste and tactile, and integrated multimodal. It was found that all sensation channels were able to discriminate between creamy and non-creamy foods, but only the multimodal method gave creaminess ratings in agreement with the samples' fat content. Results from this study show that the presence of long chain free fatty acids has no influence on creaminess perception. It is certain that food creaminess is not a primary sensory property but an integrated sensory perception (or sensory experience) derived from combined sensations of visual, olfactory, gustatory, and tactile cues. Creamy colour, milky flavour, and smooth texture are probably the most important sensory features of food creaminess.

Multimodal 2D Brain Computer Interface.

Science.gov (United States)

Almajidy, Rand K; Boudria, Yacine; Hofmann, Ulrich G; Besio, Walter; Mankodiya, Kunal

2015-08-01

In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

Multimodal interaction with W3C standards toward natural user interfaces to everything

CERN Document Server

2017-01-01

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers. Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way; Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted livi...

Gestures and multimodal input

OpenAIRE

Keates, Simeon; Robinson, Peter

1999-01-01

For users with motion impairments, the standard keyboard and mouse arrangement for computer access often presents problems. Other approaches have to be adopted to overcome this. In this paper, we will describe the development of a prototype multimodal input system based on two gestural input channels. Results from extensive user trials of this system are presented. These trials showed that the physical and cognitive loads on the user can quickly become excessive and detrimental to the interac...

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

Directory of Open Access Journals (Sweden)

Jing-Yu Yang

2012-04-01

Full Text Available When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person’s overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA. Specifically, one person’s different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

Multi-focus beam shaping of high power multimode lasers

Science.gov (United States)

Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

2017-08-01

Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

Multimodality image registration with software: state-of-the-art

Energy Technology Data Exchange (ETDEWEB)

Slomka, Piotr J. [Cedars-Sinai Medical Center, AIM Program/Department of Imaging, Los Angeles, CA (United States); University of California, David Geffen School of Medicine, Los Angeles, CA (United States); Baum, Richard P. [Center for PET, Department of Nuclear Medicine, Bad Berka (Germany)

2009-03-15

Multimodality image integration of functional and anatomical data can be performed by means of dedicated hybrid imaging systems or by software image co-registration techniques. Hybrid positron emission tomography (PET)/computed tomography (CT) systems have found wide acceptance in oncological imaging, while software registration techniques have a significant role in patient-specific, cost-effective, and radiation dose-effective application of integrated imaging. Software techniques allow accurate (2-3 mm) rigid image registration of brain PET with CT and MRI. Nonlinear techniques are used in whole-body image registration, and recent developments allow for significantly accelerated computing times. Nonlinear software registration of PET with CT or MRI is required for multimodality radiation planning. Difficulties remain in the validation of nonlinear registration of soft tissue organs. The utilization of software-based multimodality image integration in a clinical environment is sometimes hindered by the lack of appropriate picture archiving and communication systems (PACS) infrastructure needed to efficiently and automatically integrate all available images into one common database. In cardiology applications, multimodality PET/single photon emission computed tomography and coronary CT angiography imaging is typically not required unless the results of one of the tests are equivocal. Software image registration is likely to be used in a complementary fashion with hybrid PET/CT or PET/magnetic resonance imaging systems. Software registration of stand-alone scans ''paved the way'' for the clinical application of hybrid scanners, demonstrating practical benefits of image integration before the hybrid dual-modality devices were available. (orig.)

Marveling at "The Man Called Nova": Comics as Sponsors of Multimodal Literacy

Science.gov (United States)

Jacobs, Dale

2007-01-01

This essay theorizes the ways in which comics, and Marvel Comics in particular, acted as sponsors of multimodal literacy for the author. In doing so, the essay demonstrates the possibilities that exist in examining comics more closely and in thinking about how literacy sponsorship happens in multimodal texts. (Contains 1 figure and 13 notes.)

Numerical modelling of multimode fibre-optic communication lines

Energy Technology Data Exchange (ETDEWEB)

Sidelnikov, O S; Fedoruk, M P [Novosibirsk State University, Novosibirsk (Russian Federation); Sygletos, S; Ferreira, F [Aston University, England, Birmingham, B4 7ET (United Kingdom)

2016-01-31

The results of numerical modelling of nonlinear propagation of an optical signal in multimode fibres with a small differential group delay are presented. It is found that the dependence of the error vector magnitude (EVM) on the differential group delay can be reduced by increasing the number of ADC samples per symbol in the numerical implementation of the differential group delay compensation algorithm in the receiver. The possibility of using multimode fibres with a small differential group delay for data transmission in modern digital communication systems is demonstrated. It is shown that with increasing number of modes the strong coupling regime provides a lower EVM level than the weak coupling one. (fibre-optic communication lines)

WE-D-9A-03: CSDF: A Color Extension of the Grayscale Standard Display Function

International Nuclear Information System (INIS)

Kimpe, T; Marchessoux, C; Rostang, J; Piepers, B; Avanaki, A; Espig, K; Xthona, A

2014-01-01

Purpose: Use of color images in medical imaging has increased significantly the last few years. As of today there is no agreed standard on how color information needs to be visualized on medical color displays, resulting into large variability of color appearance and it making consistency and quality assurance a challenge. This paper presents a proposal for an extension of DICOM GSDF towards color. Methods: Visualization needs for several color modalities (multimodality imaging, nuclear medicine, digital pathology, quantitative imaging applications…) have been studied. On this basis a proposal was made for desired color behavior of color medical display systems and its behavior and effect on color medical images was analyzed. Results: Several medical color modalities could benefit from perceptually linear color visualization for similar reasons as why GSDF was put in place for greyscale medical images. An extension of the GSDF (Greyscale Standard Display Function) to color is proposed: CSDF (color standard display function). CSDF is based on deltaE2000 and offers a perceptually linear color behavior. CSDF uses GSDF as its neutral grey behavior. A comparison between sRGB/GSDF and CSDF confirms that CSDF significantly improves perceptual color linearity. Furthermore, results also indicate that because of the improved perceptual linearity, CSDF has the potential to increase perceived contrast of clinically relevant color features. Conclusion: There is a need for an extension of GSDF towards color visualization in order to guarantee consistency and quality. A first proposal (CSDF) for such extension has been made. Behavior of a CSDF calibrated display has been characterized and compared with sRGB/GSDF behavior. First results indicate that CSDF could have a positive influence on perceived contrast of clinically relevant color features and could offer benefits for quantitative imaging applications. Authors are employees of Barco Healthcare

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

Science.gov (United States)

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback

Directory of Open Access Journals (Sweden)

Obrenović Željko

2004-01-01

Full Text Available In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.

An Efficient Quality-Related Fault Diagnosis Method for Real-Time Multimode Industrial Process

Directory of Open Access Journals (Sweden)

Kaixiang Peng

2017-01-01

Full Text Available Focusing on quality-related complex industrial process performance monitoring, a novel multimode process monitoring method is proposed in this paper. Firstly, principal component space clustering is implemented under the guidance of quality variables. Through extraction of model tags, clustering information of original training data can be acquired. Secondly, according to multimode characteristics of process data, the monitoring model integrated Gaussian mixture model with total projection to latent structures is effective after building the covariance description form. The multimode total projection to latent structures (MTPLS model is the foundation of problem solving about quality-related monitoring for multimode processes. Then, a comprehensive statistics index is defined which is based on the posterior probability of the monitored samples belonging to each Gaussian component in the Bayesian theory. After that, a combined index is constructed for process monitoring. Finally, motivated by the application of traditional contribution plot in fault diagnosis, a gradient contribution rate is applied for analyzing the variation of variable contribution rate along samples. Our method can ensure the implementation of online fault monitoring and diagnosis for multimode processes. Performances of the whole proposed scheme are verified in a real industrial, hot strip mill process (HSMP compared with some existing methods.

Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

Science.gov (United States)

Kim, Mi Song

2015-10-01

Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal learning environment. Our design-based research co-designs and develops engaging, immersive, and interactive informal learning activities called "Embodied Modeling-Mediated Activities" (EMMA) to support not only Singaporean learners' deep learning of astronomy but also the capacity of teachers. As part of the research on EMMA, this case study describes two prospective teachers' co-design processes involving multimodal models for teaching and learning the concept of the seasons in a technology-rich informal learning setting. Our study uncovers four prominent themes emerging from our data concerning the contextualized nature of learning and teaching involving multimodal models in informal learning contexts: (1) promoting communication and emerging questions, (2) offering affordances through limitations, (3) explaining one concept involving multiple concepts, and (4) integrating teaching and learning experiences. This study has an implication for the development of a pedagogical framework for teaching and learning in technology-enhanced learning environments—that is empowering teachers to become active sense-makers using multimodal models.

Responsive Multimodal Transportation Management Strategies And IVHS

Science.gov (United States)

1995-02-01

THE PURPOSE OF THIS STUDY WAS TO INVESTIGATE NEW AND INNOVATIVE WAYS TO INCORPORATE IVHS TECHNOLOGIES INTO MULTIMODAL TRANSPORTATION MANAGEMENT STRATEGIES. MUCH OF THE IVHS RESEARCH DONE TO DATE HAS ADDRESSED THE MODES INDIVIDUALLY. THIS PROJECT FOCU...

The future of multimodal corpora O futuro dos corpora modais

Directory of Open Access Journals (Sweden)

Dawn Knight

2011-01-01

Full Text Available This paper takes stock of the current state-of-the-art in multimodal corpus linguistics, and proposes some projections of future developments in this field. It provides a critical overview of key multimodal corpora that have been constructed over the past decade and presents a wish-list of future technological and methodological advancements that may help to increase the availability, utility and functionality of such corpora for linguistic research.Este artigo apresenta um balanço do estado da arte da linguística de corpus multimodal e propõe a projeção de desenvolvimentos futuros nessa área. Um resumo crítico dos corpora multimodais-chave que foram construídos na última década é apresentado, assim como uma lista de desenvolvimentos tecnológicos e metodológicos futuros que podem auxiliar na disponibilização e utilização, bem como na funcionalidade, de tais corpora para a pesquisa linguística.

New developments in multimodal clinical multiphoton tomography

Science.gov (United States)

König, Karsten

2011-03-01

80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

The Impact of Multimodal Texts on Reading Achievement: A Study of Iranian Secondary School Learners

Directory of Open Access Journals (Sweden)

Bahareh Baharani

2015-07-01

Full Text Available This study was designed to investigate the impact of multimodal text on reading comprehension test performance of Iranian intermediate learners. A total of 80 students participated in this study. All of them were Iranian female EFL learners with the age ranging from 16 to 18. They were selected from a boarding high school in Nasr Abad, Torbat Jam in Khorasan e Razavi, Iran. The students were randomly settled in four groups, who received different instructional approaches through using linear texts, multimodal printed texts, non-printed multimodal texts, and both multimodal printed and non-printed texts.  A pre-test and post-test were used to find out the differences before and after the experimental treatment.  The results reflected that the printed and non-printed multimodal texts had significant impact on reading comprehension test performance. In contrast, applying linear texts or traditional texts did not exert significant influence on reading comprehension ability of the participants. The findings provide useful hints for language instructors to improve effectiveness of instructional reading curriculums and reading ability of language learners. The participants who learned reading comprehension through using multimodal printed and non-printed texts enjoy reading programs and develop their intrinsic and extrinsic motivation for improving reading ability.

Multimodal Speech Capture System for Speech Rehabilitation and Learning.

Science.gov (United States)

Sebkhi, Nordine; Desai, Dhyey; Islam, Mohammad; Lu, Jun; Wilson, Kimberly; Ghovanloo, Maysam

2017-11-01

Speech-language pathologists (SLPs) are trained to correct articulation of people diagnosed with motor speech disorders by analyzing articulators' motion and assessing speech outcome while patients speak. To assist SLPs in this task, we are presenting the multimodal speech capture system (MSCS) that records and displays kinematics of key speech articulators, the tongue and lips, along with voice, using unobtrusive methods. Collected speech modalities, tongue motion, lips gestures, and voice are visualized not only in real-time to provide patients with instant feedback but also offline to allow SLPs to perform post-analysis of articulators' motion, particularly the tongue, with its prominent but hardly visible role in articulation. We describe the MSCS hardware and software components, and demonstrate its basic visualization capabilities by a healthy individual repeating the words "Hello World." A proof-of-concept prototype has been successfully developed for this purpose, and will be used in future clinical studies to evaluate its potential impact on accelerating speech rehabilitation by enabling patients to speak naturally. Pattern matching algorithms to be applied to the collected data can provide patients with quantitative and objective feedback on their speech performance, unlike current methods that are mostly subjective, and may vary from one SLP to another.

Male-typical courtship, spawning behavior, and olfactory sensitivity are induced to different extents by androgens in the goldfish suggesting they are controlled by different neuroendocrine mechanisms.

Science.gov (United States)

Ghosal, Ratna; Sorensen, Peter W

2016-06-01

Male-typical reproductive behaviors vary greatly between different species of fishes with androgens playing a variety of roles that appear especially important in the gonochorist cypriniform fishes. The goldfish is an important model for the cypriniformes and while it is clear that male goldfish are fully feminized by prostaglandin F2α(PGF2α), it is not clear whether females will exhibit normal levels of male-typical reproductive behaviors as well as olfactory function when treated with androgens. To answer this question, we exposed sexually-regressed adult female goldfish to several types of androgen and monitored their tendencies to court (inspect females) and mate (spawn, or attempt to release gametes) while monitoring their olfactory sensitivity until changes in these attributes were maximized. Untreated adult males (intact) were included to determine the extent of masculinization. Treatments included the natural androgens, 11-ketotestosterone and testosterone (KT and T), administered via capsules (KT+T-implanted fish); the artificial androgen, methyltestosterone (MT), administered via capsules (MT-C); and MT administered in the fishes' water (MT-B). Male-typical olfactory sensitivity to a pheromone (15keto-PGF2α) increased in all androgen-treated groups and by week 6 was fully equivalent to that of males. Male-typical courtship behavior increased in all androgen-treated groups although slowly, and only MT-B females came to exhibit levels equivalent to those of males after 18weeks. In contrast, male-typical mating activity increased only slightly, with MT-B females reaching levels one-third that of males after 30weeks. We conclude that while androgens fully masculinize olfactory sensitivity and courtship behavior in goldfish, mating behavior is controlled by a different neuroendocrine mechanism(s) that has yet to be fully elucidated. Copyright © 2016 Elsevier Inc. All rights reserved.

Naming Block Structures: A Multimodal Approach

Science.gov (United States)

Cohen, Lynn; Uhry, Joanna

2011-01-01

This study describes symbolic representation in block play in a culturally diverse suburban preschool classroom. Block play is "multimodal" and can allow children to experiment with materials to represent the world in many forms of literacy. Combined qualitative and quantitative data from seventy-seven block structures were collected and analyzed.…

Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

Science.gov (United States)

Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

2017-12-01

How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

Evaluation of multimodal ground cues

DEFF Research Database (Denmark)

Nordahl, Rolf; Lecuyer, Anatole; Serafin, Stefania

2012-01-01

This chapter presents an array of results on the perception of ground surfaces via multiple sensory modalities,with special attention to non visual perceptual cues, notably those arising from audition and haptics, as well as interactions between them. It also reviews approaches to combining...... synthetic multimodal cues, from vision, haptics, and audition, in order to realize virtual experiences of walking on simulated ground surfaces or other features....

Teaching Poetry through Collaborative Art: An Analysis of Multimodal Ensembles for Transformative Learning

Science.gov (United States)

Wandera, David B.

2016-01-01

This study is anchored on two positions: that every communication is multimodal and that different modalities within multimodal communication have particular affordances. Written and oral language and other modalities, such as body language and audio/visual media, are interwoven in classroom communication. What might it look like to strategically…

Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

Science.gov (United States)

Donnelly, Debra J.

2018-01-01

Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

APEX_SCOPE: A graphical user interface for visualization of multi-modal data in inter-disciplinary studies.

Science.gov (United States)

Kanbar, Lara J; Shalish, Wissam; Precup, Doina; Brown, Karen; Sant'Anna, Guilherme M; Kearney, Robert E

2017-07-01

In multi-disciplinary studies, different forms of data are often collected for analysis. For example, APEX, a study on the automated prediction of extubation readiness in extremely preterm infants, collects clinical parameters and cardiorespiratory signals. A variety of cardiorespiratory metrics are computed from these signals and used to assign a cardiorespiratory pattern at each time. In such a situation, exploratory analysis requires a visualization tool capable of displaying these different types of acquired and computed signals in an integrated environment. Thus, we developed APEX_SCOPE, a graphical tool for the visualization of multi-modal data comprising cardiorespiratory signals, automated cardiorespiratory metrics, automated respiratory patterns, manually classified respiratory patterns, and manual annotations by clinicians during data acquisition. This MATLAB-based application provides a means for collaborators to view combinations of signals to promote discussion, generate hypotheses and develop features.

Multimodal retrieval of autobiographical memories: sensory information contributes differently to the recollection of events.

Science.gov (United States)

Willander, Johan; Sikström, Sverker; Karlsson, Kristina

2015-01-01

Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality). However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities) are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, or multimodal. The results showed that the peak of the distributions depends on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

Multimodal Retrieval of Autobiographical Memories: Sensory Information Contributes Differently to the Recollection of Events

Directory of Open Access Journals (Sweden)

Johan eWillander

2015-11-01

Full Text Available Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality. However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, and multimodal. The results showed that the peak of the distributions depend on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

A Robust Multimodal Bio metric Authentication Scheme with Voice and Face Recognition

International Nuclear Information System (INIS)

Kasban, H.

2017-01-01

This paper proposes a multimodal biometric scheme for human authentication based on fusion of voice and face recognition. For voice recognition, three categories of features (statistical coefficients, cepstral coefficients and voice timbre) are used and compared. The voice identification modality is carried out using Gaussian Mixture Model (GMM). For face recognition, three recognition methods (Eigenface, Linear Discriminate Analysis (LDA), and Gabor filter) are used and compared. The combination of voice and face biometrics systems into a single multimodal biometrics system is performed using features fusion and scores fusion. This study shows that the best results are obtained using all the features (cepstral coefficients, statistical coefficients and voice timbre features) for voice recognition, LDA face recognition method and scores fusion for the multimodal biometrics system

Effect of Multimodal Pore Channels on Cargo Release from Mesoporous Silica Nanoparticles

Directory of Open Access Journals (Sweden)

Sushilkumar A. Jadhav

2016-01-01

Full Text Available Mesoporous silica nanoparticles (MSNs with multimodal pore channels were fully characterized by TEM, nitrogen adsorption-desorption, and DLS analyses. MSNs with average diameter of 200 nm with dual pore channel zones with pore diameters of 1.3–2.6 and 4 nm were tested for their use in drug delivery application. Important role of the multimodal pore systems present on MSNs on the quantitative release of model drug ibuprofen was investigated. The results obtained revealed that the release profile for ibuprofen clearly shows distinct zones which can be attributed to the respective porous channel zones present on the particles. The fluctuations in the concentration of ibuprofen during the prolonged release from MSNs were caused by the multimodal pore channel systems.

Immune-mediated change in the expression of a sexual trait predicts offspring survival in the wild.

Directory of Open Access Journals (Sweden)

Rémi Chargé

Full Text Available BACKGROUND: The "good genes" theory of sexual selection postulates that females choose mates that will improve their offspring's fitness through the inheritance of paternal genes. In spite of the attention that this hypothesis has given rise to, the empirical evidence remains sparse, mostly because of the difficulties of controlling for the many environmental factors that may covary with both the paternal phenotype and offspring fitness. Here, we tested the hypothesis that offspring sired by males of a preferred phenotype should have better survival in an endangered bird, the houbara bustard (Chlamydotis undulata undulata. METHODOLOGY/PRINCIPAL FINDINGS: We tested if natural and experimentally-induced variation in courtship display (following an inflammatory challenge predicts the survival of offspring. Chicks were produced by artificial insemination of females, ensuring that any effect on survival could only arise from the transfer of paternal genes. One hundred and twenty offspring were equipped with radio transmitters, and their survival monitored in the wild for a year. This allowed assessment of the potential benefits of paternal genes in a natural setting, where birds experience the whole range of environmental hazards. Although natural variation in sire courtship display did not predict offspring survival, sires that withstood the inflammatory insult and maintained their courtship activity sired offspring with the best survival upon release. CONCLUSIONS: This finding is relevant both to enlighten the debate on "good genes" sexual selection and the management of supportive breeding programs.

Sustained Spatial Attention in Touch: Modality-Specific and Multimodal Mechanisms

Directory of Open Access Journals (Sweden)

Chiara F. Sambo

2011-01-01

Full Text Available Sustained attention to a body location results in enhanced processing of tactile stimuli presented at that location compared to another unattended location. In this paper, we review studies investigating the neural correlates of sustained spatial attention in touch. These studies consistently show that activity within modality-specific somatosensory areas (SI and SII is modulated by sustained tactile-spatial attention. Recent evidence suggests that these somatosensory areas may be recruited as part of a larger cortical network,also including higher-level multimodal regions involved in spatial selection across modalities. We discuss, in turn, the following multimodal effects in sustained tactile-spatial attention tasks. First, cross-modal attentional links between touch and vision, reflected in enhanced processing of task-irrelevant visual stimuli at tactuallyattended locations, are mediated by common (multimodal representations of external space. Second, vision of the body modulates activity underlying sustained tactile-spatial attention, facilitating attentional modulation of tactile processing in between-hand (when hands are sufficiently far apart and impairing attentional modulation in within-hand selection tasks. Finally, body posture influences mechanisms of sustained tactile-spatial attention, relying, at least partly, on remapping of tactile stimuli in external, visuallydefined, spatial coordinates. Taken together, the findings reviewed in this paper indicate that sustained spatial attention in touch is subserved by both modality-specific and multimodal mechanisms. The interplay between these mechanisms allows flexible and efficient spatial selection within and across sensory modalities.

Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

Science.gov (United States)

Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

2016-03-01

Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

Multimodal system for the planning and guidance of bronchoscopy

Science.gov (United States)

Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

2015-03-01

Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

Human-computer interaction for alert warning and attention allocation systems of the multimodal watchstation

Science.gov (United States)

Obermayer, Richard W.; Nugent, William A.

2000-11-01

The SPAWAR Systems Center San Diego is currently developing an advanced Multi-Modal Watchstation (MMWS); design concepts and software from this effort are intended for transition to future United States Navy surface combatants. The MMWS features multiple flat panel displays and several modes of user interaction, including voice input and output, natural language recognition, 3D audio, stylus and gestural inputs. In 1999, an extensive literature review was conducted on basic and applied research concerned with alerting and warning systems. After summarizing that literature, a human computer interaction (HCI) designer's guide was prepared to support the design of an attention allocation subsystem (AAS) for the MMWS. The resultant HCI guidelines are being applied in the design of a fully interactive AAS prototype. An overview of key findings from the literature review, a proposed design methodology with illustrative examples, and an assessment of progress made in implementing the HCI designers guide are presented.

Multimodality and children's participation in classrooms: Instances of ...

African Journals Online (AJOL)

Multimodality and children's participation in classrooms: Instances of research. ... deficit models of children, drawing on their everyday experiences and their existing ... It outlines the theoretical framework supporting the pedagogical approach, ...

Elimination of mode coupling in multimode continuous-variable key distribution

International Nuclear Information System (INIS)

Filip, Radim; Mista, Ladislav; Marek, Petr

2005-01-01

A multimode channel can be utilized to substantially increase the capacity of quantum continuous-variable key distribution. Beyond losses in the channel, an uncontrollable coupling between the modes of the channel typically degrades the capacity of multimode channels. For the key distribution protocol with simultaneous measurement of both complementary quadratures we propose a feasible method to eliminate any undesirable mode coupling by only the receiver's appropriate measurement and data manipulation. It can be used to substantially increase the capacity of the channel, which has an important application in practical continuous-variable quantum cryptography

OpenLMD, multimodal monitoring and control of LMD processing

Science.gov (United States)

Rodríguez-Araújo, Jorge; García-Díaz, Antón

2017-02-01

This paper presents OpenLMD, a novel open-source solution for on-line multimodal monitoring of Laser Metal Deposition (LMD). The solution is also applicable to a wider range of laser-based applications that require on-line control (e.g. laser welding). OpenLMD is a middleware that enables the orchestration and virtualization of a LMD robot cell, using several open-source frameworks (e.g. ROS, OpenCV, PCL). The solution also allows reconfiguration by easy integration of multiple sensors and processing equipment. As a result, OpenLMD delivers significant advantages over existing monitoring and control approaches, such as improved scalability, and multimodal monitoring and data sharing capabilities.

3D hierarchical spatial representation and memory of multimodal sensory data

Science.gov (United States)

Khosla, Deepak; Dow, Paul A.; Huber, David J.

2009-04-01

This paper describes an efficient method and system for representing, processing and understanding multi-modal sensory data. More specifically, it describes a computational method and system for how to process and remember multiple locations in multimodal sensory space (e.g., visual, auditory, somatosensory, etc.). The multimodal representation and memory is based on a biologically-inspired hierarchy of spatial representations implemented with novel analogues of real representations used in the human brain. The novelty of the work is in the computationally efficient and robust spatial representation of 3D locations in multimodal sensory space as well as an associated working memory for storage and recall of these representations at the desired level for goal-oriented action. We describe (1) A simple and efficient method for human-like hierarchical spatial representations of sensory data and how to associate, integrate and convert between these representations (head-centered coordinate system, body-centered coordinate, etc.); (2) a robust method for training and learning a mapping of points in multimodal sensory space (e.g., camera-visible object positions, location of auditory sources, etc.) to the above hierarchical spatial representations; and (3) a specification and implementation of a hierarchical spatial working memory based on the above for storage and recall at the desired level for goal-oriented action(s). This work is most useful for any machine or human-machine application that requires processing of multimodal sensory inputs, making sense of it from a spatial perspective (e.g., where is the sensory information coming from with respect to the machine and its parts) and then taking some goal-oriented action based on this spatial understanding. A multi-level spatial representation hierarchy means that heterogeneous sensory inputs (e.g., visual, auditory, somatosensory, etc.) can map onto the hierarchy at different levels. When controlling various machine

Multimodality, politics and ideology

DEFF Research Database (Denmark)

Machin, David; Van Leeuwen, T.

2016-01-01

This journal's editorial statement is clear that political discourse should be studied not only as regards parliamentary type politics. In this introduction we argue precisely for the need to pay increasing attention to the way that political ideologies are infused into culture more widely...... of power, requires meanings and identities which can hold them in place. We explain the processes by which critical multimodal discourse analysis can best draw out this ideology as it is realized through different semiotics resources. © John Benjamins Publishing Company....

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

Science.gov (United States)

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

Single versus multimodality training basic laparoscopic skills

NARCIS (Netherlands)

Brinkman, W.M.; Havermans, S.Y.; Buzink, S.N.; Botden, S.M.B.I.; Jakimowicz, J.J.; Schoot, B.C.

2012-01-01

Introduction - Even though literature provides compelling evidence of the value of simulators for training of basic laparoscopic skills, the best way to incorporate them into a surgical curriculum is unclear. This study compares the training outcome of single modality training with multimodality

The Multimodalities of Globalization: Teaching a YouTube Video in an EAP Classroom

Science.gov (United States)

Chun, Christian W.

2012-01-01

This article examines the ways in which a multimodal text--a YouTube video on globalization and business--was mediated in two English for Academic Purposes (EAP) classrooms, and how these mediations shaped the instructor's and her students' meaning-making in specific ways. I first explore the complex multimodal discourses involved with this…

Multimodal interaction in image and video applications

CERN Document Server

Sappa, Angel D

2013-01-01

Traditional Pattern Recognition (PR) and Computer Vision (CV) technologies have mainly focused on full automation, even though full automation often proves elusive or unnatural in many applications, where the technology is expected to assist rather than replace the human agents. However, not all the problems can be automatically solved being the human interaction the only way to tackle those applications. Recently, multimodal human interaction has become an important field of increasing interest in the research community. Advanced man-machine interfaces with high cognitive capabilities are a hot research topic that aims at solving challenging problems in image and video applications. Actually, the idea of computer interactive systems was already proposed on the early stages of computer science. Nowadays, the ubiquity of image sensors together with the ever-increasing computing performance has open new and challenging opportunities for research in multimodal human interaction. This book aims to show how existi...

Photonic lantern with multimode fibers embedded

Science.gov (United States)

Yu, Hai-Jiao; Yan, Qi; Huang, Zong-Jun; Tian, He; Jiang, Yu; Liu, Yong-Jun; Zhang, Jian-Zhong; Sun, Wei-Min

2014-08-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined.

Photonic lantern with multimode fibers embedded

International Nuclear Information System (INIS)

Yu Hai-Jiao; Yan Qi; Huang Zong-Jun; Tian He; Jiang Yu; Liu Yong-Jun; Zhang Jian-Zhong; Sun Wei-Min

2014-01-01

A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined. (research papers)

Adaptive Multiview Nonnegative Matrix Factorization Algorithm for Integration of Multimodal Biomedical Data

Directory of Open Access Journals (Sweden)

Bisakha Ray

2017-08-01

Full Text Available The amounts and types of available multimodal tumor data are rapidly increasing, and their integration is critical for fully understanding the underlying cancer biology and personalizing treatment. However, the development of methods for effectively integrating multimodal data in a principled manner is lagging behind our ability to generate the data. In this article, we introduce an extension to a multiview nonnegative matrix factorization algorithm (NNMF for dimensionality reduction and integration of heterogeneous data types and compare the predictive modeling performance of the method on unimodal and multimodal data. We also present a comparative evaluation of our novel multiview approach and current data integration methods. Our work provides an efficient method to extend an existing dimensionality reduction method. We report rigorous evaluation of the method on large-scale quantitative protein and phosphoprotein tumor data from the Clinical Proteomic Tumor Analysis Consortium (CPTAC acquired using state-of-the-art liquid chromatography mass spectrometry. Exome sequencing and RNA-Seq data were also available from The Cancer Genome Atlas for the same tumors. For unimodal data, in case of breast cancer, transcript levels were most predictive of estrogen and progesterone receptor status and copy number variation of human epidermal growth factor receptor 2 status. For ovarian and colon cancers, phosphoprotein and protein levels were most predictive of tumor grade and stage and residual tumor, respectively. When multiview NNMF was applied to multimodal data to predict outcomes, the improvement in performance is not overall statistically significant beyond unimodal data, suggesting that proteomics data may contain more predictive information regarding tumor phenotypes than transcript levels, probably due to the fact that proteins are the functional gene products and therefore a more direct measurement of the functional state of the tumor. Here, we

A community intervention trial of multimodal suicide prevention program in Japan: A Novel multimodal Community Intervention program to prevent suicide and suicide attempt in Japan, NOCOMIT-J

OpenAIRE

Ono, Yutaka; Awata, Shuichi; Iida, Hideharu; Ishida, Yasushi; Ishizuka, Naoki; Iwasa, Hiroto; Kamei, Yuichi; Motohashi, Yutaka; Nakagawa, Atsuo; Nakamura, Jun; Nishi, Nobuyuki; Otsuka, Kotaro; Oyama, Hirofumi; Sakai, Akio; Sakai, Hironori

2008-01-01

Abstract Background To respond to the rapid surge in the incidence of suicide in Japan, which appears to be an ongoing trend, the Japanese Multimodal Intervention Trials for Suicide Prevention (J-MISP) have launched a multimodal community-based suicide prevention program, NOCOMIT-J. The primary aim of this study is to examine whether NOCOMIT-J is effective in reducing suicidal behavior in the community. Methods/DesignThis study is a community intervention trial involving seven intervention re...

Transversus abdominis plane block: A multimodal analgesia technique – Our experience

Directory of Open Access Journals (Sweden)

Deepak Dwivedi

2017-01-01

Full Text Available Context: A retrospective observational study conducted to assess transversus abdominis plane (TAP block as a tool for providing multimodal analgesia postoperatively for abdominal surgeries. Aims: The aim is to compare the visual analog scale (VAS of pain and the requirement of rescue analgesia postoperatively in patients undergoing various abdominal surgeries (open and laparoscopic where TAP block was given for postoperative analgesia and was compared with patients who received pain relief according to the institutional protocol. Settings and Design: Retrospective observational study conducted in a tertiary care hospital. Subjects and Methods: Retrospective data from anesthesia records of patients, who underwent abdominal surgeries from January 2016 to December 2016, were analyzed and were divided into two groups. Group A (n = 250 consisted of patients who received the conventional standard postoperative analgesia protocol of the department of anesthesia. Group B (n = 136 consisted of patients who were administered TAP block postsurgery for the postoperative analgesia by the trained anesthesiologist. Primary outcome considered was (i average VAS at 02, 06, 12, and 24 h and (ii average opioid/nonsteroidal anti-inflammatory drug consumption at 24 h postoperatively. Secondary outcome considered was time to first rescue analgesia. Statistical Analysis: All parametric data were analyzed using unpaired t-test. Data are expressed as the mean ± standard deviation. A SPSS version 17 (SPSS Inc., Chicago, IL, USA was used for statistical analysis. Results: Average pain scores (VAS were lower in Group B as compared to Group A in all subcategories of surgery postoperatively. Patients given TAP block (Group B required less rescue analgesia in the postoperative period with time to first rescue analgesia being prolonged. Conclusions: On the basis of our retrospective study, we suggest that TAP block can be utilized as a part of multimodal analgesia regimen for

Construction of Common Interpretive Spaces through Intertextual Loops--How Teachers Interpret Multimodal Learning Materials

Science.gov (United States)

Poyas, Yael; Eilam, Billie

2012-01-01

This study draws on several theoretical domains: intertextuality, multimodality, and the pedagogy of multiliteracies. We introduced multimodal textbook materials to eleven experienced teachers and examined, through in-depth interviews, their approach to juxtapositions of literary texts and visual artwork. Our analysis revealed (a) three attitudes…

The integration of emotional and symbolic components in multimodal communication

Directory of Open Access Journals (Sweden)

Marc eMehu

2015-07-01

Full Text Available Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g. verbal and denotative signals are well suited to transfer conceptual information, emotional components (e.g. nonverbal signals that are difficult to manipulate voluntarily likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by nonverbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals.

The integration of emotional and symbolic components in multimodal communication

Science.gov (United States)

Mehu, Marc

2015-01-01

Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals. PMID:26217280

A Novel Multimodal Biometrics Recognition Model Based on Stacked ELM and CCA Methods

Directory of Open Access Journals (Sweden)

Jucheng Yang

2018-04-01

Full Text Available Multimodal biometrics combine a variety of biological features to have a significant impact on identification performance, which is a newly developed trend in biometrics identification technology. This study proposes a novel multimodal biometrics recognition model based on the stacked extreme learning machines (ELMs and canonical correlation analysis (CCA methods. The model, which has a symmetric structure, is found to have high potential for multimodal biometrics. The model works as follows. First, it learns the hidden-layer representation of biological images using extreme learning machines layer by layer. Second, the canonical correlation analysis method is applied to map the representation to a feature space, which is used to reconstruct the multimodal image feature representation. Third, the reconstructed features are used as the input of a classifier for supervised training and output. To verify the validity and efficiency of the method, we adopt it for new hybrid datasets obtained from typical face image datasets and finger-vein image datasets. Our experimental results demonstrate that our model performs better than traditional methods.

Scenemash: multimodal route summarization for city exploration

NARCIS (Netherlands)

Berg, J. van den; Rudinac, S.; Worring, M.

2016-01-01

The potential of mining tourist information from social multimedia data gives rise to new applications offering much richer impressions of the city. In this paper we propose Scenemash, a system that generates multimodal summaries of multiple alternative routes between locations in a city. To get

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

An agent-based architecture for multimodal interaction

NARCIS (Netherlands)

Jonker, C.M.; Treur, J.; Wijngaards, W.C.A.

2001-01-01

In this paper, an executable generic process model is proposed for combined verbal and non-verbal communication processes and their interaction. The agent-based architecture can be used to create multimodal interaction. The generic process model has been designed, implemented and used to simulate

Academic Knowledge Construction and Multimodal Curriculum Development

Science.gov (United States)

Loveless, Douglas J., Ed.; Griffith, Bryant, Ed.; Bérci, Margaret E., Ed.; Ortlieb, Evan, Ed.; Sullivan, Pamela, Ed.

2014-01-01

While incorporating digital technologies into the classroom has offered new ways of teaching and learning into educational processes, it is essential to take a look at how the digital shift impacts teachers, school administration, and curriculum development. "Academic Knowledge Construction and Multimodal Curriculum Development" presents…

Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

Science.gov (United States)

Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

2015-02-28

To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P<0.001) and objective tumor response (P=0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P<0.001). Multivariate analysis identified tumor stage (P<0.001) and tumor type (P=0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P<0.001), surgical treatment (P=0.009), and multi-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

Multimodality localization of epileptic foci

Science.gov (United States)

Desco, Manuel; Pascau, Javier; Pozo, M. A.; Santos, Andres; Reig, Santiago; Gispert, Juan D.; Garcia-Barreno, Pedro

2001-05-01

This paper presents a multimodality approach for the localization of epileptic foci using PET, MRI and EEG combined without the need of external markers. Mutual Information algorithm is used for MRI-PET registration. Dipole coordinates (provided by BESA software) are projected onto the MRI using a specifically developed algorithm. The four anatomical references used for electrode positioning (nasion, inion and two preauricular points) are located on the MRI using a triplanar viewer combined with a surface-rendering tool. Geometric transformation using deformation of the ideal sphere used for dipole calculations is then applied to match the patient's brain size and shape. Eight treatment-refractory epileptic patients have been studied. The combination of the anatomical information from the MRI, hipoperfusion areas in PET and dipole position and orientation helped the physician in the diagnosis of epileptic focus location. Neurosurgery was not indicated for patients where PET and dipole results were inconsistent; in two cases it was clinically indicated despite the mismatch, showing a negative follow up. The multimodality approach presented does not require external markers for dipole projection onto the MRI, this being the main difference with previous methods. The proposed method may play an important role in the indication of surgery for treatment- refractory epileptic patients.

Multimodal transport and TransLoad facilities in Arkansas.

Science.gov (United States)

2015-01-01

National Priorities consist of building a clean and ecient 21st century : transportation sector, and Multimodal Transportation is one of ve : Transportation System Eciency strategies at the US Department of Energy. Six : locomotives co...

Impact of multimodality in reading comprehension of narrative texts in English as a foreign language (EFL in undergraduate students

Directory of Open Access Journals (Sweden)

Fernando Vera Millalén

2014-11-01

Full Text Available This research seeks to compare the effect that monomodal and multimodal tests have on the reading comprehension level of English-written narrative texts that EFL learners achieve at a private Chilean university. For this purpose, a quasi-experiment was performed, using a monomodal reading comprehension test and another multimodal one, with intact groups. The experimental group took the multimodal format test, while the control group took the monomodal format test. The interest of this research focused on the need to integrate multimodal texts in L2 reading comprehension. The results endorse the hypothesis that students reach higher comprehension levels in multimodal reading comprehension tests.

Social Context Predicts Vocalization Use in the Courtship Behaviors of Weddell Seals (Leptonychotes weddellii: A Case Study

Directory of Open Access Journals (Sweden)

Ludivine R. Russell

2016-05-01

Full Text Available Despite previous research, no study has convincingly demonstrated what role if any vocalizations might play in the reproductive behavior of Weddell seals (Leptonychotes weddellii. To better understand that role, we created an artificial territory for an adult, male Weddell seal under the shore-fast ice in McMurdo Sound, Antarctica, and recorded its in situ vocalizations and non-vocal behaviors with an underwater video camera and hydrophone while alone, with another male, and with one or more females. Additionally, we simultaneously recorded the vocalizations and non-vocal behaviors from a female interacting with the male. Analysis of 86 hr of video and audio recordings showed: 1 the male vocalized more than the female, 2 the male’s vocal repertoire was larger than the females’ repertoire, 3 vocalizations changed quantitatively and qualitatively with social context, and 4 patterns of vocalizations and non-vocal behaviors were detected with Theme, pattern recognition software from Noldus Information Technology. These results provided strong evidence that vocalizations played an important role during courtship, and together with the significant behavioral sequences, vocal and non-vocal, they provided insight into the function of their vocalizations including chirps, growls, jaw claps, knocks, mews, trills, and trills + knocks.

A Multimodal Communication Aid for Global Aphasia Patients

DEFF Research Database (Denmark)

Pedersen, Jakob Schou; Dalsgaard, Paul; Lindberg, Børge

2004-01-01

This paper presents the basic rationale behind the development and testing of a multimodal communication aid especially designed for people suffering from global aphasia, and thus having severe expressive difficulties. The principle of the aid is to trigger patient associations by presenting...... various multimodal representations of communicative expressions. The aid can in this way be seen as a conceptual continuation of previous research within the field of communication aids based on uni-modal (pictorial) representations of communicative expressions. As patients suffering from global aphasia...... expressions can be used to support patients with global aphasia in communicating by means of short sentences with their surroundings. Only a limited evaluation is carried out, and as such no statistically significant results are obtained. The tests however indicate that the aid is capable of supporting...

Alcohol sensor based on single-mode-multimode-single-mode fiber structure

Science.gov (United States)

Mefina Yulias, R.; Hatta, A. M.; Sekartedjo, Sekartedjo

2016-11-01

Alcohol sensor based on Single-mode -Multimode-Single-mode (SMS) fiber structure is being proposed to sense alcohol concentration in alcohol-water mixtures. This proposed sensor uses refractive index sensing as its sensing principle. Fabricated SMS fiber structure had 40 m of multimode length. With power input -6 dBm and wavelength 1550 nm, the proposed sensor showed good response with sensitivity 1,983 dB per % v/v with measurement range 05 % v/v and measurement span 0,5% v/v.

Feeding, social behaviour and temperature preferences in Agama ...

African Journals Online (AJOL)

Agama atra is mainly insectivorous, ants being the main food of juveniles, and larger insects that of adults. The lizards are territorial and hierarchical and perform elaborate aggressive and courtship displays on prominent rocks. In the field, routine activities commence at an air temperature of about 19°C and reach a peak at ...

Percorsi linguistici e semiotici: Critical Multimodal Analysis of Digital Discourse

OpenAIRE

edited by Ilaria Moschini

2014-01-01

The language section of LEA - edited by Ilaria Moschini - is dedicated to the Critical Multimodal Analysis of Digital Discourse, an approach that encompasses the linguistic and semiotic detailed investigation of texts within a socio-cultural perspective. It features an interview with Professor Theo van Leeuwen by Ilaria Moschini and four essays: “Retwitting, reposting, repinning; reshaping identities online: Towards a social semiotic multimodal analysis of digital remediation” by Elisabetta A...

The role of radiation therapy in multimodality treatment for renal-cell cancer

International Nuclear Information System (INIS)

Semikoz, N.G.; Kudryashov, O.G.; Ponomar'ov, V.V.; Osipenkov, R.A.; Anyishchenko, A.O.; Kudryashova, S.M.

2011-01-01

The authors report the results of multimodality treatment for renal-cell cancer (pT any, N any, M0) using pre- operative large-fraction irradiation. Our findings demonstrate that radiation therapy does not aggravate the conditions for surgery and improves long-term results. The data about efficacy of multimodality treatment (palliative nephrectomy with radiation therapy) in patients with primary metastatic kidney cancer T any, N any, M1) are also reported.

Squeezing in multi-mode nonlinear optical state truncation

International Nuclear Information System (INIS)

Said, R.S.; Wahiddin, M.R.B.; Umarov, B.A.

2007-01-01

In this Letter, we show that multi-mode qubit states produced via nonlinear optical state truncation driven by classical external pumpings exhibit squeezing condition. We restrict our discussions to the two- and three-mode cases

Going political – multimodal metaphor framings on a cover of the sports newspaper A Bola

Directory of Open Access Journals (Sweden)

Maria Clotilde Almeida

2016-12-01

Full Text Available This paper analyses a political-oriented multimodal metaphor on a cover of the sports newspaper A Bola, sequencing another study on multimodal metaphors deployed on the covers of the very same sports newspaper pertaining to the 2014 Football World Cup in Brazil (Almeida/Sousa, 2015 in the light of Forceville (2009, 2012. The fact that European politics is mapped onto football in multimodal metaphors on this sports newspaper cover draws on the interplay of conceptual metaphors, respectively in the visual mode and in the written mode. Furthermore, there is a relevant time-bound leitmotif which motivates the mapping of politics onto football in the sports newspaper A Bola, namely the upcoming football match between Portugal and Germany. In the multimodal framing of the story line under analysis. The visual mode apparently assumes preponderance, since a picture of Angela Merkel, a prominent leader of EU, is clearly overshadowed by a large picture of Cristiano Ronaldo, the captain of the Portuguese National Football team. However, the visual modality of Cristiano Ronaldo’s dominance over Angela Merkel is intertwined with the powerful metaphorical headline “Vamos expulsar a Alemanha do Euro” (“Let’s kick Germany out of the European Championship”, intended to boost the courage of the Portuguese national football team: “Go Portugal – you can win this time!”. Thus, differently from multimodal metaphors on other covers of the same newspaper, the visual modality in this case cannot be considered the dominant factor in multimodal meaning creation in this politically-oriented layout.Keywords: Multimodal Metaphors. Sports and Politics. Metaphors in Sports Newspapers.

Computer Aided Analysis of TM-Multimode Planar Graded-index Optical Waveguides

International Nuclear Information System (INIS)

Ashry, M.; Nasr, A.S.; Abou El-Fadl, A.A.

2000-01-01

An algorithm is developed for analysis TM-Multimode Planar graded-index optical waveguides. A Modified Impedance Boundary Method of Moments (MIBMOM) for the analysis of planar graded-index optical waveguide structures is presented. The algorithm is used to calculate the dispersion characteristics and the field distribution of TM-multimode planar graded-index optical waveguides. The technique is based on Galerkin s procedure and the exact boundary condition at the interfaces between the graded index region and the step index cladding. Legendre polynomials are used as basis functions. The efficiency of this algorithm is examined with waveguides having various index profiles such as exponential, Gaussian and complementary error functions. The advantage of the MIBMOM is the complete solution of TM-multimode as presented which is very difficult by the other methods. With this algorithm a minimum number of basis functions to give accurate results is used. The obtained results show good agreement with the experimental results

Magnetic Iron Oxide Nanoparticles for Multimodal Imaging and Therapy of Cancer

Directory of Open Access Journals (Sweden)

In-Kyu Park

2013-07-01

Full Text Available Superparamagnetic iron oxide nanoparticles (SPION have emerged as an MRI contrast agent for tumor imaging due to their efficacy and safety. Their utility has been proven in clinical applications with a series of marketed SPION-based contrast agents. Extensive research has been performed to study various strategies that could improve SPION by tailoring the surface chemistry and by applying additional therapeutic functionality. Research into the dual-modal contrast uses of SPION has developed because these applications can save time and effort by reducing the number of imaging sessions. In addition to multimodal strategies, efforts have been made to develop multifunctional nanoparticles that carry both diagnostic and therapeutic cargos specifically for cancer. This review provides an overview of recent advances in multimodality imaging agents and focuses on iron oxide based nanoparticles and their theranostic applications for cancer. Furthermore, we discuss the physiochemical properties and compare different synthesis methods of SPION for the development of multimodal contrast agents.

Co-constructing referential space in multimodal narratives

NARCIS (Netherlands)

Stec, Kashmiri; Huiskes, Mike

Meaning-making is a situated, multimodal process. Although most research has focused on conceptualization in individuals, recent work points to the way dynamic processes can affect both conceptualization and expression in multiple individuals (e.g. Özyürek 2002; Fusaroli and Tylén 2012; Narayan

Multimodal Dialogue Management - State of the art

NARCIS (Netherlands)

Bui Huu Trung, B.H.T.

This report is about the state of the art in dialogue management. We first introduce an overview of a multimodal dialogue system and its components. Second, four main approaches to dialogue management are described (finite-state and frame-based, information-state based and probabilistic, plan-based,

Multimodal Student Interaction Online: An Ecological Perspective

Science.gov (United States)

Berglund, Therese Ornberg

2009-01-01

This article describes the influence of tool and task design on student interaction in language learning at a distance. Interaction in a multimodal desktop video conferencing environment, FlashMeeting, is analyzed from an ecological perspective with two main foci: participation rates and conversational feedback strategies. The quantitative…

Detection of elemental mercury by multimode diode laser correlation spectroscopy.

Science.gov (United States)

Lou, Xiutao; Somesfalean, Gabriel; Svanberg, Sune; Zhang, Zhiguo; Wu, Shaohua

2012-02-27

We demonstrate a method for elemental mercury detection based on correlation spectroscopy employing UV laser radiation generated by sum-frequency mixing of two visible multimode diode lasers. Resonance matching of the multimode UV laser is achieved in a wide wavelength range and with good tolerance for various operating conditions. Large mode-hops provide an off-resonance baseline, eliminating interferences from other gas species with broadband absorption. A sensitivity of 1 μg/m3 is obtained for a 1-m path length and 30-s integration time. The performance of the system shows promise for mercury monitoring in industrial applications.

Multimodal and ubiquitous computing systems: supporting independent-living older users.

Science.gov (United States)

Perry, Mark; Dowdall, Alan; Lines, Lorna; Hone, Kate

2004-09-01

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident's home with sensors--these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications.

Generalized uncertainty relations and characteristic invariants for the multimode states

International Nuclear Information System (INIS)

Sudarshan, E.C.G.; Chiu, C.B.; Bhamathi, G.

1995-01-01

The close relationship between the zero-point energy, the uncertainty relation, coherent states, squeezed states, and correlated states for one mode is investigated. This group theoretic perspective of the problem enables the parametrization and identification of their multimode generalization. A simple and efficient method of determining the canonical structure of the generalized correlated states is presented. Implication of canonical commutation relations for correlations are not exhausted by the Heisenberg uncertainty relation, not even by the Schroedinger-Robertson uncertainty inequality, but there are relations in the multimode case that are the generalization of the Schroedinger-Robertson relation

Multimodal location estimation of videos and images

CERN Document Server

Friedland, Gerald

2015-01-01

This book presents an overview of the field of multimodal location estimation, i.e. using acoustic, visual, and/or textual cues to estimate the shown location of a video recording. The authors' sample research results in this field in a unified way integrating research work on this topic that focuses on different modalities, viewpoints, and applications. The book describes fundamental methods of acoustic, visual, textual, social graph, and metadata processing as well as multimodal integration methods used for location estimation. In addition, the text covers benchmark metrics and explores the limits of the technology based on a human baseline. ·         Discusses localization of multimedia data; ·         Examines fundamental methods of establishing location metadata for images and videos (other than GPS tagging); ·         Covers Data-Driven as well as Semantic Location Estimation.

Multi-Modal Traveler Information System - Gateway Functional Requirements

Science.gov (United States)

1997-11-17

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Context-Aware Multimodal FIDO Authenticator for Sustainable IT Services

Directory of Open Access Journals (Sweden)

Seung-Hyun Kim

2018-05-01

Full Text Available Existing sustainable IT services have several problems related to user authentication such as the inefficiency of managing the system security, low security, and low usability. In this paper, we propose a Fast IDentity Online (FIDO authenticator that performs continuous authentication with implicit authentication based on user context and multimodal authentication. The proposed FIDO authenticator, a context-aware multimodal FIDO authentication (CAMFA method, combines information such as the user context, state of the mobile device, and user biometrics, then applies implicit and explicit authentication methods to meet the level of authentication required by the service provider. This reduces the user’s explicit authentication burden and continually authenticates users at risk during the session. Moreover, it is able to respond to attacks such as the theft of the authentication method or session hijacking. To study the effectiveness of CAMFA, we ran a user study by collecting data from 22 participants over 42 days of activity on a practical Android platform. The result of the user study demonstrates that the number of explicit authentication requests could be reduced by half. Based on the results of this study, an advanced user authentication that provides multimodal and continuous authentication could be applied to sustainable IT services.

An Efficient Human Identification through MultiModal Biometric System

Directory of Open Access Journals (Sweden)

K. Meena

Full Text Available ABSTRACT Human identification is essential for proper functioning of society. Human identification through multimodal biometrics is becoming an emerging trend, and one of the reasons is to improve recognition accuracy. Unimodal biometric systems are affected by various problemssuch as noisy sensor data,non-universality, lack of individuality, lack of invariant representation and susceptibility to circumvention.A unimodal system has limited accuracy. Hence, Multimodal biometric systems by combining more than one biometric feature in different levels are proposed in order to enhance the performance of the system. A supervisor module combines the different opinions or decisions delivered by each subsystem and then make a final decision. In this paper, a multimodal biometrics authentication is proposed by combining face, iris and finger features. Biometric features are extracted by Local Derivative Ternary Pattern (LDTP in Contourlet domain and an extensive evaluation of LDTP is done using Support Vector Machine and Nearest Neighborhood Classifier. The experimental evaluations are performed on a public dataset demonstrating the accuracy of the proposed system compared with the existing systems. It is observed that, the combination of face, fingerprint and iris gives better performance in terms of accuracy, False Acceptance Rate, False Rejection Rate with minimum computation time.

Reflection effects in multimode fiber systems utilizing laser transmitters

Science.gov (United States)

Bates, Harry E.

1991-11-01

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

Effects of Multimodal Analgesia on the Success of Mouse Embryo Transfer Surgery

Science.gov (United States)

Parker, John M.; Austin, Jamie; Wilkerson, James; Carbone, Larry

2011-01-01

Multimodal analgesia is promoted as the best practice pain management for invasive animal research procedures. Universal acceptance and incorporation of multimodal analgesia requires assessing potential effects on study outcome. The focus of this study was to assess effects on embryo survival after multimodal analgesia comprising an opioid and nonsteroidal antiinflammatory drug (NSAID) compared with opioid-only analgesia during embryo transfer procedures in transgenic mouse production. Mice were assigned to receive either carprofen (5 mg/kg) with buprenorphine (0.1 mg/kg; CB) or vehicle with buprenorphine (0.1 mg/kg; VB) in a prospective, double-blinded placebo controlled clinical trial. Data were analyzed in surgical sets of 1 to 3 female mice receiving embryos chimeric for a shared targeted embryonic stem-cell clone and host blastocyst cells. A total of 99 surgical sets were analyzed, comprising 199 Crl:CD1 female mice and their 996 offspring. Neither yield (pups weaned per embryo implanted in the surgical set) nor birth rate (average number of pups weaned per dam in the set) differed significantly between the CB and VB conditions. Multimodal opioid–NSAID analgesia appears to have no significant positive or negative effect on the success of producing novel lines of transgenic mice by blastocyst transfer. PMID:21838973

Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety.

Science.gov (United States)

Biondi, Francesco; Strayer, David L; Rossi, Riccardo; Gastaldi, Massimiliano; Mulatti, Claudio

2017-01-01

This study investigated whether multimodal redundant warnings presented by advanced assistance systems reduce brake response times. Warnings presented by assistance systems are designed to assist drivers by informing them that evasive driving maneuvers are needed in order to avoid a potential accident. If these warnings are poorly designed, they may distract drivers, slow their responses, and reduce road safety. In two experiments, participants drove a simulated vehicle equipped with a forward collision avoidance system. Auditory, vibrotactile, and multimodal warnings were presented when the time to collision was shorter than five seconds. The effects of these warnings were investigated with participants performing a concurrent cell phone conversation (Exp. 1) or driving in high-density traffic (Exp. 2). Braking times and subjective workload were measured. Multimodal redundant warnings elicited faster braking reaction times. These warnings were found to be effective even when talking on a cell phone (Exp. 1) or driving in dense traffic (Exp. 2). Multimodal warnings produced higher ratings of urgency, but ratings of frustration did not increase compared to other warnings. Findings obtained in these two experiments are important given that faster braking responses may reduce the potential for a collision. Copyright © 2016 Elsevier Ltd. All rights reserved.

Fish and robot dancing together: bluefin killifish females respond differently to the courtship of a robot with varying color morphs.

Science.gov (United States)

Phamduy, P; Polverino, G; Fuller, R C; Porfiri, M

2014-09-01

The experimental integration of bioinspired robots in groups of social animals has become a valuable tool to understand the basis of social behavior and uncover the fundamental determinants of animal communication. In this study, we measured the preference of fertile female bluefin killifish (Lucania goodei) for robotic replicas whose aspect ratio, body size, motion pattern, and color morph were inspired by adult male killifish. The motion of the fish replica was controlled via a robotic platform, which simulated the typical courtship behavior observed in killifish males. The positional preferences of females were measured for three different color morphs (red, yellow, and blue). While variation in preference was high among females, females tend to spend more time in the vicinity of the yellow painted robot replicas. This preference may have emerged because the yellow robot replicas were very bright, particularly in the longer wavelengths (550–700 nm) compared to the red and blue replicas. These findings are in agreement with previous observations in mosquitofish and zebrafish on fish preference for artificially enhanced yellow pigmentation.

Fish and robot dancing together: bluefin killifish females respond differently to the courtship of a robot with varying color morphs

International Nuclear Information System (INIS)

Phamduy, P; Polverino, G; Porfiri, M; Fuller, R C

2014-01-01

The experimental integration of bioinspired robots in groups of social animals has become a valuable tool to understand the basis of social behavior and uncover the fundamental determinants of animal communication. In this study, we measured the preference of fertile female bluefin killifish (Lucania goodei) for robotic replicas whose aspect ratio, body size, motion pattern, and color morph were inspired by adult male killifish. The motion of the fish replica was controlled via a robotic platform, which simulated the typical courtship behavior observed in killifish males. The positional preferences of females were measured for three different color morphs (red, yellow, and blue). While variation in preference was high among females, females tend to spend more time in the vicinity of the yellow painted robot replicas. This preference may have emerged because the yellow robot replicas were very bright, particularly in the longer wavelengths (550–700 nm) compared to the red and blue replicas. These findings are in agreement with previous observations in mosquitofish and zebrafish on fish preference for artificially enhanced yellow pigmentation. (paper)

European display scene

Science.gov (United States)

Bartlett, Christopher T.

2000-08-01

The manufacture of Flat Panel Displays (FPDs) is dominated by Far Eastern sources, particularly in Active Matrix Liquid Crystal Displays (AMLCD) and Plasma. The United States has a very powerful capability in micro-displays. It is not well known that Europe has a very active research capability which has lead to many innovations in display technology. In addition there is a capability in display manufacturing of organic technologies as well as the licensed build of Japanese or Korean designs. Finally, Europe has a display systems capability in military products which is world class.

Effect of display location on control-display stereotype strength for translational and rotational controls with linear displays.

Science.gov (United States)

Chan, Alan H S; Hoffmann, Errol R

2015-01-01

Experiments were designed to investigate the effects of control type and display location, relative to the operator, on the strength of control/display stereotypes. The Worringham and Beringer Visual Field principle and an extension of this principle for rotary controls (Hoffmann E.R., and Chan A.H.S. 2013). "The Worringham and Beringer 'Visual Field' Principle for Rotary Controls. Ergonomics." 56 (10): 1620-1624) indicated that, for a number of different control types (rotary and lever) on different planes, there should be no significant effect of the display location relative to the seated operator. Past data were surveyed and stereotype strengths listed. Experiments filled gaps where data are not available. Six different control types and seven display locations were used, as in the Frame of Reference Transformation Tool (FORT) model of Wickens et al. (Wickens, C.D., Keller, J.W., and Small, R.L. (2010). "Left. No, Right! Development of the Frame of Reference Transformation Tool (FORT)." Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting September 2010, 54: 1022-1026). Control/display arrangements with high stereotype strengths were evaluated yielding data for designers of complex control/display arrangements where the control and display are in different planes and for where the operator is moving. It was found possible to predict display/control arrangements with high stereotype strength, based on past data. Practitioner Summary: Controls and displays in complex arrangements need to have high compatibility. These experiments provide arrangements for six different controls (rotary and translational) and seven different display locations relative to the operator.

Influence of Blood Contamination During Multimode Adhesive ...

African Journals Online (AJOL)

Objectives: The present study evaluated the effects of blood contamination performed at different steps of bonding on the microtensile bond strength (μTBS) of multimode adhesives to dentin when using the self-etch approach. Materials and Methods: Seventy-five molars were randomly assigned to three adhesive groups ...

Meaning Making through Multiple Modalities in a Biology Classroom: A Multimodal Semiotics Discourse Analysis

Science.gov (United States)

Jaipal, Kamini

2010-01-01

The teaching of science is a complex process, involving the use of multiple modalities. This paper illustrates the potential of a multimodal semiotics discourse analysis framework to illuminate meaning-making possibilities during the teaching of a science concept. A multimodal semiotics analytical framework is developed and used to (1) analyze the…

Displays in scintigraphy

International Nuclear Information System (INIS)

Todd-Pokropek, A.E.; Pizer, S.M.

1977-01-01

Displays have several functions: to transmit images, to permit interaction, to quantitate features and to provide records. The main characteristics of displays used for image transmission are their resolution, dynamic range, signal-to-noise ratio and uniformity. Considerations of visual acuity suggest that the display element size should be much less than the data element size, and in current practice at least 256X256 for a gamma camera image. The dynamic range for image transmission should be such that at least 64 levels of grey (or equivalent) are displayed. Scanner displays are also considered, and in particular, the requirements of a whole-body camera are examined. A number of display systems and devices are presented including a 'new' heated object colour display system. Interaction with displays is considered, including background subtraction, contrast enhancement, position indication and region-of-interest generation. Such systems lead to methods of quantitation, which imply knowledge of the expected distributions. Methods for intercomparing displays are considered. Polaroid displays, which have for so long dominated the field, are in the process of being replaced by stored image displays, now that large cheap memories exist which give an equivalent image quality. The impact of this in nuclear medicine is yet to be seen, but a major effect will be to enable true quantitation. (author)

Compact Spectrometer based on a silicon multimode waveguide

DEFF Research Database (Denmark)

Piels, Molly; Zibar, Darko

2017-01-01

A multimode waveguide spectrometer with 4 GHz resolution, 250 GHz usable range, and a 1.6 mm × 2.1 mm footprint is demonstrated. The operating range is greatly extended by including distinct mode-exciting elements on chip....

Implementation and flight-test of a multi-mode rotorcraft flight-control system for single-pilot use in poor visibility

Science.gov (United States)

Hindson, William S.

1987-01-01

A flight investigation was conducted to evaluate a multi-mode flight control system designed according to the most recent recommendations for handling qualities criteria for new military helicopters. The modes and capabilities that were included in the system are those considered necessary to permit divided-attention (single-pilot) lowspeed and hover operations near the ground in poor visibility conditions. Design features included mode-selection and mode-blending logic, the use of an automatic position-hold mode that employed precision measurements of aircraft position, and a hover display which permitted manually-controlled hover flight tasks in simulated instrument conditions. Pilot evaluations of the system were conducted using a multi-segment evaluation task. Pilot comments concerning the use of the system are provided, and flight-test data are presented to show system performance.

Frequency tripling with multimode-lasers

International Nuclear Information System (INIS)

Langer, H.; Roehr, H.; Wrobel, W.G.

1978-10-01

The presence of different modes with random phases in a laser beam leads to fluctuations in nonlinear optical interactions. This paper describes the influence of the linewidth of a dye laser on the generation of intensive Lyman-alpha radiation by frequency tripling. Using this Lyman-alpha source for resonance scattering on strongly doppler-broadened lines in fusion plasmas the detection limit of neutral hydrogen is nearly two orders higher with the multimode than the singlemode dye laser. (orig.) [de

Multimode polymer waveguides for high-speed optical interconnects

Science.gov (United States)

Bamiedakis, N.; Ingham, J. D.; Penty, R. V.; White, I. H.; DeGroot, J. V.; Clapp, T. V.

2017-11-01

Polymeric multimode waveguides are of particular interest for optical interconnections in short-reach data links. In some applications, for example in space-borne systems, the use of advanced materials with outstanding performance in extreme environments is required (temperature and radiation). In this paper therefore, we present novel siloxane polymers suitable for these applications. The materials are used to form straight, 90° bent and spiral polymer waveguides by low-cost conventional photolithographic techniques on FR4 substrates. The samples have been tested to investigate their propagation characteristics and demonstrate their potential for high-speed data links. Overall, there is strong evidence that these multimode waveguides can be successfully employed as high-speed short-reach data links. Their excellent thermal properties, their low cost and the simple fabrication process indicate their suitability for a wide range of space applications.

Effectiveness of a Multimodal Therapy for Patients with Chronic Low Back Pain Regarding Pre-Admission Healthcare Utilization

Science.gov (United States)

Borys, Constanze; Lutz, Johannes; Strauss, Bernhard; Altmann, Uwe

2015-01-01

Objective The aim of the study was to examine the effectiveness of an intensive inpatient three-week multimodal therapy. We focused especially on the impact on the multimodal therapy outcome of the pre-admission number of treatment types patients had received and of medical specialist groups patients had consulted. Methods 155 patients with chronic low back pain and indication for multimodal therapy were evaluated with respect to pain intensity, depression, anxiety, well-being, and pre-admission health care utilization. In our controlled clinical trial we compared N = 66 patients on the waiting list with N = 89 patients who received immediate treatment. The waiting list patients likewise attended multimodal therapy after the waiting period. Longitudinal post-treatment data for both were collected at three- and twelve-month follow-ups. The impact of pre-admission health care utilization on multimodal therapy outcome (post) was analysed by structural equation model. Results Compared to the control group, multimodal therapy patients’ pain intensity and psychological variables were significantly reduced. Longitudinal effects with respect to pre-measures were significant at three-month follow-up for pain intensity (ES = -0.48), well-being (ES = 0.78), anxiety (ES = -0.33), and depression (ES = -0.30). Effect sizes at twelve-month follow-up were small for anxiety (ES = -0.22), and moderate for general well-being (ES = 0.61). Structural equation model revealed that a higher number of pre-admission treatment types was associated with poorer post-treatment outcomes in pain intensity, well-being, and depression. Conclusion Multimodal therapy proved to be effective with regard to improvements in pain intensity, depression, anxiety, and well-being. The association between treatment effect and number of pre-admission pain treatment types suggests that patients would benefit more from attending multimodal therapy in an earlier stage of health care. PMID:26599232

Development of comprehensive image processing technique for differential diagnosis of liver disease by using multi-modality images. Pixel-based cross-correlation method using a profile

International Nuclear Information System (INIS)

Inoue, Akira; Okura, Yasuhiko; Akiyama, Mitoshi; Ishida, Takayuki; Kawashita, Ikuo; Ito, Katsuyoshi; Matsunaga, Naofumi; Sanada, Taizo

2009-01-01

Imaging techniques such as high magnetic field imaging and multidetector-row CT have been markedly improved recently. The final image-reading systems easily produce more than a thousand diagnostic images per patient. Therefore, we developed a comprehensive cross-correlation processing technique using multi-modality images, in order to decrease the considerable time and effort involved in the interpretation of a radiogram (multi-formatted display and/or stack display method, etc). In this scheme, the criteria of an attending radiologist for the differential diagnosis of liver cyst, hemangioma of liver, hepatocellular carcinoma, and metastatic liver cancer on magnetic resonance images with various sequences and CT images with and without contrast enhancement employ a cross-correlation coefficient. Using a one-dimensional cross-correlation method, comprehensive image processing could be also adapted for various artifacts (some depending on modality imaging, and some on patients), which may be encountered at the clinical scene. This comprehensive image-processing technique could assist radiologists in the differential diagnosis of liver diseases. (author)

Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox

Directory of Open Access Journals (Sweden)

Andre Santos Ribeiro

2015-07-01

Full Text Available Aim. In recent years, connectivity studies using neuroimaging data have increased the understanding of the organization of large-scale structural and functional brain networks. However, data analysis is time consuming as rigorous procedures must be assured, from structuring data and pre-processing to modality specific data procedures. Until now, no single toolbox was able to perform such investigations on truly multimodal image data from beginning to end, including the combination of different connectivity analyses. Thus, we have developed the Multimodal Imaging Brain Connectivity Analysis (MIBCA toolbox with the goal of diminishing time waste in data processing and to allow an innovative and comprehensive approach to brain connectivity.Materials and Methods. The MIBCA toolbox is a fully automated all-in-one connectivity toolbox that offers pre-processing, connectivity and graph theoretical analyses of multimodal image data such as diffusion-weighted imaging, functional magnetic resonance imaging (fMRI and positron emission tomography (PET. It was developed in MATLAB environment and pipelines well-known neuroimaging softwares such as Freesurfer, SPM, FSL, and Diffusion Toolkit. It further implements routines for the construction of structural, functional and effective or combined connectivity matrices, as well as, routines for the extraction and calculation of imaging and graph-theory metrics, the latter using also functions from the Brain Connectivity Toolbox. Finally, the toolbox performs group statistical analysis and enables data visualization in the form of matrices, 3D brain graphs and connectograms. In this paper the MIBCA toolbox is presented by illustrating its capabilities using multimodal image data from a group of 35 healthy subjects (19–73 years old with volumetric T1-weighted, diffusion tensor imaging, and resting state fMRI data, and 10 subjets with 18F-Altanserin PET data also.Results. It was observed both a high inter

Cortical inter-hemispheric circuits for multimodal vocal learning in songbirds.

Science.gov (United States)

Paterson, Amy K; Bottjer, Sarah W

2017-10-15

Vocal learning in songbirds and humans is strongly influenced by social interactions based on sensory inputs from several modalities. Songbird vocal learning is mediated by cortico-basal ganglia circuits that include the SHELL region of lateral magnocellular nucleus of the anterior nidopallium (LMAN), but little is known concerning neural pathways that could integrate multimodal sensory information with SHELL circuitry. In addition, cortical pathways that mediate the precise coordination between hemispheres required for song production have been little studied. In order to identify candidate mechanisms for multimodal sensory integration and bilateral coordination for vocal learning in zebra finches, we investigated the anatomical organization of two regions that receive input from SHELL: the dorsal caudolateral nidopallium (dNCL SHELL ) and a region within the ventral arcopallium (Av). Anterograde and retrograde tracing experiments revealed a topographically organized inter-hemispheric circuit: SHELL and dNCL SHELL , as well as adjacent nidopallial areas, send axonal projections to ipsilateral Av; Av in turn projects to contralateral SHELL, dNCL SHELL , and regions of nidopallium adjacent to each. Av on each side also projects directly to contralateral Av. dNCL SHELL and Av each integrate inputs from ipsilateral SHELL with inputs from sensory regions in surrounding nidopallium, suggesting that they function to integrate multimodal sensory information with song-related responses within LMAN-SHELL during vocal learning. Av projections share this integrated information from the ipsilateral hemisphere with contralateral sensory and song-learning regions. Our results suggest that the inter-hemispheric pathway through Av may function to integrate multimodal sensory feedback with vocal-learning circuitry and coordinate bilateral vocal behavior. © 2017 Wiley Periodicals, Inc.

Monocular display unit for 3D display with correct depth perception

Science.gov (United States)

Sakamoto, Kunio; Hosomi, Takashi

2009-11-01

A study of virtual-reality system has been popular and its technology has been applied to medical engineering, educational engineering, a CAD/CAM system and so on. The 3D imaging display system has two types in the presentation method; one is a 3-D display system using a special glasses and the other is the monitor system requiring no special glasses. A liquid crystal display (LCD) recently comes into common use. It is possible for this display unit to provide the same size of displaying area as the image screen on the panel. A display system requiring no special glasses is useful for a 3D TV monitor, but this system has demerit such that the size of a monitor restricts the visual field for displaying images. Thus the conventional display can show only one screen, but it is impossible to enlarge the size of a screen, for example twice. To enlarge the display area, the authors have developed an enlarging method of display area using a mirror. Our extension method enables the observers to show the virtual image plane and to enlarge a screen area twice. In the developed display unit, we made use of an image separating technique using polarized glasses, a parallax barrier or a lenticular lens screen for 3D imaging. The mirror can generate the virtual image plane and it enlarges a screen area twice. Meanwhile the 3D display system using special glasses can also display virtual images over a wide area. In this paper, we present a monocular 3D vision system with accommodation mechanism, which is useful function for perceiving depth.

Multimodal imaging in health, disease, and man-made disasters

International Nuclear Information System (INIS)

Papineni, Rao V.L.

2012-01-01

Significant advances in the fields of molecular and functional imaging are rapidly emerging as potential advance research tools in health, Disease and drug discovery. Notable are the approaches utilizing multi-modal imaging strategies in preclinical studies that are becoming extremely useful in assessing the efficacy of the novel target molecules. This talk will focus on our efforts in bringing the multimodality to preclinical research with Optical, X-ray, and noninvasive nuclear imaging. The concepts and methods in molecular imaging to support drug targeting and drug discovery will be discussed along with a focus on its utilization in radiation induced changes in the bone physiology. Also, will discuss how such approaches can be employed in future as a biodosimetry for radiation disasters or in radiation threat. (author)

Pervasive Technologies and the Paradoxes of Multimodal Digital Communication

Directory of Open Access Journals (Sweden)

Sandra Petroni

2014-12-01

Full Text Available Contemporary societies are greatly challenged by paradoxes in all facets of life. Digital communication encodes and produces meaning by making use of these contradictory relations. In this contribution, three digital paradoxes will be presented. The first paradox is grounded in the process of remediation in digital settings which mirrors a contradictory double logic. Digital culture, in fact, wants both to multiply its media and to eliminate all traces of mediation. The second antinomy has its origins in the new concept of linguistic entropy: a structured information disorder that is regulated by usability and multimodality. In accordance with the second paradox, the third one stems from further processes that are framing, a multimodal resource, and linking, a hypertextual resource.

Performance characterization of the IEEE 802.11 signal transmission over a multimode fiber PON

Science.gov (United States)

Maksymiuk, L.; Siuzdak, J.

2014-11-01

In this paper there are presented measurements concerning performance analysis of the IEEE 802.11 signal distribution over multimode fiber based passive optical network. In the paper there are addressed three main sources of impairments: modal noise, frequency response fluctuation of the multimode fiber and non-linear distortion of the signal in the receiver.

Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

Science.gov (United States)

Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

2013-09-01

Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit

Multimodal compared to pharmacologic treatments for chronic tension-type headache in adolescents.

Science.gov (United States)

Przekop, Peter; Przekop, Allison; Haviland, Mark G

2016-10-01

Chronic tension-type headache (CTTH) in children and adolescents is a serious medical condition, with considerable morbidity and few effective, evidence-based treatments. We performed a chart review of 83 adolescents (age range = 13-18 years; 67 girls and 16 boys) diagnosed with CTTH. Two treatment protocols were compared: multimodal (osteopathic manipulative treatments, mindfulness, and qi gong) and pharmacologic (amitriptyline or gabapentin). Four outcomes (headache frequency, pain intensity, general health, and health interference) were assessed at three time points (baseline, 3 months, and 6 months). A fifth outcome, number of bilateral tender points, was recorded at baseline and 6 months. All five were evaluated statistically with a linear mixed model. Although both multimodal and pharmacologic treatments were effective for CTTH (time effects for all measures were significant at p treatment (the five group by time interaction effects were significant at or below the p Headache frequency in the pharmacologic group, for example, reduced from a monthly average (95% Confidence Interval shown in parentheses) of 23.9 (21.8, 26.0) to 16.4 (14.3, 18.6) and in the multimodal group from 22.3 (20.1, 24.5) to 4.9 (2.6, 7.2) (a substantial group difference). Pain intensity (worst in the last 24 hours, 0-10 scale) was reduced in the pharmacologic group from 6.2 (5.6, 6.9) to 3.4 (2.7, 4.1) and from 6.1 (5.4, 6.8) to 2.0 (1.2, 2.7) in the multimodal group (a less substantial difference). Across the other three assessments, group differences were larger for general health and number of tender points and less so for pain restriction. Multimodal treatment for adolescent CTTH appears to be effective. Randomized controlled trials are needed to confirm these promising results. Copyright © 2015 Elsevier Ltd. All rights reserved.

Recent Progress in Synthesis and Functionalization of Multimodal Fluorescent-Magnetic Nanoparticles for Biological Applications

Directory of Open Access Journals (Sweden)

Raquel Serrano García

2018-01-01

Full Text Available There is a great interest in the development of new nanomaterials for multimodal imaging applications in biology and medicine. Multimodal fluorescent-magnetic based nanomaterials deserve particular attention as they can be used as diagnostic and drug delivery tools, which could facilitate the diagnosis and treatment of cancer and many other diseases. This review focuses on the recent developments of magnetic-fluorescent nanocomposites and their biomedical applications. The recent advances in synthetic strategies and approaches for the preparation of fluorescent-magnetic nanocomposites are presented. The main biomedical uses of multimodal fluorescent-magnetic nanomaterials, including biological imaging, cancer therapy and drug delivery, are discussed, and prospects of this field are outlined.

Multimodal route choice models of public transport passengers in the Greater Copenhagen Area

DEFF Research Database (Denmark)

Anderson, Marie Karen; Nielsen, Otto Anker; Prato, Carlo Giacomo

2014-01-01

Understanding route choice behavior is crucial to explain travelers’ preferences and to predict traffic flows under different scenarios. A growing body of literature has concentrated on public transport users without, however, concentrating on multimodal public transport networks because......,641 public transport users in the Greater Copenhagen Area.A two-stage approach consisting of choice set generation and route choice model estimation allowed uncovering the preferences of the users of this multimodal large-scale public transport network. The results illustrate the rates of substitution...... not only of the in-vehicle times for different public transport modes, but also of the other time components (e.g., access, walking, waiting, transfer) composing the door-to-door experience of using a multimodal public transport network, differentiating by trip length and purpose, and accounting...

MULTIMODAL ANALGESIA AFTER TOTAL HIP ARTHROPLASTY

Directory of Open Access Journals (Sweden)

I. G. Mukutsa

2012-01-01

Full Text Available Purpose - to assess the effect of multimodal analgesia in the early rehabilitation of patients after hip replacement. Materials and methods. A prospective single-centre randomized research, which included 32 patients. Patients of the 1st group received paracetamol, ketorolac and tramadol, the 2nd group of patients - ketorolac intravenously and the 3rd group of patients - etoricoxib and gabapentin. Patients of the 2nd and the 3rd groups underwent epidural analgesia with ropivacaine. Multimodal analgesia was carried out for 48 hours after the surgery. Assessment of pain intensity was performed by the VAS (visual analogue scale, a neuropathic pain component - on the DN4 questionnaire . Time was recorded during the first and second verticalization of patients, using the distance walkers and by fixing the distance covered with in 2 minutes. Results. The intensity of pain for more than 50 mm on VAS at movement at least once every 48 hours after the surgery was occurred among 9% of the 1st group, 22% of patients from the 2nd group and 8% of patients of the 3rd group. Number of patients with neuropathic pain component decreased from 25% to 3% (p ≤ 0.05. The first verticalization was performed 10 ± 8 hours after the surgery, the second - 21 ± 8 hours later. Two-minute walk distance was 5 ± 3 and 8 ± 4 m, respectively. It is noted more frequent adverse events in patients of the 1st group was noted compared to patients of the 2nd and the 3rd groups during first (91%, 33% and 25%, p ≤ 0.05 and the second verticalization (70%, 25% and 17%, p ≤ 0.05. Multimodal analgesia allows to proceed with the successful activation of patients after hip replacement with in the first day after the surgery. The 3rd group patients are noted with a tendency for the optimal combination of efficient and safe of analgetic therapy.

Costs of female odour in males of the parasitic wasp Lariophagus distinguendus (Hymenoptera: Pteromalidae)

Science.gov (United States)

Ruther, Joachim; Steiner, Sven

2008-06-01

The display of female traits by males is widespread in the animal kingdom. In several species, this phenomenon has been shown to function adaptively as a male mating strategy to deceive sexual rivals (female mimicry). Freshly emerged males of the parasitic wasp Lariophagus distinguendus (Hymenoptera: Pteromalidae) are perceived by other males as if they were females because of a very similar composition of cuticular hydrocarbons which function as a sex pheromone in this species inducing courtship behaviour in males. Within 32 h, however, males deactivate the pheromone and are no longer courted by other males. In this paper, behavioural experiments were performed to test hypotheses on potential costs and benefits associated with the female odour in young males. We did not find any benefits, but demonstrated that young males were significantly more often outrivaled in male-male contests when competing with two older males for a female. Also, young males were significantly more often mounted in homosexual courtship events during these contests. Thus, display of female traits by males is not necessarily beneficial, and in fact, can be disadvantageous. We suggest that these costs have favoured the evolution of the pheromone deactivation mechanism in L. distinguendus males. The function of cuticular hydrocarbons as a female courtship pheromone in L. distinguendus might have evolved secondarily from a primary function relevant for both genders, and the deactivation of the signal in males might have caused a shift of specificity of the chemical signal from the species level to the sex level.

Coherent multimoded dielectric wakefield accelerators

International Nuclear Information System (INIS)

Power, J.

1998-01-01

There has recently been a study of the potential uses of multimode dielectric structures for wakefield acceleration [1]. This technique is based on adjusting the wakefield modes of the structure to constructively interfere at certain delays with respect to the drive bunch, thus providing an accelerating gradient enhancement over single mode devices. In this report we examine and attempt to clarify the issues raised by this work in the light of the present state of the art in wakefield acceleration

Conservative multimodal management of a primitive neuroectodermal tumor of the thyroid

Directory of Open Access Journals (Sweden)

Juliette Haudebourg

2013-04-01

Full Text Available Primitive neuroectodermal tumors (PNET represent 1% of sarcomas. Head and neck peripheral PNETs have an intermediate prognosis between abdominopelvic disease and extremities. We here report the case of a 40-year old male who presented with primitive neuroectodermal tumor of the thyroid and was treated by multimodal treatment, including surgery, chemotherapy and intermediate dose radiotherapy. The patient is alive and fit with a functional larynx at 27 months. Multimodal treatments yield five-year survival rates of about 60%. Major drug regimens use vincristine, doxorubicin, ifosfamide or cyclophosphamide, dactinomycin and/or etoposide. Complete surgical excision is undertaken whenever possible to improve long-term survival. However, the relative radiosensitivity of tumors of the Ewing family, suggest multimodal treatment including adjuvant conformal radiotherapy in case of positive margins or poor response to chemotherapy rather than resection with 2-3 cm margins, which would imply laryngeal sacrifice for thyroid tumors. The role of expert rare tumor networks is crucial for optimal decision-making and management of such rare tumors on a case by case basis.

Recommendations on nuclear and multimodality imaging in IE and CIED infections.

Science.gov (United States)

Erba, Paola Anna; Lancellotti, Patrizio; Vilacosta, Isidre; Gaemperli, Oliver; Rouzet, Francois; Hacker, Marcus; Signore, Alberto; Slart, Riemer H J A; Habib, Gilbert

2018-05-24

In the latest update of the European Society of Cardiology (ESC) guidelines for the management of infective endocarditis (IE), imaging is positioned at the centre of the diagnostic work-up so that an early and accurate diagnosis can be reached. Besides echocardiography, contrast-enhanced CT (ce-CT), radiolabelled leucocyte (white blood cell, WBC) SPECT/CT and [ 18 F]FDG PET/CT are included as diagnostic tools in the diagnostic flow chart for IE. Following the clinical guidelines that provided a straightforward message on the role of multimodality imaging, we believe that it is highly relevant to produce specific recommendations on nuclear multimodality imaging in IE and cardiac implantable electronic device infections. In these procedural recommendations we therefore describe in detail the technical and practical aspects of WBC SPECT/CT and [ 18 F]FDG PET/CT, including ce-CT acquisition protocols. We also discuss the advantages and limitations of each procedure, specific pitfalls when interpreting images, and the most important results from the literature, and also provide recommendations on the appropriate use of multimodality imaging.

Multimodality: a way to cope with road traffic noise? The case of European treefrog (Hyla arborea).

Science.gov (United States)

Troïanowski, Mathieu; Melot, Geoffrey; Lengagne, Thierry

2014-09-01

In the last decades, traffic noise has become a new challenge for efficient animal communication and several studies suggest that it is involved in population declines. Although poorly investigated in a traffic noise context, communication is generally multimodal, which can be viewed as a way to improve communication efficiency by allowing shift from a sensory modality to another when one modality suffers from noise. In the present study, we investigated multimodal shift in the European treefrog (Hyla arborea), a species using both acoustic and visual cues during male quality assessment task performed by females. Females were used in a discrimination task in two environmental conditions: with or without traffic noise. In traffic noise conditions, we showed that females' reliance on acoustic signal embedded in noise pollution did not decrease in favour of visual signals, therefore showing that females do not shift between modalities in response to traffic noise. Although, we did not evidence multimodal shift in our study, many species facing traffic noise present multimodal communication, and should be investigated to evaluate the importance of multimodal shift as a way to cope with traffic noise pollution. Copyright © 2014 Elsevier B.V. All rights reserved.

Early recovery after abdominal rectopexy with multimodal rehabilitation

DEFF Research Database (Denmark)

Basse, Linda; Billesbølle, Per; Kehlet, Henrik

2002-01-01

status III to IV, were scheduled for abdominal rectopexy with a multimodal rehabilitation program including 48 hours thoracic epidural analgesia or patient-controlled anesthesia (3 patients), early oral nutrition and mobilization, and a planned two-day postoperative hospital stay. Follow-up was done...

OAM-enhanced transmission for multimode short-range links

DEFF Research Database (Denmark)

Tatarczak, Anna; Usuga Castaneda, Mario A.; Tafur Monroy, Idelfonso

2015-01-01

We propose, experimentally demonstrate, and evaluate the performance of a multimode (MM) transmission fiber data link which is based on orbital angular momentum (OAM) modes. The proposed scheme uses OAM modes to increase capacity or reach without recurring to mode division multiplexing (MDM...

Multimodal interaction design in collocated mobile phone use

NARCIS (Netherlands)

El-Ali, A.; Lucero, A.; Aaltonen, V.

2011-01-01

In the context of the Social and Spatial Interactions (SSI) platform, we explore how multimodal interaction design (input and output) can augment and improve the experience of collocated, collaborative activities using mobile phones. Based largely on our prototype evaluations, we reflect on and

Design of multimodal transport networks : A hierarchical approach

NARCIS (Netherlands)

Van Nes, R.

2002-01-01

Multimodal transport, that is using two or more transport modes for a trip between which a transfer is necessary, seems an interesting approach to solving today's transportation problems with respect to the deteriorating accessibility of city centres, recurrent congestion, and environmental impact.

Multimodality treatment strategies have changed prognosis of peritoneal metastases

Science.gov (United States)

Lungoci, Corneliu; Mironiuc, Aurel Ion; Muntean, Valentin; Oniu, Traian; Leebmann, Hubert; Mayr, Max; Piso, Pompiliu

2016-01-01

For a long time, treatment of peritoneal metastases (PM) was mostly palliative and thus, this status was link with “terminal status/despair”. The current multimodal treatment strategy, consisting of cytoreductive surgery (CRS) and hyperthermic intraperitoneal chemotherapy (HIPEC), has been strenuously achieved over time, but seems to be the best treatment option for PM patients. As we reviewed the literature data, we could emphasize some milestones and also, controversies in the history of proposed multimodal treatment and thus, outline the philosophy of this approach, which seems to be an unusual one indeed. Initially marked by nihilism and fear, but benefiting from a remarkable joint effort of human and material resources (multi-center and -institutional research), over a period of 30 years, CRS and HIPEC found their place in the treatment of PM. The next 4 years were dedicated to the refinement of the multimodal treatment, by launching research pathways. In selected patients, with requires training, it demonstrated a significant survival results (similar to the Hepatic Metastases treatment), with acceptable risks and costs. The main debates regarding CRS and HIPEC treatment were based on the oncologists’ perspective and the small number of randomized clinical trials. It is important to statement the PM patient has the right to be informed of the existence of CRS and HIPEC, as a real treatment resource, the decision being made by multidisciplinary teams. PMID:26798438

Exploring the requirements for multimodal interaction for mobile devices in an end-to-end journey context.

Science.gov (United States)

Krehl, Claudia; Sharples, Sarah

2012-01-01

The paper investigates the requirements for multimodal interaction on mobile devices in an end-to-end journey context. Traditional interfaces are deemed cumbersome and inefficient for exchanging information with the user. Multimodal interaction provides a different user-centred approach allowing for more natural and intuitive interaction between humans and computers. It is especially suitable for mobile interaction as it can overcome additional constraints including small screens, awkward keypads, and continuously changing settings - an inherent property of mobility. This paper is based on end-to-end journeys where users encounter several contexts during their journeys. Interviews and focus groups explore the requirements for multimodal interaction design for mobile devices by examining journey stages and identifying the users' information needs and sources. Findings suggest that multimodal communication is crucial when users multitask. Choosing suitable modalities depend on user context, characteristics and tasks.

Improved multimodal biomarkers for Alzheimer's disease and mild cognitive impairment diagnosis: data from ADNI

Science.gov (United States)

Martinez-Torteya, Antonio; Treviño-Alvarado, Víctor; Tamez-Peña, José

2013-02-01

The accurate diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI) confers many clinical research and patient care benefits. Studies have shown that multimodal biomarkers provide better diagnosis accuracy of AD and MCI than unimodal biomarkers, but their construction has been based on traditional statistical approaches. The objective of this work was the creation of accurate AD and MCI diagnostic multimodal biomarkers using advanced bioinformatics tools. The biomarkers were created by exploring multimodal combinations of features using machine learning techniques. Data was obtained from the ADNI database. The baseline information (e.g. MRI analyses, PET analyses and laboratory essays) from AD, MCI and healthy control (HC) subjects with available diagnosis up to June 2012 was mined for case/controls candidates. The data mining yielded 47 HC, 83 MCI and 43 AD subjects for biomarker creation. Each subject was characterized by at least 980 ADNI features. A genetic algorithm feature selection strategy was used to obtain compact and accurate cross-validated nearest centroid biomarkers. The biomarkers achieved training classification accuracies of 0.983, 0.871 and 0.917 for HC vs. AD, HC vs. MCI and MCI vs. AD respectively. The constructed biomarkers were relatively compact: from 5 to 11 features. Those multimodal biomarkers included several widely accepted univariate biomarkers and novel image and biochemical features. Multimodal biomarkers constructed from previously and non-previously AD associated features showed improved diagnostic performance when compared to those based solely on previously AD associated features.

Multidimensional and Multimodal Separations by HPTLC in Phytochemistry

Science.gov (United States)

Ciesla, Lukasz; Waksmundzka-Hajnos, Monika

HPTLC is one of the most widely applied methods in phytochemical analysis. It is due to its numerous advantages, e.g., it is the only chromatographic method offering the option of presenting the results as an image. Other advantages include simplicity, low costs, parallel analysis of samples, high sample capacity, rapidly obtained results, and possibility of multiple detection. HPTLC provides identification as well as quantitative results. It also enables the identification of adulterants. In case of complex samples, the resolving power of traditional one-dimensional chromatography is usually inadequate, hence special modes of development are required. Multidimensional and multimodal HPTLC techniques include those realized in one direction (UMD, IMD, GMD, BMD, AMD) as well as typical two-dimensional methods realized on mono- or bi-layers. In this manuscript, an overview on variable multidimensional and multimodal methods, applied in the analysis of phytochemical samples, is presented.

Facial Emotion Recognition Using Context Based Multimodal Approach

Directory of Open Access Journals (Sweden)

Priya Metri

2011-12-01

Full Text Available Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user’s emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion . Multimodal system gives more accurate result than a signal or bimodal system

Linking variability in brain chemistry and circuit function through multimodal human neuroimaging

DEFF Research Database (Denmark)

Fisher, Patrick M; Hariri, A R

2012-01-01

and dopamine system and its effects on threat- and reward-related brain function, we review evidence for how such a multimodal neuroimaging strategy can be successfully implemented. Furthermore, we discuss how multimodal PET-fMRI can be integrated with techniques such as imaging genetics, pharmacological......Identifying neurobiological mechanisms mediating the emergence of individual differences in behavior is critical for advancing our understanding of relative risk for psychopathology. Neuroreceptor positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) can be used...

Multimodal Perioperative Analgesia Regimen to Improve Patient Outcomes After Total Knee Arthroplasty: A Multidisciplinary Quality Improvement Project.

Science.gov (United States)

Donahue, Rebecca E; Bradbury, George R; Zychowicz, Michael E; Muckler, Virginia C

2018-04-01

The primary aim of this quality improvement project was to improve mobilization for patients after total knee arthroscopy by developing and implementing a standardized, evidence-based, multimodal analgesia regimen and patient-educational video. Secondary outcomes included opioid consumption, pain, and length of stay. A pre-post implementation design was used to compare two independent samples. Patients were screened based on inclusion and exclusion criteria 1-2 weeks before surgery. The anesthesia provider made the final determination for inclusion. Data were collected by retrospective chart review. Following implementation, patients displayed significantly improved mobilization, reduced opioid consumption, and reduced length of stay. Patient-reported pain scores were similar or significantly lower in the postimplementation group. Variability of patient outcomes was reduced, and quality of care was improved by standardizing care and incorporating the best available evidence, consistent with organization's resources in the nonacademic-affiliated, community hospital setting. Published by Elsevier Inc.

Four-Wave Mixing of a Laser and Its Frequency-Doubled Version in a Multimode Optical Fiber

Directory of Open Access Journals (Sweden)

Hamed Pourbeyram

2015-08-01

Full Text Available It is shown that it is possible to couple a laser beam and its frequency-doubled daughter into a multimode optical fiber through the four-wave mixing nonlinear process and generate a new wavelength. The frequency-doubled daughter can be generated in an external crystal with a large second order nonlinearity. It is argued that while this possibility is within the design parameter range of conventional multimode optical fibers, it necessitates a lower-bound for the core-cladding refractive index contrast of the multimode optical fiber.

Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

Science.gov (United States)

Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

2016-12-20

The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

Copper accumulation by stickleback nests containing spiggin.

Science.gov (United States)

Pinho, G L L; Martins, C M G; Barber, I

2016-07-01

The three-spined stickleback is a ubiquitous fish of marine, brackish and freshwater ecosystems across the Northern hemisphere that presents intermediate sensitivity to copper. Male sticklebacks display a range of elaborate reproductive behaviours that include nest construction. To build the nests, each male binds nesting material together using an endogenous glycoprotein nesting glue, known as 'spiggin'. Spiggin is a cysteine-rich protein and, therefore, potentially binds heavy metals present in the environment. The aim of this study was to investigate the capacity of stickleback nests to accumulate copper from environmental sources. Newly built nests, constructed by male fish from polyester threads in laboratory aquaria, were immersed in copper solutions ranging in concentration from 21.1-626.6 μg Cu L(-1). Bundles of polyester threads from aquaria without male fish were also immersed in the same copper solutions. After immersion, nests presented higher amounts of copper than the thread bundles, indicating a higher capacity of nests to bind this metal. A significant, positive correlation between the concentration of copper in the exposure solution and in the exposed nests was identified, but there was no such relationship for thread bundles. Since both spiggin synthesis and male courtship behaviour are under the control of circulating androgens, we predicted that males with high courtship scores would produce and secrete high levels of the spiggin protein. In the present study, nests built by high courtship score males accumulated more copper than those built by low courtship score males. Considering the potential of spiggin to bind metals, the positive relationship between fish courtship and spiggin secretion seems to explain the higher amount of copper on the nests from the fish showing high behaviour scores. Further work is now needed to determine the consequences of the copper binding potential of spiggin in stickleback nests for the health and survival of

Copulatory courtship song in Lutzomyia migonei (Diptera: psychodidae).

Science.gov (United States)

Vigoder, Felipe M; Souza, Nataly A; Peixoto, Alexandre A

2010-12-01

Lutzomyia migonei is a vector of leishmaniasis with a wide distribution in South America, which could favour population differentiation and speciation. Cryptic species of the Lutzomyia longipalpis complex, the widely distributed sand fly vector of visceral leishmaniasis in Latin America, have previously been shown to display distinct copulation songs. We found that Lu. migonei males also produce a song during copulation. This "lovesong" presents short trains (6-8 pulses) with an inter-pulse interval around 26 ms and is potentially involved in cryptic female choice and insemination success.

Manifold regularized multi-task feature selection for multi-modality classification in Alzheimer's disease.

Science.gov (United States)

Jie, Biao; Zhang, Daoqiang; Cheng, Bo; Shen, Dinggang

2013-01-01

Accurate diagnosis of Alzheimer's disease (AD), as well as its prodromal stage (i.e., mild cognitive impairment, MCI), is very important for possible delay and early treatment of the disease. Recently, multi-modality methods have been used for fusing information from multiple different and complementary imaging and non-imaging modalities. Although there are a number of existing multi-modality methods, few of them have addressed the problem of joint identification of disease-related brain regions from multi-modality data for classification. In this paper, we proposed a manifold regularized multi-task learning framework to jointly select features from multi-modality data. Specifically, we formulate the multi-modality classification as a multi-task learning framework, where each task focuses on the classification based on each modality. In order to capture the intrinsic relatedness among multiple tasks (i.e., modalities), we adopted a group sparsity regularizer, which ensures only a small number of features to be selected jointly. In addition, we introduced a new manifold based Laplacian regularization term to preserve the geometric distribution of original data from each task, which can lead to the selection of more discriminative features. Furthermore, we extend our method to the semi-supervised setting, which is very important since the acquisition of a large set of labeled data (i.e., diagnosis of disease) is usually expensive and time-consuming, while the collection of unlabeled data is relatively much easier. To validate our method, we have performed extensive evaluations on the baseline Magnetic resonance imaging (MRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) data of Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our experimental results demonstrate the effectiveness of the proposed method.

NaGdF4:Nd3+/Yb3+ Nanoparticles as Multimodal Imaging Agents

Science.gov (United States)

Pedraza, Francisco; Rightsell, Chris; Kumar, Ga; Giuliani, Jason; Monton, Car; Sardar, Dhiraj

Medical imaging is a fundamental tool used for the diagnosis of numerous ailments. Each imaging modality has unique advantages; however, they possess intrinsic limitations. Some of which include low spatial resolution, sensitivity, penetration depth, and radiation damage. To circumvent this problem, the combination of imaging modalities, or multimodal imaging, has been proposed, such as Near Infrared Fluorescence imaging (NIRF) and Magnetic Resonance Imaging (MRI). Combining individual advantages, specificity and selectivity of NIRF with the deep penetration and high spatial resolution of MRI, it is possible to circumvent their shortcomings for a more robust imaging technique. In addition, both imaging modalities are very safe and minimally invasive. Fluorescent nanoparticles, such as NaGdF4:Nd3 +/Yb3 +, are excellent candidates for NIRF/MRI multimodal imaging. The dopants, Nd and Yb, absorb and emit within the biological window; where near infrared light is less attenuated by soft tissue. This results in less tissue damage and deeper tissue penetration making it a viable candidate in biological imaging. In addition, the inclusion of Gd results in paramagnetic properties, allowing their use as contrast agents in multimodal imaging. The work presented will include crystallographic results, as well as full optical and magnetic characterization to determine the nanoparticle's viability in multimodal imaging.

Unimodal and multimodal regions for logographic language processing in left ventral occipitotemporal cortex

Directory of Open Access Journals (Sweden)

Yuan eDeng

2013-09-01

Full Text Available The human neocortex appears to contain a dedicated visual word form area (VWFA and an adjacent multimodal (visual/auditory area. However, these conclusions are based on functional magnetic resonance imaging (fMRI of alphabetic language processing, languages that have clear grapheme-to-phoneme correspondence (GPC rules that make it difficult to disassociate visual-specific processing from form-to-sound mapping. In contrast, the Chinese language has no clear GPC rules. Therefore, the current study examined whether native Chinese readers also have the same VWFA and multimodal area. Two cross-modal tasks, phonological retrieval of visual words and orthographic retrieval of auditory words, were adopted. Different task requirements were also applied to explore how different levels of cognitive processing modulate activation of putative VWFA-like and multimodal-like regions. Results showed that the left occipitotemporal sulcus responded exclusively to visual inputs and an adjacent region, the left inferior temporal gyrus, showed comparable activation for both visual and auditory inputs. Surprisingly, processing levels did not significantly alter activation of these two regions. These findings indicated that there are both unimodal and multimodal word areas for non-alphabetic language reading, and that activity in these two word-specific regions are independent of task demands at the linguistic level.

Speech Perception as a Multimodal Phenomenon

OpenAIRE

Rosenblum, Lawrence D.

2008-01-01

Speech perception is inherently multimodal. Visual speech (lip-reading) information is used by all perceivers and readily integrates with auditory speech. Imaging research suggests that the brain treats auditory and visual speech similarly. These findings have led some researchers to consider that speech perception works by extracting amodal information that takes the same form across modalities. From this perspective, speech integration is a property of the input information itself. Amodal s...

A Multimodal Robot Game for Seniors

DEFF Research Database (Denmark)

Hansen, Søren Tranberg; Krogsager, Anders; Fredslund, Jakob

2017-01-01

This paper describes the initial findings of a multimodal game which has been implemented on a humanoid robot platform and tested with seniors suffering from dementia. Physical and cognitive activities can improve the overall wellbeing of seniors, but it is often difficult to motivate seniors...... feedback and includes animated gestures and sounds. The game has been tested in a nursing home with four seniors suffering from moderate to severe dementia....

Stress and Cognitive Load in Multimodal Conversational Interactions

NARCIS (Netherlands)

Niculescu, A.I.; Cao, Y.; Nijholt, Antinus; Stephanides, C.

2009-01-01

The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during

Multimodal transports in the Unidted States and Europe

DEFF Research Database (Denmark)

Ulfbeck, Vibe Garf

2009-01-01

is preferred in Europe whereas another is preferred in the US. In this sense, modern transport law has become reginialized. The regionalization creates difficulties when goods are trasnported between the two regions. Neither the attempt to regulate multimodal transports in the new global UNCITRAL Convention...

The Management Of Homosexuality Using Multimodal Therapy: A ...

African Journals Online (AJOL)

Anxiety, depression, marital distress and low self-esteem were identified as correlates of the client's condition. Multimodal therapy was instituted thereafter. The result after three months of treatment showed reduction in sexual attraction for men, increased attraction to females, reduced frequency of masturbation, lowered ...

Multimodal Counseling of Childhood Encopresis: A Case Example.

Science.gov (United States)

Gumaer, Jim

1990-01-01

Provides information regarding childhood disorder of encopresis and presents multimodal therapy techniques for school counselors who cannot successfully refer clients. Presents a case study of a teenage boy suffering from encopresis who was referred for counseling. Suggests specific treatment strategies including behavior modification, nutrition…

Demonstration of analyzers for multimode photonic time-bin qubits

Science.gov (United States)

Jin, Jeongwan; Agne, Sascha; Bourgoin, Jean-Philippe; Zhang, Yanbao; Lütkenhaus, Norbert; Jennewein, Thomas

2018-04-01

We demonstrate two approaches for unbalanced interferometers as time-bin qubit analyzers for quantum communication, robust against mode distortions and polarization effects as expected from free-space quantum communication systems including wavefront deformations, path fluctuations, pointing errors, and optical elements. Despite strong spatial and temporal distortions of the optical mode of a time-bin qubit, entangled with a separate polarization qubit, we verify entanglement using the Negative Partial Transpose, with the measured visibility of up to 0.85 ±0.01 . The robustness of the analyzers is further demonstrated for various angles of incidence up to 0 .2∘ . The output of the interferometers is coupled into multimode fiber yielding a high system throughput of 0.74. Therefore, these analyzers are suitable and efficient for quantum communication over multimode optical channels.

Multimodality treatment of hypertrophic scars using long-wave X-radiation

International Nuclear Information System (INIS)

Protsenko, T.V.

1984-01-01

The paper is concerned with a therapeutic method for hypertrophic scars inc cluding Bucky rays, pyrogenal, vitamins a, e, b 12 , sodium salicylate and dimexide ointment. Multimodality treatment of hypertrophic scars is effective, well tolerated and can be widely used in out-patient clinics. It makes it possible to reduce the period of therapy by 2-3 mos., and the summary dose by 20 000-3000 rad (18.6-27.9 Gy) as compared to common therapy with Wucky rays only Changes in the connective structure of scars in the process of multimodality th herapy are nonspecific and account for some mechanisms of scar regression and reaffirm the efficacy of this therapeutic method

Multimodal approach to postoperative recovery

DEFF Research Database (Denmark)

Kehlet, Henrik

2009-01-01

PURPOSE OF REVIEW: To provide updated information on recent developments within individual components of multimodal interventions to improve postoperative outcome (fast-track methodology). RECENT FINDINGS: The value of the fast-track methodology to improve recovery and decrease hospital stay...... and morbidity has been firmly consolidated, especially in colorectal procedures. An increasing amount of data from other procedures supports the value of the fast-track concept across procedures. Fast-track programs should be based on the analysis of procedure-specific factors that may influence outcome...

Invisible Display in Aluminum

DEFF Research Database (Denmark)

Prichystal, Jan Phuklin; Hansen, Hans Nørgaard; Bladt, Henrik Henriksen

2005-01-01

Bang & Olufsen a/s has been working with ideas for invisible integration of displays in metal surfaces. Invisible integration of information displays traditionally has been possible by placing displays behind transparent or semitransparent materials such as plastic or glass. The wish for an integ......Bang & Olufsen a/s has been working with ideas for invisible integration of displays in metal surfaces. Invisible integration of information displays traditionally has been possible by placing displays behind transparent or semitransparent materials such as plastic or glass. The wish...... for an integrated display in a metal surface is often ruled by design and functionality of a product. The integration of displays in metal surfaces requires metal removal in order to clear the area of the display to some extent. The idea behind an invisible display in Aluminum concerns the processing of a metal...

Reading in the Australian Curriculum English: Describing the Effects of Structure and Organisation on Multimodal Texts

Science.gov (United States)

Exley, Beryl; Cottrell, Amber

2012-01-01

The recently introduced "Australian Curriculum: English" (Australian Curriculum, Assessment and Reporting Authority (ACARA), 2012) requires students to "read" multimodal text and describe the effects of structure and organisation. We begin this article by tracing the variable understandings of what reading multimodal text might…

A Multimodal Interaction Framework for Blended Learning

DEFF Research Database (Denmark)

Vidakis, Nikolaos; Kalafatis, Konstantinos; Triantafyllidis, Georgios

2016-01-01

Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses ...... framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment....

Analysis of the harmonic and intermodulation distortion in a multimode fiber optic link.

Science.gov (United States)

Gasulla, I; Capmany, J

2007-07-23

We present an analytical evaluation of the harmonic and the intermodulation distortion effects produced in the transmission of an analog signal composed of various RF tones through a multimode fiber link. It is based on the electric field propagation model previously published by the authors. Results show the possibility of implementing subcarrier multiplexing techniques (SCM) with Composite Second Order (CSO) values below -50 dBc over short and middle reach multimode fiber links.

Single-pulse CARS based multimodal nonlinear optical microscope for bioimaging.

Science.gov (United States)

Kumar, Sunil; Kamali, Tschackad; Levitte, Jonathan M; Katz, Ori; Hermann, Boris; Werkmeister, Rene; Považay, Boris; Drexler, Wolfgang; Unterhuber, Angelika; Silberberg, Yaron

2015-05-18

Noninvasive label-free imaging of biological systems raises demand not only for high-speed three-dimensional prescreening of morphology over a wide-field of view but also it seeks to extract the microscopic functional and molecular details within. Capitalizing on the unique advantages brought out by different nonlinear optical effects, a multimodal nonlinear optical microscope can be a powerful tool for bioimaging. Bringing together the intensity-dependent contrast mechanisms via second harmonic generation, third harmonic generation and four-wave mixing for structural-sensitive imaging, and single-beam/single-pulse coherent anti-Stokes Raman scattering technique for chemical sensitive imaging in the finger-print region, we have developed a simple and nearly alignment-free multimodal nonlinear optical microscope that is based on a single wide-band Ti:Sapphire femtosecond pulse laser source. Successful imaging tests have been realized on two exemplary biological samples, a canine femur bone and collagen fibrils harvested from a rat tail. Since the ultra-broad band-width femtosecond laser is a suitable source for performing high-resolution optical coherence tomography, a wide-field optical coherence tomography arm can be easily incorporated into the presented multimodal microscope making it a versatile optical imaging tool for noninvasive label-free bioimaging.

Spontaneous generalization of abstract multimodal patterns in young domestic chicks.

Science.gov (United States)

Versace, Elisabetta; Spierings, Michelle J; Caffini, Matteo; Ten Cate, Carel; Vallortigara, Giorgio

2017-05-01

From the early stages of life, learning the regularities associated with specific objects is crucial for making sense of experiences. Through filial imprinting, young precocial birds quickly learn the features of their social partners by mere exposure. It is not clear though to what extent chicks can extract abstract patterns of the visual and acoustic stimuli present in the imprinting object, and how they combine them. To investigate this issue, we exposed chicks (Gallus gallus) to three days of visual and acoustic imprinting, using either patterns with two identical items or patterns with two different items, presented visually, acoustically or in both modalities. Next, chicks were given a choice between the familiar and the unfamiliar pattern, present in either the multimodal, visual or acoustic modality. The responses to the novel stimuli were affected by their imprinting experience, and the effect was stronger for chicks imprinted with multimodal patterns than for the other groups. Interestingly, males and females adopted a different strategy, with males more attracted by unfamiliar patterns and females more attracted by familiar patterns. Our data show that chicks can generalize abstract patterns by mere exposure through filial imprinting and that multimodal stimulation is more effective than unimodal stimulation for pattern learning.

Multimodal Biometric System- Fusion Of Face And Fingerprint Biometrics At Match Score Fusion Level

Directory of Open Access Journals (Sweden)

Grace Wangari Mwaura

2017-04-01

Full Text Available Biometrics has developed to be one of the most relevant technologies used in Information Technology IT security. Unimodal biometric systems have a variety of problems which decreases the performance and accuracy of these system. One way to overcome the limitations of the unimodal biometric systems is through fusion to form a multimodal biometric system. Generally biometric fusion is defined as the use of multiple types of biometric data or ways of processing the data to improve the performance of biometric systems. This paper proposes to develop a model for fusion of the face and fingerprint biometric at the match score fusion level. The face and fingerprint unimodal in the proposed model are built using scale invariant feature transform SIFT algorithm and the hamming distance to measure the distance between key points. To evaluate the performance of the multimodal system the FAR and FRR of the multimodal are compared along those of the individual unimodal systems. It has been established that the multimodal has a higher accuracy of 92.5 compared to the face unimodal system at 90 while the fingerprint unimodal system is at 82.5.