• search hit 7 of 8
Back to Result List

Integration of Multi-modal Cues in Synthetic Attention Processes to Drive Virtual Agent Behavior

  • Simulations and serious games require realistic behavior of multiple intelligent agents in real-time. One particular issue is how attention and multi-modal sensory memory can be modeled in a natural but effective way, such that agents controllably react to salient objects or are distracted by other multi-modal cues from their current intention. We propose a conceptual framework that provides a solution with adherence to three main design goals: natural behavior, real-time performance, and controllability. As a proof of concept, we implement three major components and showcase effectiveness in a real-time game engine scenario. Within the exemplified scenario, a visual sensor is combined with static saliency probes and auditory cues. The attention model weighs bottom-up attention against intention-related top-down processing, controllable by a designer using memory and attention inhibitor parameters. We demonstrate our case and discuss future extensions.

Export metadata

Additional Services

Share in Twitter Search Google Scholar Availability
Document Type:Conference Object
Parent Title (English):Intelligent Virtual Agents. 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Lecture Notes in Computer Science (LNCS), Vol. 10498
First Page:403
Last Page:412
Date of first publication:2017/08/26
Tag:Intelligent virtual agents; Synthetic perception; Virtual attention
Departments, institutes and facilities:Fachbereich Informatik
Institute of Visual Computing (IVC)
Dewey Decimal Classification (DDC):0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
Entry in this database:2017/08/31