eDrama project

This page contain links to reseach projects that are related to the eDrama.

1. Emotion modelling, detection, metaphor and natural language processing

2. Intelligent agent based interactive virtual drama architecture

3. Embodied conversational agent animation system

 

 

Emotion modelling, detection, metaphor and natural language processing

ATT-Meta project, Natural Language Processing group, University of Birmingham

This project concerns metaphor-based reasoning and reasoning about mental states. A special concern is mental states that are described metaphorically in discourse, but the current main focus of the project is on metaphor in general. A reasoning system called ATT-Meta has been implemented. It performs some of the reasoning needed for understanding metaphorical utterances. It performs both ordinary and metaphor-based reasoning about mental states.

Emotion

A collection of conferences, journals, research projects on emotion modelling.

Back to top

 

Intelligent agent based interactive virtual drama architecture

Oz project for interactive virtual drama, University of Carnegie Mellon

It aimed at the creation of interactive virtual drama system with believable intelligent avatars by combining art and virtual reality techniques. Fašadewas later developed to integrates story level interaction (drama management), believable agents, and shallow natural language processing, in the context of a first person, graphical, real-time interactive drama.

Information Sciences Institute, University of Southern California

The institute carries out researches on autonomous agent, grid technology, natural language, etc. The subsidiary Center for advanced research in technology for education concentrates on developing new technologies for education and training and evaluate their effectiveness. “Steve” is an intelligent pedagogical agent to support virtual learning. The MRE is a virtual reality training environment that brings together research in intelligent tutoring, natural language recognition and generation, interactive narrative, emotional modelling, and immersive graphics and audio. The focus of the research is on creating a highly realistic and compelling face-to-face social interactions with virtual characters. Detailed publication on emotion, animation, social agents, natural language etc can be found here.

VICTEC: Virtual ICT with Empathic Characters, University of Salford

Project VICTEC aims to apply synthetic characters and emergent narrative to personal and social education for children aged 8-12.

Intellimedia, North Carolina State University

It aims to create knowledge-based multimedia learning environments that are populated by intelligent animated agents. Publications are mainly on animated pedagogical agents, 3D learning environments, and natural language generation. These can be useful references on constructing interactive intelligent avatars.

Back to top

 

Embodied conversational agent animation system

Gesture and Narrative language group, MIT

Directed by Justine Cassell, the group concentrates on the creation of conversational embodied agents including the system architecture, animation control, text to speech animation, rule and knowledge based system for learning, intelligent tutoring, and etc. A list of relevant publications can be found here.

Center for human modelling and simulation, University of Pennsylvania

Directed by Norman Balder, the center has been working on creation of realistic virtual human figure animation, motion and kinematics control, and expressive natural language instruction based animation. Their Parameterized Action Representation and its animation system is the center’s most influential work in the area of animated 3D intelligent avatar.

Synthetic character group, media lab, MIT

The group has been working on creation of autonomous character animation based on perception, memory, and action of the virtual agent. Significant contributions include the virtual brain structure of the synthetic character, the learning method, virtual vision system for avatars, and the “directable” agents architecture.

Virtual Reality Lab, Swiss Federal institute of Technology (EPFL)

Directed by Daniel Thalmann, the center has been the pioneer in the area of realistic virtual human animation. Researches are mainly concentrated on real time rendering of realistic human animation, motion control/planning for intelligent avatar, emotion and personality based avatar animation, multi-agent animation in networked virtual environments,

Adaptive intelligent system research group, Stanford University.

The research group investigates the AI based system that use perception, reasoning and action to function autonomously in dynamic environments. Project “Virtual theatre” aimed at building life-like embodied virtual character for learning, education, communication applications. (relevant to eDrama)

Back to top