838266A Review of the Development of Embodied Presentation Agents and Their Application Fields Embodied conversational agents provide a promising option for presenting information to users. This contribution revisits a number of past and ongoing systems with animated characters that have been developed at DFKI. While in all systems the purpose of using characters is to convey information to the user, there are significant variations in the style of presentation and the assumed conversational setting. The spectrum of systems include systems that feature a single, TV-style presentation agent, dialogue systems, as well as systems that deploy multiple interactive characters. We also provide a technical view on these systems and sketch the underlying system architectures of each sample system. 2003IN PRENDINGER, H., ISHIZUKA, M., EDS.: LIFE-LIKE CHARACTERS – TOOLS, AFFECTIVE FUNCTIONS, AND APPLICATIONSCONFERENCE377--404SpringerThomas Rist
1 DFKI GmbH, Stuhlsatzenhausweg 3, D-66123 Saarbrücken, Germany.
rist@dfki.de,1
Elisabeth André
2 Augsburg University, Eichleitnerstr. 30, D-86135 Augsburg, Germany
andre@informatik.uni-augsburg.de2
Stephan Baldes
1 DFKI GmbH, Stuhlsatzenhausweg 3, D-66123 Saarbrücken, Germany.
baldes@dfki.de,3
Patrick Gebhard
pit@blinx.de4
Martin Klesen
1 DFKI GmbH, Stuhlsatzenhausweg 3, D-66123 Saarbrücken, Germany.
klesen@dfki.de,5
Michael Kipp, Peter Rist
1 DFKI GmbH, Stuhlsatzenhausweg 3, D-66123 Saarbrücken, Germany.
kipp@dfki.de,6
Markus Schmitt
1 DFKI GmbH, Stuhlsatzenhausweg 3, D-66123 Saarbrücken, Germany.
mschmitt@dfki.de,7
507848E André,RistT.: Coping with temporal constraints in multimedia presentation planningIn: Proc of the AAAI ‘96, Menlo ParkCONFERENCE1996142--147MIT PressCambridge, LondonAndré, E., Rist, T.: Coping with temporal constraints in multimedia presentation planning. In: Proc of the AAAI ‘96, Menlo Park, Cambridge, London (AAAI Press/The MIT Press 1996) pp 142–14710.1.1.83.948497213E André,G Herzog,RistT.: Generating multimedia presentations for RoboCup soccer games. In: RoboCup ’97: Robot Soccer World Cup I, ed by Kitano1997200--215SpringerNew YorkAndré, E., Herzog, G., Rist, T.: Generating multimedia presentations for RoboCup soccer games. In: RoboCup ’97: Robot Soccer World Cup I, ed by Kitano (Springer, New York 1997) pp 200–21510.1.1.83.9484315413E André,T Rist,J MüllerEmploying AI methods to control the behavior of animated interface agentsApplied Artificial IntelligenceJOURNAL199913André, E., Rist, T., Müller, J.: Employing AI methods to control the behavior of animated interface agents. Applied Artificial Intelligence 13:415–448 (1999)10.1.1.83.948464293E André,T Rist,S van Mulken,M Klesen,BaldesS.: The automated design of believable dialogues for animated presentation teams. In: Embodied Conversational Agents, ed by2000220--255The MIT PressCambridge, MAAndré, E., Rist, T., van Mulken, S., Klesen, M., Baldes, S.: The automated design of believable dialogues for animated presentation teams. In: Embodied Conversational Agents, ed by Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (The MIT Press, Cambridge, MA 2000) pp 220–25510.1.1.83.9484363477E André,K Binsted,K Tanaka-Ishii,S Luke,G Herzog,RistT.: Three RoboCup Simulation League Commentator SystemsAI MagazineJOURNAL200021André, E., Binsted, K., Tanaka-Ishii, K., Luke, S., Herzog, G., Rist, T.: Three RoboCup Simulation League Commentator Systems. AI Magazine 21(1):57–65 (2000)10.1.1.83.94841460048E André,S Baldes,RistT.: From simulated dialogues to interactive performancesIn: Multi-Agent Systems and Applications II, ed by MarikCONFERENCE2002107--118SpringerNew YorkAndré, E., Baldes, S., Rist, T.: From simulated dialogues to interactive performances. In: Multi-Agent Systems and Applications II, ed by Marik, V., Stepankova, O., Krauwurmovpa, H., Luck, M. (Springer, New York 2002) pp 107–11810.1.1.83.94844708171K Binsted,LukeS.: Character design for soccer commentary. In: RoboCup-98: Robot Soccer World Cup II, ed by Asada199922--33M., Kitano, H. (Springer, New YorkBinsted, K., Luke, S.: Character design for soccer commentary. In: RoboCup-98: Robot Soccer World Cup II, ed by Asada, M., Kitano, H. (Springer, New York 1999) pp 22–3310.1.1.83.9484111811B Blumberg,B Tomlinson,DownieM.: Multiple conceptions of characterbased interactive installationsComputer Graphics International 2001 (2001) pp 5–11CONFERENCEBlumberg, B., Tomlinson, B., Downie, M.: Multiple conceptions of characterbased interactive installations. Computer Graphics International 2001 (2001) pp 5–1110.1.1.83.948469125J Cassell,C Pelachaud,N Badler,M Steedman,B Achorn,T Becket,B Douville,S Prevost,StoneM.: Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. Computer Graphics 28:413–4201994Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., Stone, M.: Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. Computer Graphics 28:413–420 (1994) 26 Thomas Rist et al.10.1.1.83.948469126J Cassell,T Bickmore,L Camphell,H Vilhjalmsson,YanH.: The human conversation as a system framework: Designing embodied conversational agents. In: Embodied Conversational Agents, ed by200029--63The MIT PressCambridge MACassell, J., Bickmore, T., Camphell, L., Vilhjalmsson, H., Yan, H.: The human conversation as a system framework: Designing embodied conversational agents. In: Embodied Conversational Agents, ed by Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (The MIT Press, Cambridge MA 2000) pp 29–6310.1.1.83.9484585797M Cavazza,CharlesF.: Interacting with virtual characters in interactive storytellingIn: Proceedings of AAMAS’02 (2002) pp 318–325CONFERENCECavazza, M., Charles, F.: Interacting with virtual characters in interactive storytelling. In: Proceedings of AAMAS’02 (2002) pp 318–32510.1.1.83.948432409M M Cohen,J Beskow,MassaroDW.: Recent developments in facial animation: An inside viewIn: Proceedings of Auditory-Visual Speech Processing 98CONFERENCE1998Sydney, AustraliaCohen, M.M., Beskow, J., Massaro, DW.: Recent developments in facial animation: An inside view. In: Proceedings of Auditory-Visual Speech Processing 98, Sydney, Australia (1998)10.1.1.83.9484295783P GebhardEnhancing embodied intelligent agents with affective user modellingIn: Proceedings of UM2001, Doctoral Consortium summaryCONFERENCE2001SpringerBerlinGebhard, P.: Enhancing embodied intelligent agents with affective user modelling. In: Proceedings of UM2001, Doctoral Consortium summary (Springer, Berlin 2001)10.1.1.83.9484346213B Hayes-Roth,R van Gent,HuberD.: Acting in character. Creating personalities for synthetic actors, ed by Trappl199792--112SpringerNew YorkHayes-Roth, B., van Gent, R., Huber, D.: Acting in character. Creating personalities for synthetic actors, ed by Trappl, R., Petta, P. (Springer, New York 1997) pp 92–11210.1.1.83.9484330035K Höök,P Persson,SjölinderM.: Evaluating users’ experience of a characterenhanced Information SpaceAI CommunicationsJOURNAL200013Höök, K., Persson, P., Sjölinder, M.: Evaluating users’ experience of a characterenhanced Information Space. AI Communications 13(3):195–212 (2000)10.1.1.83.9484183162M HuberJAM: A BDI-theoretic mobile agent architectureIn: Proceedings of the 3rd Conference on Autonomous Agents, (ACMCONFERENCE1999236--243PressNew YorkHuber, M.: JAM: A BDI-theoretic mobile agent architecture. In: Proceedings of the 3rd Conference on Autonomous Agents, (ACM Press, New York 1999) pp 236–24310.1.1.83.9484164762K Isbister,H Nakanishi,T Ishida,NassC.: Helper agent: Designing an assistant for human-human interaction in a virtual meeting spaceIn: Proceedings of CHI 2000 (ACMCONFERENCE200057--64PressNew YorkIsbister, K., Nakanishi, H., Ishida, T., Nass, C.: Helper agent: Designing an assistant for human-human interaction in a virtual meeting space. In: Proceedings of CHI 2000 (ACM Press, New York 2000) pp 57–6410.1.1.83.9484235106M Ishizuka,T Tsutsui,S Saeyor,H Dohi,Y Zong,PrendingerH.: MPML: A multimodal presentation markup language with character control functionsIn: Proceedings of the Workshop on Achieving Human-like Behavior in Interactive Animated Agents, held in conj. with AAMAS’02 (2002) pp 50–54CONFERENCEIshizuka, M., Tsutsui, T., Saeyor, S., Dohi, H., Zong, Y., Prendinger, H.: MPML: A multimodal presentation markup language with character control functions. In: Proceedings of the Workshop on Achieving Human-like Behavior in Interactive Animated Agents, held in conj. with AAMAS’02 (2002) pp 50–5410.1.1.83.94841252781M KippFrom human gesture to synthetic actionIn: Proceedings of the Workshop on Multimodal Communication and Context in Embodied Agents, held in conj. with the Fifth International Conference on Autonomous Agents (2001) pp 9–14CONFERENCEKipp, M.: From human gesture to synthetic action. In: Proceedings of the Workshop on Multimodal Communication and Context in Embodied Agents, held in conj. with the Fifth International Conference on Autonomous Agents (2001) pp 9–1410.1.1.83.948489809M KippAnvil – a generic annotation tool for multimodal dialogueIn: Proceedings of Eurospeech’01 (2001) pp 1367–1370CONFERENCEKipp, M.: Anvil – a generic annotation tool for multimodal dialogue. In: Proceedings of Eurospeech’01 (2001) pp 1367–137010.1.1.83.948472314H Kitano,M Asada,Y Kuniyoshi,I Noda,E Osawa,MatsubaraH.: RoboCup: A challenging problem for AIAI MagazineJOURNAL199718Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E., Matsubara, H.: RoboCup: A challenging problem for AI. AI Magazine 18(1):73–85 (1997)10.1.1.83.94841207457M Klesen,J Szatkowski,LehmannN.: A Dramatised Actant Model for Interactive Improvisational PlaysIn: Proceedings of the 3rd Intelligent Virtual Agents Workshop (IVACONFERENCE2001181--194SpringerNew YorkKlesen, M., Szatkowski, J., Lehmann, N.: A Dramatised Actant Model for Interactive Improvisational Plays. In: Proceedings of the 3rd Intelligent Virtual Agents Workshop (IVA) (Springer, New York 2001) pp 181–19410.1.1.83.94844566D Kurlander,T Skelly,SalesinD.: Comic ChatIn: Proceedings of SIGGRAPH’96CONFERENCE1996225--236Kurlander, D., Skelly, T., Salesin, D.: Comic Chat. In: Proceedings of SIGGRAPH’96 (1996) pp 225–23610.1.1.83.94841471288B LaurelComputers as Theatre (Addison-Wesley1993Reading MALaurel, B.: Computers as Theatre (Addison-Wesley, Reading MA 1993)10.1.1.83.9484285140J Voerman,J L Towns,S G CallawayC.B.: Deictic believability: Coordinated gesture, locomotion, and speech in lifelike pedagogical agentsApplied Artificial IntelligenceJOURNAL199913Lester. J, Voerman, J.L., Towns, S.G., Callaway, C.B.: Deictic believability: Coordinated gesture, locomotion, and speech in lifelike pedagogical agents. Applied Artificial Intelligence 13:383–414 (1999)10.1.1.83.94841460050I Machado,A Paiva,PradaR.: Is the Wolf Angry or . . . Just HungryIn: Proceedings of Autonomous Agents (ACMCONFERENCE2001370--376PressNew YorkMachado, I., Paiva, A., Prada, R.: Is the Wolf Angry or . . . Just Hungry? In: Proceedings of Autonomous Agents (ACM Press, New York 2001), pp 370–37610.1.1.83.948463279P Maes,T Darrell,B Blumberg,PentlandA.: The ALIVE system: Wireless, full-Body Interaction with autonomous agentsIn: ACM Special Issue on Multimedia and Multisensory Virtual Worlds (1996) Review on the Development of Embodied Presentation Agents 27CONFERENCEMaes, P., Darrell, T., Blumberg, B., Pentland, A.: The ALIVE system: Wireless, full-Body Interaction with autonomous agents. In: ACM Special Issue on Multimedia and Multisensory Virtual Worlds (1996) A Review on the Development of Embodied Presentation Agents 2710.1.1.83.9484235109S C Marsella,W L Johnson,LaBoreC.: Interactive pedagogical dramaIn: Proceedings of the Fourth International Conference on Autonomous Agents (ACM Press 2000) pp 301–308CONFERENCEMarsella, S.C., Johnson, W.L., LaBore, C.: Interactive pedagogical drama. In: Proceedings of the Fourth International Conference on Autonomous Agents (ACM Press 2000) pp 301–30810.1.1.83.948442186M MateasAn Oz-Centric review of interactive drama and believable agentsSchool of CS, CMUTECHREPORT1997Pittsburgh, PATechnical Report CMU-CS-97-156Mateas, M.: An Oz-Centric review of interactive drama and believable agents. Technical Report CMU-CS-97-156, School of CS, CMU, Pittsburgh, PA. (1997)10.1.1.83.948427988M Mateas,SternA.: Towards integrating plot and character for interactive dramaIn: Working notes of the Social Intelligent Agents: The Human in the Loop Symposium (AAAI Press 2000CONFERENCEMateas, M., Stern, A.: Towards integrating plot and character for interactive drama. In: Working notes of the Social Intelligent Agents: The Human in the Loop Symposium (AAAI Press 2000)10.1.1.83.94842245436H Matsubara,I Frank,K Tanaka-Ishii,I Noda,H Nakashima,HasidaK.: Character design for soccer commentaryIn: RoboCup-98: Robot Soccer World Cup II, ed by Asada, M., Kitano, HCONFERENCE199934--49SpringerNew YorkMatsubara, H., Frank, I., Tanaka-Ishii, K., Noda, I., Nakashima, H., Hasida, K.: Character design for soccer commentary. In: RoboCup-98: Robot Soccer World Cup II, ed by Asada, M., Kitano, H. (Springer, New York 1999) pp 34–4910.1.1.83.94841075971K Nitta,O Hasegawa,T Akiba,T Kamishima,T Kurita,S Hayamizu,K Itoh,M Ishizuka,H Dohi,OkamuraM.: An experimental multimodal disputation systemIn: Proceedings of the IJCAI ’97 Workshop on Intelligent Multimodal SystemsCONFERENCE1997Nitta, K., Hasegawa, O., Akiba, T., Kamishima, T., Kurita, T., Hayamizu, S., Itoh, K., Ishizuka, M., Dohi, H., Okamura, M.: An experimental multimodal disputation system. In: Proceedings of the IJCAI ’97 Workshop on Intelligent Multimodal Systems (1997)10.1.1.83.9484477117T Noma,BadlerN.: A virtual human presenterIn: Proceedings of the IJCAI ’97 Workshop on Animated Interface Agents: Making them ntelligentCONFERENCE199745--51Noma, T., Badler, N.: A virtual human presenter. In: Proceedings of the IJCAI ’97 Workshop on Animated Interface Agents: Making them ntelligent (1997) pp 45–5110.1.1.83.9484492726C Pelachaud,V Carofiglio,B De Carolis,F de Rosis,PoggiI.: Embodied contextual agent in information delivering applicationProceedings of AAMAS’02 (ACMCONFERENCE2002758--765PressNew YorkPelachaud, C., Carofiglio, V., De Carolis, B., de Rosis, F., Poggi, I.: Embodied contextual agent in information delivering application. Proceedings of AAMAS’02 (ACM Press, New York 2002) pp 758–76510.1.1.83.948419042K Perlin,GoldbergA.: Improv: a system for scripting interactive actors in virtual worlds. Computer Graphics 30:205–2161996Perlin, K., Goldberg, A.: Improv: a system for scripting interactive actors in virtual worlds. Computer Graphics 30:205–216 (1996)10.1.1.83.9484295785H Prendinger,IshizukaM.: Social role awareness in animated agentsIn: Proceedings 5th International Conference on Autonomous Agents (Agents-01) (ACMCONFERENCE2001270--277PressNew YorkPrendinger, H., Ishizuka, M.: Social role awareness in animated agents. In: Proceedings 5th International Conference on Autonomous Agents (Agents-01) (ACM Press, New York 2001) pp 270–27710.1.1.83.948474501C Rich,C L Sidner,LeshN.: COLLAGEN: Applying collaborative discourse theory to human-computer interactionAI MagazineJOURNAL200122Rich, C., Sidner, C.L., Lesh, N.: COLLAGEN: Applying collaborative discourse theory to human-computer interaction. AI Magazine 22(4):15–25 (2001)10.1.1.83.94841823619J Rickel,JohnsonW.L.: Virtual humans for team training in virtual realityIn: Proceedings of the Ninth International Conference on Artificial Intelligence in Education (IOSCONFERENCE1999578--585PressAmsterdamRickel, J., Johnson, W.L.: Virtual humans for team training in virtual reality. In: Proceedings of the Ninth International Conference on Artificial Intelligence in Education (IOS Press, Amsterdam 1999) pp 578–58510.1.1.83.9484705055T Rist,E André,J MüllerAdding animated presentation agents to the interfaceProceedings of IUI 97 (ACMCONFERENCE199779--86PressNew YorkRist, T., André, E., Müller, J.: Adding animated presentation agents to the interface. Proceedings of IUI 97 (ACM Press, New York 1997) pp 79–8610.1.1.83.94841028300T Rist,E André,BaldesS.: A flexible platform for building applications with life-Like charactersIn: Proceedings of IUI’03 (ACM Press 2003) pp 158–165CONFERENCERist, T., André, E., Baldes, S.: A flexible platform for building applications with life-Like characters. In: Proceedings of IUI’03 (ACM Press 2003) pp 158–16510.1.1.83.9484295788T Rist,SchmittM.: Applying socio-psychological concepts of cognitive consistency to negotiation dialog scenarios with embodied conversational charactersProceedings of AISB’02 Symposium on Animated Expressive Characters for Social InteractionsCONFERENCE2002Rist, T., Schmitt, M.: Applying socio-psychological concepts of cognitive consistency to negotiation dialog scenarios with embodied conversational characters. Proceedings of AISB’02 Symposium on Animated Expressive Characters for Social Interactions (2002) pp 79–84 (Extended version submitted for publication in 2003)10.1.1.83.94844708172A E ScheflenThe significance of posture in communication systems. Psychiatry 26:316–3311964Scheflen, A.E.: The significance of posture in communication systems. Psychiatry 26:316–331 (1964)10.1.1.83.9484828964M A Smith,S Farnham,DruckerS.M.: The social life of small graphical chat spacesIn: Proceedings of CHI’2000 (2000) pp 462–469CONFERENCESmith, M.A., Farnham, S., Drucker, S.M.: The social life of small graphical chat spaces In: Proceedings of CHI’2000 (2000) pp 462–46910.1.1.83.94841400144N SgourosDynamic generation, management and resolution of interactive plotsArtificial IntelligenceJOURNAL1999107Sgouros, N.: Dynamic generation, management and resolution of interactive plots. Artificial Intelligence 107(1):29–62 (1999)10.1.1.83.948442230W Swartout,R Hill,J Gratch,W L Johnson,C Kyriakakis,C LaBore,R Lindheim,S Marsella,D Miraglia,B Moore,J Morie,J Rickel,M Thiébaux,L Tuch,R Whitney,J DouglasToward the Holodeck: Integrating graphics, sound, character and storyIn: Proceedings 5th International Thomas Rist et al. Conference on Autonomous Agents (Agents-01) (ACMCONFERENCE2001409--416PressNew YorkSwartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiébaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the Holodeck: Integrating graphics, sound, character and story. In: Proceedings 5th International 28 Thomas Rist et al. Conference on Autonomous Agents (Agents-01) (ACM Press, New York 2001) pp 409–41610.1.1.83.94842208281N M Thalmann,KalraP.: The simulation of a virtual TV presenterIn: Computer graphics and applications (World ScientificCONFERENCE19959--21PressSingaporeThalmann, N.M., Kalra, P.: The simulation of a virtual TV presenter. In: Computer graphics and applications (World Scientific Press, Singapore 1995) pp 9–2110.1.1.83.948469152D Traum,J RickelEmbodied agents for multi-party dialogue in immersive virtual worldsIn: Proc of AAMAS’02 (ACMCONFERENCE2002PressNew YorkTraum, D., Rickel, J.: Embodied agents for multi-party dialogue in immersive virtual worlds. In: Proc of AAMAS’02 (ACM Press, New York 2002) pp 766–73310.1.1.83.9484173109H Vilhjalmsson,J CassellBodyChat: Autonomous Communicative Behaviors in AvatarsIn: Proceedings of Autonomous Agents’98CONFERENCE1998269--276Vilhjalmsson, H., Cassell, J.: BodyChat: Autonomous Communicative Behaviors in Avatars. In: Proceedings of Autonomous Agents’98 (1998) pp 269–27610.1.1.83.9484146741P WeyhrauchGuiding interactive dramaTECHREPORT1997Ph.D. thesisWeyhrauch, P.: Guiding interactive drama. Ph.D. thesis. Carnegie Mellon University (1997)10.1.1.83.94844708173J Yabe,S Takahashi,ShibayamaE.: Automatic animation of discussions in usenetIn: Proceedings of Advanced Visual Interfaces 2000CONFERENCE200284--91Yabe, J., Takahashi, S., Shibayama, E.: Automatic animation of discussions in usenet. In: Proceedings of Advanced Visual Interfaces 2000 (2002) pp 84-9110.1.1.83.94841460052M YoungThe cooperative contract in interactive entertainment. In: Socially Intelligent Agents: Creating Relationships with Computers and Robots, ed by Dautenhahn2002229--234K., Bond, A.H., Canamero, L., Edmonds, B. (Kluwer, DordrechtYoung, M.: The cooperative contract in interactive entertainment. In: Socially Intelligent Agents: Creating Relationships with Computers and Robots, ed by Dautenhahn, K., Bond, A.H., Canamero, L., Edmonds, B. (Kluwer, Dordrecht 2002) pp 229–23410.1.1.83.948439557W Wahlster,N Reithinger,BlocherA.: SmartKom: Multimodal communication with a life-Like characterIn: Proceedings of EUROSPEECH’01 (2001CONFERENCEWahlster, W., Reithinger, N., Blocher, A.: SmartKom: Multimodal communication with a life-Like character. In: Proceedings of EUROSPEECH’01 (2001)10.1.1.83.9484111844M A Walker,J E Cahn,WhittackerS.J.: Improvising linguistic style: Social and affective bases for agent personalityIn: Proceedings First International Conference on Autonomous Agents (Agents’97) (ACMCONFERENCE199710--17PressNew YorkWalker, M.A., Cahn, J.E., Whittacker, S.J.: Improvising linguistic style: Social and affective bases for agent personality. In: Proceedings First International Conference on Autonomous Agents (Agents’97) (ACM Press, New York 1997) pp 10–1710.1.1.83.9484Apr 1, 2008rep1PDFLib TEThttp://mm-werkstatt.informatik.uni-augsburg.de/files/publications/87/prendinger-2.pdf