Article

A multimodal guide for the augmented campus

Authors:

Salvatore Sorce,

Agnese Augello,

Antonella Santangelo,

Giovanni Pilato,

Antonio Gentile,

Alessandro Genco, and

Salvatore GaglioAuthors Info & Claims

SIGUCCS '07: Proceedings of the 35th annual ACM SIGUCCS fall conference

October 2007

Pages 325 - 331

https://doi.org/10.1145/1294046.1294123

Published: 07 October 2007 Publication History

Abstract

The use of Personal Digital Assistants (PDAs) with ad-hoc built-in information retrieval and auto-localization functionalities can help people navigating an environment in a more natural manner compared to traditional audio/visual pre-recorded guides. In this work we propose and discuss a user-friendly, multi-modal guide system for pervasive context-aware service provision within augmented environments. The proposed system is adaptable to the user needs of mobility within a given environment; it is usable on different mobile devices and in particular on PDAs, which are used as advanced adaptive HEI (human-environment interaction) interfaces. An information retrieval service is provided that is easily accessible through spoken language interaction in cooperation with an auto-localization service. The interaction is enabled by speech recognition and synthesis technologies, and by a ChatBot system, endowed with common sense reasoning capabilities to properly interpret user speech and provide him with the requested information. This interaction mode turns to be more natural, and users are required to have only basic skills on the use of PDAs. The auto-localization service relies on a RFID-based framework, which resides partly in the mobile side of the entire system (PDAs), and partly in the environment side. In particular, RFID technology allows the system to provide users with context-related information. An implemented case study is showed that illustrates service provision in an augmented environment within university campus settings (termed "Augmented Campus"). Lastly, a discussion about user experiences while using trial services within the Augmented Campus is given.

References

[1]

Alice: http://www.alicebot.org

[2]

Andrew, H. and McGlashan, S.: Speech Recognition Grammar Specification Version 1.0, W3C Recommendation, (2004)

[3]

Aridor, Y., Carmel, D., Maarek, Y. S., Soffer, A., and Lempel, R. 2002. "Knowledge encapsulation for focused search from pervasive devices." ACM Trans. Inf. Syst. 20, 1 (Jan. 2002), 25--46.

Digital Library

[4]

Axelsson, J.,Cross, C., Ferrans, J., McCobb, G., Raman, T. and Wilson, L.: XHTML+Voice profile 1.2, W3C Note. (2004)

[5]

Barnett, J., Bodell, M., Raggett, D. and Wahbe, A.: Multimodal Architecture and Interfaces, W3C Working Draft. (2006)

[6]

Berhe G., Brunie L., Pierson J. M., "Modeling Service-Based Multimedia Content Adaptation", Proceedings of the 1st ACM Conference on Computing Frontiers CF '04, Ischia, Italy 2004, pp. 60--69

Digital Library

[7]

Black B., E. A. Larsson, "Beyond simple e-mail: upgrading an entire campus to enterprise e-mail and calendaring with groupwise", in Proceedings of the 34th annual ACM conference on User services SIGUCCS '06, November 2006, Edmonton, Alberta, Canada, Pages: 24--27

Digital Library

[8]

Chen A., "Network Based Storage: Getting Students to Actually Use It", in Proceedings of the 34th annual ACM conference on User services SIGUCCS '06, November 2006, Edmonton, Alberta, Canada, pages: 55--59.

Digital Library

[9]

Decker C., Kubach U., and Beigl. M., "Revealing the retail black box by interaction sensing", in Proceedings of the 23rd Distributed Computing Systems Workshops (ICDCS 2003), 19-22 May 2003 Page(s): 328--333

Digital Library

[10]

Fujimura N., D. Masairo, "Collecting Students' Degree of Comprehension with Mobile Phones", in Proceedings of the 34th annual ACM conference on User services SIGUCCS '06, November 2006, Edmonton, Alberta, Canada, pages: 123--127

Digital Library

[11]

Genco, A., Sorce, S. and Varrica, E.: "Combined People Position and Compass Detection for Context-aware Service Provision", proc. of IEEE 3rd International Workshop on Embedded Computing IWEC-06, Columbus, Ohio, USA, 14 Aug 2006, pp 368--375

Digital Library

[12]

Genco A., Sorce S., Reina G., Santoro G., "An Agent-Based Service Network for Personal Mobile Devices", IEEE Pervasive Computing, vol. 5, no. 2, Apr-Jun 2006, pp. 54--61

Digital Library

[13]

Genco A., S. Sorce, G. Reina, G. Santoro, R. Messineo, R. Raccuglia, L. Lo vecchio, G. Di Stefano, "An Augmented Campus Design for Context-aware Service Provision", Proceedings of the 33rd annual ACM SIGUCCS Conference on User Services, Monterey, CA, Nov. 6-11 2005, pp. 92--97

Digital Library

[14]

Grinter, R. E., and Eldridge, M., "Y do tngrs luv 2 txt msg?", in Proceedings of the Seventh European Conference on Computer-Supported Cooperative Work (ECSCW'01), Bonn, Germany, 16-20 September, 2001, Kluwer Academic Publishers, Dordrecht, Netherlands, 219--238.

Digital Library

[15]

Henrysson A., M. Ollila, M. Billinghurst, "Mobile phone based AR scene assembly", Proceedings of the 4th International Conference on Mobile and Ubiquitous Multimedia, Christchurch, New Zealand 2005, pp. 95--102

Digital Library

[16]

IBM Multimodal Tools: http://www-306.ibm.com/software/pervasive/multimodal/

[17]

Kino Coursey, Daxtron Laboratories, Inc., Living in CYN: mating AIML and CYC together with Program N. 2004.

[18]

McGlashan, S., Burnett, D. C., Carter, J., Danielsen, P., Ferrans, J., Hunt, A., Lucas, B., Porter, B., Rehor, K. and Tryphonas, S.: Voice Extensible Markup Language (VoiceXML) Version 2.0, W3C Recommendation, (2004)

[19]

Murnan, C. A., "Expanding Communication Mechanisms: They're Not Just E-Mailing Anymore", in Proceedings of the 34th annual ACM conference on User services SIGUCCS '06, November 2006, Edmonton, Alberta, Canada, pages: 267--272

Digital Library

[20]

Ni, L. M.; Yunhao Liu; Yiu Cho Lau; Patil, A. P.: LANDMARC: indoor location sensing using active RFID, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications (PerCom 2003), 23-26 March 2003 Page(s): 407--415

Digital Library

[21]

OpenCyc: http://www.opencyc.org

[22]

Pilato, G., Augello, A., Santangelo, A., Gentile, A. and Gaglio, S.: An Intelligent Multimodal Site-guide for the "Parco Archeologico della Valle dei Templi in Agrigento, Proc. of First European Workshop on Intelligent Technologies for Cultural Heritage Exploitation at The 17th European Conference on Artificial Intelligence, Riva del Garda, Italy, August, 45--49 (2006)

[23]

Price, S.; Summers, R., "Mobile Healthcare in the Home Environment", Proceedings of 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society EMBS '06, New York, NY, Aug. 2006, pp. 6446--6448

[24]

Raptis D., Tselios N., Avouris N., "Context-based design of mobile applications for museums: a survey of existing practices", Proceedings of the 7th ACM International Conference on Human-Computer Interaction with Mobile Devices & Services, Salzburg, Austria 2005, pp: 153--160

Digital Library

[25]

Wan. D., "Magic medicine cabinet: A situated portal for consumer healthcare.", In Proceedings of the International Symposium on Handheld and Ubiquitous Computing, 1999, Lecture Notes in Computer Science, vol. 1707, pag. 352

Digital Library

[26]

Want R., Fishkin K. O., Gujar A., and Harrison B. L., "Bridging physical and virtual worlds with electronic tags.", In Proc. ACM CHI '99, Pittsburgh, PA, May 15-20, 1999, pp. 370--377

Digital Library

[27]

Weiser M.: The Computer for the Twenty-First Century, Scientific American, pp. 94--100, (1991)

Cited By

Sorce SGentile VCascio DGiuliano ATabacchi MTaormina VTegolo DValenti CRaso G(2019)A REST-based Framework to Support Non-Invasive and Early Coeliac Disease DiagnosisProceedings of the 20th International Conference on Computer Systems and Technologies10.1145/3345252.3345296(207-212)Online publication date: 21-Jun-2019
https://dl.acm.org/doi/10.1145/3345252.3345296
Valenti C(2019)A genetic approach to the maximum common subgraph problemProceedings of the 20th International Conference on Computer Systems and Technologies10.1145/3345252.3345272(98-104)Online publication date: 21-Jun-2019
https://dl.acm.org/doi/10.1145/3345252.3345272
Cascio DTaormina VAbbene LRaso G(2018)A Microcalcification Detection System in Mammograms based on ANN Clustering2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC)10.1109/NSSMIC.2018.8824729(1-4)Online publication date: Nov-2018
https://doi.org/10.1109/NSSMIC.2018.8824729
Show More Cited By

Index Terms

A multimodal guide for the augmented campus
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens
    2. Interaction paradigms
      1. Natural language interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

An augmented campus design for context-aware service provision
SIGUCCS '05: Proceedings of the 33rd annual ACM SIGUCCS conference on User services

This paper deals with the design of a multi-modal system for pervasive context-aware service provision and human-environment interaction in augmented environments by the use of Personal Digital Assistants (PDA) or SmartPhones. The system enables mobile ...
Read More
An Agent-Based Service Network for Personal Mobile Devices

PDAs and mobile phones have become users' main interactive media platform for digital information and services. Taking advantage of this development, the Agent Network for Bluetooth Devices uses personal mobile devices equipped with Bluetooth connection ...
Read More
Remote control for pervasive services

In this paper, we present the REACHeS architecture for controlling pervasive services through physical user interfaces, using a mobile terminal and icons placed in the environment. An icon advertises a service that can be started by touching the icon ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGUCCS '07: Proceedings of the 35th annual ACM SIGUCCS fall conference

October 2007

390 pages

ISBN:9781595936349

DOI:10.1145/1294046

General Chairs:
Jayne Ashworth
University of Virginia
,
Lynnell Lacy
University of Illinois
,
Program Chairs:
Lisa Brown
University of Rochester
,
Carol Rhodes
Indiana University

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGUCCS Fall07

Sponsor:

SIGUCCS Fall07: ACM SIGUCCS Fall Conference

October 7 - 10, 2007

Florida, Orlando, USA

Acceptance Rates

Overall Acceptance Rate 123 of 170 submissions, 72%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
376
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Other Metrics

View Author Metrics

Citations

Cited By

Sorce SGentile VCascio DGiuliano ATabacchi MTaormina VTegolo DValenti CRaso G(2019)A REST-based Framework to Support Non-Invasive and Early Coeliac Disease DiagnosisProceedings of the 20th International Conference on Computer Systems and Technologies10.1145/3345252.3345296(207-212)Online publication date: 21-Jun-2019
https://dl.acm.org/doi/10.1145/3345252.3345296
Valenti C(2019)A genetic approach to the maximum common subgraph problemProceedings of the 20th International Conference on Computer Systems and Technologies10.1145/3345252.3345272(98-104)Online publication date: 21-Jun-2019
https://dl.acm.org/doi/10.1145/3345252.3345272
Cascio DTaormina VAbbene LRaso G(2018)A Microcalcification Detection System in Mammograms based on ANN Clustering2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC)10.1109/NSSMIC.2018.8824729(1-4)Online publication date: Nov-2018
https://doi.org/10.1109/NSSMIC.2018.8824729
Gentile VMilazzo FSorce SGentile AAugello APilato G(2017)Body Gestures and Spoken Sentences: A Novel Approach for Revealing User’s Emotions2017 IEEE 11th International Conference on Semantic Computing (ICSC)10.1109/ICSC.2017.14(69-72)Online publication date: 2017
https://doi.org/10.1109/ICSC.2017.14
Nuccio CAugello AGaglio SPilato G(2017)Interaction Capabilities of a Robotic ReceptionistIntelligent Interactive Multimedia Systems and Services 201710.1007/978-3-319-59480-4_18(171-180)Online publication date: 28-May-2017
https://doi.org/10.1007/978-3-319-59480-4_18
Augello APilato GVassallo GGaglio S(2014)Chatbots as Interface to OntologiesAdvances onto the Internet of Things10.1007/978-3-319-03992-3_20(285-299)Online publication date: 1-Jan-2014
https://doi.org/10.1007/978-3-319-03992-3_20
Schweitzer DTeel S(2011)SHERPAProceedings of the 2011 Frontiers in Education Conference10.1109/FIE.2011.6142733(S1E-1-1-S1E-5)Online publication date: 12-Oct-2011
https://dl.acm.org/doi/10.1109/FIE.2011.6142733
Sorce SAugello ASantangelo AGenco AGentile AGaglio SPilato G(2009)An RFID Framework for Multimodal Service Provision2009 International Conference on Complex, Intelligent and Software Intensive Systems10.1109/CISIS.2009.168(730-735)Online publication date: Mar-2009
https://doi.org/10.1109/CISIS.2009.168
Genco ASorce SMessineo RRaccuglia P(2008)PDA -- Remote Display Interaction FrameworkProceedings of the 2008 International Conference on Complex, Intelligent and Software Intensive Systems10.1109/CISIS.2008.130(763-768)Online publication date: 4-Mar-2008
https://dl.acm.org/doi/10.1109/CISIS.2008.130
Genco ASorce SFerrarotto CGallea RGentile AImpastato SMorana M(2008)A Java-based Wrapper for Wireless CommunicationsProceedings of the 2008 International Conference on Complex, Intelligent and Software Intensive Systems10.1109/CISIS.2008.129(769-774)Online publication date: 4-Mar-2008
https://dl.acm.org/doi/10.1109/CISIS.2008.129

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents