IPSOM

From HCIM

Contents

Summary

The goals of the IPSOM project are the indexing, integration and retrieval of sound in multimedia documents, applied to spoken books. With this project, we intend to broaden and improve the use of the collection of spoken books of Biblioteca Nacional (The National Library). On one hand, making them available in digital format will simplify their access to a potentially much broader community of users. On the other hand, through the alignment between the written and spoken representation, allowing the indexing and retrieval of words, sets of words or topics, the project will open new horizons for the use of these documents.

The results of this project will be particularly relevant for visually impaired citizens, allowing a non-sequential search and access to the information stored in spoken books. The multimedia applications to be developed will allow the access to a very large spoken corpus for didactic or other purposes.


Teams

The project will involve three different teams with complementary expertise in the areas covered by IPSOM:

  • The Speech Processing Group of INESC (GPF/INESC) will be responsible for project management and task co-ordination, as well as developing methodologies for segmentation and labelling of linguistic units in the spoken corpora. The GPF team for IPSOM includes:
    • António Serralheiro (PhD)
    • Carlos Teixeira (PhD)
    • Isabel Trancoso (PhD)
    • Diamantino Caseiro (PhD)
    • Rui Amaral (MSc)
    • Pedro Cardoso


  • Biblioteca Nacional (BN) will provide the collection of spoken books and supporting infrastructure. The BN team for IPSOM includes:
    • José Luís Borbinha (PhD)
    • Hugo Amorim
    • Cláudia Ribiero
    • João Gil
    • João Samouqueiro

Publications

2005

  • Luís Carriço, Carlos Duarte, Rui Lopes, Miguel Rodrigues and Nuno Guimarães, Building Rich User Interfaces for Digital Talking Books, Book Chapter in Computer-Aided Design of User Interfaces IV, Kluwer Academic Publishers, 2005 (accepted in 2003), XI, 374 p., Hardcover (ISBN: 1-4020-3145-9), pdf.gif Download paper

2004

  • Carlos Duarte and Luís Carriço, Usability Evaluation of Digital Talking Books, In Interacção'2004, 1st National Conference in Human-Computer Interaction, Lisboa, Portugal, July 2004.
  • Carlos Duarte, Luís Carriço, and Hugo Simões, A Flexible Interface Architecture for Digital Talking Books, In Proceedings of the 6th International Conference on Enterprise Information Systems, ICEIS'04, Porto, Portugal, April 2004.
  • Luís Carriço, Carlos Duarte, Nuno Guimarães, António Serralheiro, and Isabel Trancoso, Modular Production of Flexible Digital Talking Books, In Proceedings of the 6th International Conference on Enterprise Information Systems, ICEIS'04, Porto, Portugal, April 2004.
  • Carlos Duarte and Luís Carriço, Identifying Adaptation Dimensions in Digital Talking Books, In Proceedings of the 8th ACM International Conference on Intelligent User Interfaces, IUI 2004, Island of Madeira, Portugal, ACM Press, January 2004.

2003

  • Carlos Duarte, Teresa Chambel, Luís Carriço, Nuno Guimarães, and Hugo Simões, A Multimodal Interface for Digital Talking Books, In Proceedings of WWW/Internet'2003, International Association for Development of the Information Society, IADIS, Algarve, Portugal, 5-8 November 2003.
  • Carlos Duarte, Luís Carriço, Hugo Simões, Teresa Chambel, and Nuno Guimarães, Avaliação de Aspectos de Sincronização de Livros Falados Digitais, In Proceedings of the Workshop de Sistemas de Informação Multimédia, Cooperativos e Distribuídos, Coop-Media 2003, ISEP Porto, Portugal, 8 October 2003.
  • António Serralheiro, Isabel Trancoso, Diamantino Caseiro, Teresa Chambel, Luís Carriço, and Nuno Guimarães, Towards a Repository of Digital Talking Books, In Proceedings of the 8th European Conference on Speech Communication and Technology, EuroSpeech’03, Geneve, Switzerland, 1-4 September 2003.
  • Luís Carriço, Nuno Guimarães, Carlos Duarte, Teresa Chambel, and Hugo Simões, Spoken Books: Multimodal Interaction and Information Repurposing, In Proceedings of the 10th Human Computer Interaction International Conference, HCII’03, Lawrence Erlbaum Associates, Creete, Greece, 22-27 June 2003.
  • Carlos Duarte, Luís Carriço, Nuno Guimarães, and Teresa Chambel, Producing DTB from Audio Tapes, In Proceedings of the 5th International Conference in Enterprise Information Systems, ICEIS’03, Agnes, France, 23-26 April 2003.


Funding

The IPSOM project is funded by Fundação de Ciência e Tecnologia, Programa POSI, n.º34252/99.