RiCoBA

From HCIM

Contents

Summary

The RiCoBA project - Rich Content Books for All - aims at making books more accessible and appealing to different audiences. The goals are supporting rich Digital Talking Book (DTB) generation, through the development of a production framework to assist in the building and enriching of the books, and rich DTB playback, by developing tools for non-visual platforms, and tools that adapt the book presentation and interaction, reacting to changes in the user, playback devices, and environment.

Research Goals

  • Identification of multimedia and multimodal book patterns, to assist in the production of book collections.
  • Multimedia description ontology, enabling the coherent introduction of different media, and allowing for replacing the primary media of presentation of the books.
  • Models for speech generation based on human voice recordings.
  • Integration of speech and braille interaction techniques, to promote the access to DTBs.
  • Development and evaluation of a multimedia and multimodal adaptive rich DTB playback platform.

Teams

The project will involve three different teams with complementary expertise in the areas covered by RiCoBA:

  • The Human Computer Interaction and Multimedia Research Team (HCIM) of the Large Scale Informatics Laboratory will be responsible for project management and task co-ordination, as well as developing the rich DTB production framework and the rich DTB playback applications. The HCIM team for RiCoBA includes:
    • Nuno Guimarães (PhD) - Project leader
    • Luís Carriço (PhD)
    • Teresa Chambel (PhD)
    • Carlos Teixeira (PhD)
    • Thibault Langlois (PhD)
    • Carlos Duarte (MSc) - Executive manager
    • Rui Lopes (MSc)
    • Joana Pereira


  • The Speech Processing Group of INESC (GPF/INESC) will develop and apply methodologies for segmentation and labelling of linguistic units in the spoken corpora to allow for the synchronization between the same content on different media. The GPF group for RiCoBA includes:
    • António Serralheiro (PhD)


  • Biblioteca Nacional (BN) will provide the collection of spoken books and supporting infrastructure. The BN team for RiCoBA includes:
    • José Luís Borbinha (PhD)
    • João Gil

Publications

2007

  • Rui Lopes, Luís Carriço, Leveraging Rich Accessible Documents on the Web, W4A: 4th ACM International Cross-Disciplinary Conference on Web Accessibility, Banff, Canada, 7-8 May 2007, pdf.gif Download paper
  • Carlos Duarte, Luís Carriço and Nuno Guimarães, Evaluating usability improvements by combining visual and audio modalities in the interface, Proceedings of the 12th International Conference on Human-Computer Interaction (HCI International 2007), Beijing, P.R. China, 22-27 July 2007, pdf.gif Download paper
  • Carlos Duarte, Luís Carriço and Fernando Morgado, Playback of Rich Digital Books on Mobile Devices, Proceedings of the 12th International Conference on Human-Computer Interaction (HCI International 2007), Beijing, P.R. China, 22-27 July 2007, pdf.gif Download paper
  • Carlos Duarte and Luís Carriço, Conveying Browsing Context Through Audio on Digital Spoken Books, Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction, Beijing, P.R. China, 22-27 July 2007, pdf.gif Download paper
  • Rui Lopes and Luís Carriço, Browsing a Structured Multimedia Repository, WEBIST 2007: 3rd International conference on Web Information Systems and Technologies, Barcelona, Spain, 3-6 March 2007, pdf.gif Download paper
  • Rui Lopes, Hugo Simões, Carlos Duarte and Luís Carriço, Rich Digital Books for the Web, WEBIST 2007: 3rd International conference on Web Information Systems and Technologies, Barcelona, Spain, 3-6 March 2007, pdf.gif Download paper
  • Rui Lopes and Luís Carriço, Automating XML Pipelines Through Rules, XATA'2007: XML - Aplicações e Tecnologias Associadas, Lisbon, Portugal, 15-16 February 2007, pdf.gif Download paper

2006

  • Carlos Duarte, Teresa Chambel, Hugo Simões, Luís Carriço, Eduardo Santos, Guilherme Francisco, Sérgio Neves, Ana Catarina Rua, João Robalo, Tiago Fernandes, Avaliação de Interfaces Multimodais para Livros Falados Digitais com foco Não Visual, Interacção’2006: 2ª Conferência Nacional em Interacção Pessoa-Máquina, Braga, Portugal, 16-18 October 2006, pdf.gif Download paper
  • Rui Lopes, Carlos Duarte, Hugo Simões, and Luís Carriço, On the road to Rich Digital Books, Interacção’2006: 2ª Conferência Nacional em Interacção Pessoa-Máquina, Braga, Portugal, 16-18 October 2006, pdf.gif Download paper
  • Isabel Trancoso, Carlos Duarte, António Serralheiro, Diamantino Caseiro, Luís Carriço, Céu Viana, Spoken Language Technologies Applied to Digital Talking Books, in Proceedings of Interspeech 2006, Pittsburgh, PA, USA, 17-21 September 2006
  • Rui Lopes and Luís Carriço, Patterns for Time-based Hypermedia Artifacts, EuroPLoP’2006: European Conference on Patterns Languages of Programs, Irsee, Germany, 5-9 July 2006, pdf.gif Download paper
  • Rui Lopes, Luís Carriço and Carlos Duarte, DiTaBBu - Automating the Production of Time-based Hypermedia Content, in Proceedings of the 15th ACM International World Wide Web Conference 2006, Edinburgh, United Kingdom, 23-26 May 2006, pdf.gif Download paper
  • Rui Lopes and Luís Carriço, Building Reusable Pipelines with APP, XATA'2006: XML - Aplicações e Tecnologias Associadas, Portalegre, Portugal, 9-10 February 2006, pdf.gif Download paper
  • Carlos Duarte, Luís Carriço, A Conceptual Framework for Developing Adaptive Multimodal Applications, in Proceedings of the 10th ACM International Conference on Intelligent User Interfaces (IUI 2006), Sydney, Australia, 2006, pdf.gif Download paper
  • Miguel Rodrigues, Luís Carriço, Carlos Duarte, Nuno Guimarães, António Serralheiro, Isabel Trancoso, New Ways to Read Digital Talking Books, in Proceedings of the IADIS International Conference Applied Computing 2006, San Sebastian, Spain, 2006, pdf.gif Download paper

2005

  • Carlos Duarte, Luís Carriço, Hugo Simões, Teresa Chambel and Nuno Guimarães, Avaliação de Aspectos de Sincronização de Livros Falados Digitais, Sistemas de Informação, Revista da Associação Portuguesa de Sistemas de Informação, N. 17, 2005, pdf.gif Download paper
  • Carlos Duarte and Luís Carriço, Users and Usage Driven Adaptation of Digital Talking Books, Proceedings of the 11th International Conference on Human-Computer Interaction (HCI International 2005), Las Vegas, Nevada, USA, 2005, pdf.gif Download paper

Funding

The RiCoBA project is funded by Fundação de Ciência e Tecnologia, Programa POSC, n.º 61042/2004.