Coloresia: An Interactive Colour Perception Device for the Visually Impaired

Abel Gonzalez, Robert Benavente, Olivier Penacchio, Javier Vazquez-Corral, Maria Vanrell, C. Alejandro Parraga

Springer-Verlag, Volume 48, page 47--66 - 2013

Download the publication :

Preprint Interactive Color Perception.pdf [7.1Mo]

A signiﬁcative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to reconﬁgure the system, however several features such as these were not implemented because the current technology is limited.We are conﬁdent that the full implementation will be possible in the near future as PDA technology improves.

Images and movies

BibTex references

@InBook\{GBP2013,
  author       = "Abel Gonzalez and Robert Benavente and Olivier Penacchio and Javier Vazquez-Corral and Maria Vanrell and C. Alejandro Parraga",
  title        = "Coloresia: An Interactive Colour Perception Device for the Visually Impaired",
  chapter      = "47--66",
  series       = "Multimodal Interaction in Image and Video Applications",
  volume       = "48",
  pages        = "47--66",
  year         = "2013",
  publisher    = "Springer-Verlag",
  address      = "Berlin, Heidelberg",
  note         = "http://www.springer.com/engineering/computational+intelligence+and+complexity/book/978-3-642-35931-6",
  keywords     = "multimodal interaction; colour vision impairments; ",
  abstract     = "A signi\ﬁcative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to recon\ﬁgure the system, however several features such as these were not implemented because the current technology is limited.We are con\ﬁdent that the full implementation will be possible in the near future as PDA technology improves.",
  keywords     = "multimodal interaction; colour vision impairments; ",
  url          = "http://999840.hzjufeng.icu/Public/Publications/2013/GBP2013"
}

Other publications in the database

» Robert Benavente
» Olivier Penacchio
» Javier Vazquez-Corral
» Maria Vanrell
» C. Alejandro Parraga