The HSV attributes of the pixels are mapped into sound parameters, respectively as pitch, timbre and volume. Saturation, measures the deviation of the color from gray and Value conveys information about the color's brightness. To convert image into sound we use the Hue, Saturation and Value (HSV) color model where Hue contains information about the 'pure color' of the pixel. A high rate works best if fast information about the environment is necessary, as when moving in crowded urban areas a low rate is more suited if details of a scene are needed.

The flow of the synthesized audio depends on the camera's scanning rate, which is user controlled. The prototype can process either a still image or a live video feed, weaving a tapestry of sonic particles of varying complexity. These sound events convey what the camera captures, giving information about the colors that surround the user, the amount of darkness/light, and the location of light sources. Therefore, when a single image or video frame is 'played', the result is a composition of elementary sounds originated directly by the pixels' values. Our research deals with the conversion of a digital image into its sonic print, where each pixel and pixel properties have an associated sound. It can also help anyone to sonically decode visual information, without directly observing or having access to its source.Ī digital image is a composition of discrete elementary units of color/light, its pixels. The tool aims specifically at aiding the visually impaired to navigate through and assess the surrounding environment. Nuno Correia, CITI, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, PortugalĬreate a device that converts color information from live video and still images into sound, mapping color attributes to sound parameters such as pitch, timbre, volume and sound location. Michele Mengucci, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, Portugal and Lab-IO, Portugal Sofia Cavaco, CITI, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, Portugal Tomás Henriques, Buffalo State College NY, USA and CESEM (FCSH), Portugal

Abscissa de um ponto