There was the time a fifth grader thought it would be funny to punch the blind kid and run. So he snuck up on Ben Underwood and hit him in the face. That's when Ben started his clicking thing. "I chased him, clicking until I got to him, then I socked him a good one," says Ben, a skinny 14-year-old. "He didn't reckon on me going after him. But I can hear walls, parked cars, you name it. I'm a master at this game."
I'm sure some of you saw
this story over at
mindhacks, and I'm sure many of you also know I just attended the summer institute for cognitive neuroscience in which the first week was devoted to Neural Prosthetics. One of the talks by
Beata Jarosiewicz covered a very interesting and pertinent topic. There is a system which has met with some astounding (if not very limited- I'll get into that more later) success. The vOICe system (haha.. get it... "ohh I see!"..ohh geez) creates complex sounds based on what the video system sees.
From Beata's presentation:
Left and Right Image is scanned left to right, one snapshot per second. So left and right get encoded by time (and stereo). Dark and Light Brightness is encoded by loudness: the brighter the visual pattern, the louder the sound. Up and Down Elevation is encoded by pitch: the higher the position of the visual pattern, the higher the pitch.
These sounds which impart all sorts of information are very very obnoxious (well at least to me). This is one of the potential problems with blind people using this system. Many blind people have come to depend on having a good sense of hearing to navigate through the world and if that's taken up with the vOICe system then you could imagine a number of people not liking it. Here is a
video of the vOICe system in action - you can see what the system is "looking" at and the sounds it makes in response to the various environmental stimuli.
Besides the obvious drawbacks of the system it has met with some astounding success.
From Beata:
2000: “Well the other day I was again washing dishes. I had let the water out of the sink and turn to get a towel to dry my hands. Then when I turn back to rinse the sink I was stunned to see the sink in a “depth” like image. I stepped away from the sink and walked slowly up to it again to see if my mind was playing tricks on me. No, the feeling of seeing depth in the sink bowl was still there.”ound?.... No, It is by far more, it is sight! There IS true light perception generated by the vOICe. When I am not wearing the vOICe the light I perceive from a small slit in my left eye is a grey fog. When wearing the vOICe the image is light with all the little greys and blacks. Yet a definite light image.”
2002: “Just sound?.... No, It is by far more, it is sight! There IS true light perception generated by the vOICe. When I am not wearing the vOICe the light I perceive from a small slit in my left eye is a grey fog. When wearing the vOICe the image is light with all the little greys and blacks. Yet a definite light image.”
- Pat Fletcher, long-term vOICe user
This brings up all sorts of interesting questions about cortical reorganization and consciousness. But that's for another time and place.