What Is Noise Vocoded Speech and What Has Been Learned

Question

Examlex · Accepted Answer

The Answer is Noise-vocoded speech is created by dividing the speech signal up into different frequency bands and then adding noise to each band. This process transforms the spectrogram of the original speech stimulus into a noisy spectrogram. The loss of detail in the frequency representation of the noise-vocoded signal transforms clear speech into a harsh noisy whisper.
Subjects in Matthew Davis's (2005) experiment listened to a vocoded sentence and then wrote down as much of the sentence as they could. This was repeated for a total of 30 sentences. Performance was near zero for the first three sentences, and then increases, until by the 30th sentence, subjects are reporting half or more of the words. The increase in performance is important because all the subjects were doing is listening to one sentence after the other.
What information do listeners use to achieve this clearer understanding
One hint comes from experiments in which subjects first listened to a degraded sentence and wrote down what they heard, as before, and then heard a clear undistorted version of the sentence, followed by the distorted sentence again (hear degraded sentence ? hear clear sentence ? hear degraded sentence again). Subjects reported that when they listened to the second presentation of the degraded sentence, they heard some words they hadn't heard the first time. Davis calls this ability to hear previously unintelligible words the "pop-out" effect.
The pop-out effect shows that higher-level information such as listeners' knowledge can improve speech perception. But this result becomes even more interesting when we consider that after experiencing the pop-out effect subjects became better at understanding other degraded sentences that they were hearing for the first time. Even more interesting, the pop-out effect and later improvement in performance also occurred in a group of subjects who read the sentence after hearing the degraded version (hear degraded sentence ? read written sentence ? hear degraded sentence again). What this means is that it wasn't listening to the clear sound that was important, but knowing the content (the speech sounds and words) of what they were hearing that helped with learning.

What Is Noise Vocoded Speech and What Has Been Learned

Definitions: