Joe Bloggs
Sponsor: HiByMember of the Trade: EFO Technologies Co, YanYin TechnologyHis Porta Corda walked the Green Mile
Well firstly you're talking about Auditory Scene Analysis, a non-trivial feat in and of itself. You're talking about taking two waveforms (from the two ears) and decomposing them into any number of original sound sources and making out which sounds each of these sound sources is making. This is not a closed-form problem; for any given waveform input there are infinite possibilities for original sound sources and combinations (you may have had the experience of being in a somewhat noisy environment and suddenly imagining that you're hearing a sound within that noise, which you later find via other means to simply be a figment of your "imagination". This could actually be an example of mistaken Scene Analysis.
Now, different sound sources can add to and subtract from each other in unpredictable ways (e.g. total silence could in fact be composed of a world of noise together with a 100% effective pair of active noise cancellation earphones you're wearing on your head). The imperative of the brain is to make out sounds that matter to you in this jumble. In this jumble it doesn't matter if it misses out on some small sounds, particularly because your attention is limited and can only handle so many things at once. If a lion suddenly roars behind you, it's important that you hear that roar and not important that you hear some leaves rustling in front of you. On the other hand, if all that's to be heard is leaves rustling, it's important that you hear that, as you may be quietly being stalked by some predator or other. In any event, the sound of leaves rustling would be overwhelmed by the sound of lion roaring in the first case, both temporally and in the frequency spectrum. We do not know in advance what the lion roar sounds like. The input waveform could be a lion roaring and some leaves rustling, or it could very well be just a tiny bit of difference in the lion's voice. In any case, what's important is that your brain registers that there's a lion roaring.
The above are the reasons for which I think it is reasonable to expect small signals that one can hear in isolation to be drowned out by a big simultaneous signal. Of course, these are expectations that have been borne out in masking experiments. If that can happen to small signals one *can* hear in isolation, it seems way, way easier to happen to small signals that one *can't* even hear in isolation.
If the above sounds quite ad-hoc, it is--my university education in cognitive science only covered audition as a side subject, although I did my final year thesis on the subject of trying to get a computer to recognize music notes from an audio recording. All this is in any case more than a decade in my past. If you want to seriously read up on the subject, I suggest the book Auditory Scene Analysis by Albert S. Bregman. It was reference reading for my final year thesis, although I wish I had time to finish the whole of it.
Now, different sound sources can add to and subtract from each other in unpredictable ways (e.g. total silence could in fact be composed of a world of noise together with a 100% effective pair of active noise cancellation earphones you're wearing on your head). The imperative of the brain is to make out sounds that matter to you in this jumble. In this jumble it doesn't matter if it misses out on some small sounds, particularly because your attention is limited and can only handle so many things at once. If a lion suddenly roars behind you, it's important that you hear that roar and not important that you hear some leaves rustling in front of you. On the other hand, if all that's to be heard is leaves rustling, it's important that you hear that, as you may be quietly being stalked by some predator or other. In any event, the sound of leaves rustling would be overwhelmed by the sound of lion roaring in the first case, both temporally and in the frequency spectrum. We do not know in advance what the lion roar sounds like. The input waveform could be a lion roaring and some leaves rustling, or it could very well be just a tiny bit of difference in the lion's voice. In any case, what's important is that your brain registers that there's a lion roaring.
The above are the reasons for which I think it is reasonable to expect small signals that one can hear in isolation to be drowned out by a big simultaneous signal. Of course, these are expectations that have been borne out in masking experiments. If that can happen to small signals one *can* hear in isolation, it seems way, way easier to happen to small signals that one *can't* even hear in isolation.
If the above sounds quite ad-hoc, it is--my university education in cognitive science only covered audition as a side subject, although I did my final year thesis on the subject of trying to get a computer to recognize music notes from an audio recording. All this is in any case more than a decade in my past. If you want to seriously read up on the subject, I suggest the book Auditory Scene Analysis by Albert S. Bregman. It was reference reading for my final year thesis, although I wish I had time to finish the whole of it.
Stay updated on HiBy at their facebook, website or email (icons below).
Stay updated on HiBy at their sponsor profile on Head-Fi.
|