After reading Hirsch's post and thinking about it for a bit, I'd have to say that I'd go with being blind rather than deaf.
There's a lot to sight that's repeated and overdone. It's easy enough to convey how something looks by describing an object. That is, it seems as though sight would be easier to recreate mentally. You can sort of feel a sound, but even then a lot of it is impossible to convey.
There was something we discussed in a basic psych class I took in high school. There were a few experiments with a child and a rat. When the child saw the rat, he was OK with it. Then they created a loud sound while the child saw the rat. After that, the child associated the rat with fear; the sound, not the image, had frightened him.
From that, it seems as though there's a deeper connection with sound in terms of emotion and similar sorts of things. There are, however, most likely a number of other things to consider here.
I can see myself without sight; it would be awkward, but it'd also be somewhat interesting in an exploration and discovery sense. Being deaf, however, seems as though I'd be cut off from something greater.