Yes! Can be awkward.
I generally go with the philosophy of, if other people whose opinions you trust seem to like it, then give it a chance and if you still don't like it after a good listen then sell it onwards.
It's really rare that unless you have some sort of mental hang up, you won't find redeeming qualities in any piece of $150+ audio gear that a big group of people on Head Fi like. That said, there is always the opposite danger of being swept away by hype.
Luckily if you are open minded and adventurous, and not afraid to venture in to the FS forum, it all works well :3