Detaching van be thé same problem, that the female ''barrel'' on thé iem just is to big, you can also look at thé small Ring around thé connector on thé cable, this also has a split in it you can seperate a little bit more, that's what i first tried, but that had no impact on thé sound dropping out. But after that the cable snaps in place with a more clicky sound!
This is what i Mean with that ring and what i do
This was the problem with mine