Hmmm, perhaps I should just exchange mines.
I just sent my player back to Musicteck for this same reason. I think the mechanism is broken on the inside, as like you said it no longer pops back out.