Replacing velvety part of the earpiece

[injected]

Hello, recently on my eh250's the velvety part wrapped around the earpiece just came off. I was trying to adjust it to see why it was loose, and the left side of the velvet piece is bent out of shape. I have to deal with it I guess. But now I have a problem, I can't put it back on. Theres a black frame thing that sticks to the plastic molding or whatever, and i dont want to yank it out. Heres a picture so you see what I mean. The outer part is the part that is off.

Thanks!