I think you're talking about the rubber grommet where the cable passes through the cup?
If that is the case, it just pulls out along with the cable after you desolder the wires from the driver.
You won't hurt anything by taking it out, but by that point that you remove it, you'll have already desoldered the cable so you'll have already committed to the job. Commit bro, commit.
EDIT: It came off!! Had to use a screwdriver to force it out..
Edited by wolfetan44 - 4/24/14 at 7:05am