The problem with the wiring that exists is if you've got both single-ended and XLR hooked up to your CD player, that player is likely to use pin 2 for its hot signal. If the 007t is hooked up, setting the switch to RCA will ground the hot signal, and a single-ended output on the CDP won't function. The 007t will work fine. Remember that it has to generate a + and - voltage at the outputs regardless of whether the signal is balanced or not. So, the 007t is going to have the capability to produce a phase-inverted signal, at least if one is not already present. When you flip the switch, you're using an internally generated instead of one from your source. Note that the actual phase of the amp is not determine at the input, though, but at the output. If the amp inverts the phase of a balanced signal, then using pin 3 as the "+" connector, while pin 2 receives the (-) signal, which is the reverse of normal practice, might result in correct phase at the outputs, which is where it matters.
Note that the amp receives the single ended input in parallel with pin 3, so it's going to be inverting phase of a single-ended signal also, unless phase is inverted back somewhere in the amp, in which case it's simply not going to matter.
Check phase at the output of the amp. If the + pins of the output connector have a + signal, and the - pins of the output connector have a - signal, then the signal going to the headphone will have correct absolute phase, regardless of pins used on the inputs, and anything you do with rewiring inputs or a cable mod is just going to screw the phase up.