Thanks OK-Guy, yep, tried with several pairs of headphones, same results, weird, especially considering that I've been using a Fiio E11 with L5 since day one (i.e. pretty much never even used the headphone socket for listening).
The socket looks to be a modular component, like not part of the Walkman body, so maybe it is prone to movement, should be made of metal for this price :)