That is what Audeze suggested too..
The reason you are obviously uncomfortable is because the fazors move the transducers closer to the ear by 6mm. There are not many options other than trying out microsuede ear pads which are still made out of the same material internally as the leather or sending in your unit to have the fazors removed. We try to design the headphones to fit the majority of people's heads, but sometimes it just isn't the right fit.
Usually I don't like the velour type pads because they are itchy, never tried the Audeze suede though. Internally they are the same so not sure if it will make a difference plus the Audeze pads aren't that cheap here in AU. My ears aren't "just" touching, they are really touching pretty bad now, when they were new it was OK but as I have worn them they have compressed more (in 3 days so far, will only get worse from here). Also, because the fazor is like pointy ridges, you can feel it on the ears constantly. Very annoying. The problem really shows up later, so if you do a quick test in a store they won't touch then.