You're quite right...
As with most small audio amplifiers with an analog potentiometer Volume control....
Inside each channel of the A-100 is an audio amplifier with a fixed amount of gain.
The amplifier itself has a fixed noise floor.
The input signal passes through the Volume control, which is a voltage divider, and to the amplifier.
If the source is noisy, that noise will be reduced when you turn down the Volume control.
However, the noise floor of the amplifier itself remains the same.
Under most situations, you don't notice the noise from either source.
However, if you do notice noise, which one is more noticeable simply depends on which is louder.
--------------
When you use attenuators for line-level signals, for example between a preamp and an amp, the amount of actual power involved is tiny, and can usually be ignored. In that situation 1/2 watt, or even 1/10 watt, resistors will generally be just fine, and that's what you'll often see inside line level attenuators.
Even the headphone amplifiers in most AVRs and smart phones really only put out at most a fraction of a watt.
So, an attenuator that you plan to attach to something like that doesn't see much power.
To put things in perspective:
If you were to connect a 60 Hz test tone to the input of the A-100...
And crank it up to its maximum undistorted output...
With the jumpers on...
Each channel could cheerfully deliver 50 watts into an 8 Ohm resistor.
After all, the A-100 is rated to deliver 50 watts per channel into 8 Ohms.
However, 50 watts is also the rated power of a typical bench-top soldering iron.
(So, if it all gets turned into heat, 50 watts is quite a bit of heat.)
At those same settings, if you substituted 32 Ohm resistors, each would only be getting 12 watts.
(This is why you really need to understand the math involved.)
I don't want to scare anyone...
And, in real life, with music, the situation won't be anywhere near that extreme...
But you can see how an attenuator, designed to handle a small fraction of a watt, might have problems.
So, if you don't know what's inside the little box, it is a good idea to find out for sure.
(Just tell the manufacturer that you want to connect it to the
OUTPUT of a 50 watt amplifier...)
Thanks to some very helpful correspondence with John Seaber at JDS Labs, I have finally come to understand that a preamp will not solve the hiss issue with the A100. A preamp can lessen the noise of a source. A preamp cannot do anything about the noise floor of an amp.
Since iFi said the iEMatch is not a good option for this purpose, I’m hoping the Garage1217 -20dB attenuator will be up to the task of handling the power of the A100. I sent them an email asking just that, so I’ll let you all know what they say.