Certainly. The typical approach in circuit design is to place much smaller decoupling caps that do block the high frequencies at the supply terminals of any active parts susceptible to high frequency noise on the power lines. While they might not sit in the group of components on the circuit board that you'd draw a circle around and label "power supply circuit," they are still certainly an important part to proper power conditioning in the circuit design.
I was thinking of this quote when I wrote about EE's getting butthurt when it is implied that their product is poorly designed:
The butthurt thing was only meant as a joke.
But what you write is 1,000 % true.
I will say no more about this as it will derail the thread.