You can, here is an impression where the author mixed and matched the two combos http://www.head-fi.org/t/643368/schiit-modi-and-magni-comparison-to-bifrost-and-asgard
Perfect - exactly what I was looking for.
Sounds like the Magni/Modi will get the job done for me. Can't find any significant reason to get the larger cousins. (For my use)