I've been thinking about this for a while, especially based on recent comments by members about reviews themselves, the music used, etc.
I think what would benefit the Head-Fi community greatly is a standardized selection of music (say 14-20 songs). This list can be used by ALL reviewers, to review everything from amps to headphones.
Songs from multiple genres, a male vocal, a female vocals, an orchestral, etc.
And NOT just a list of commercial songs like (The Beatles Let It Be, etc). Because some people may have the original while others the remastered, some would have a lossless while others would only have lossy. They would have to be either royalty-free (of which there's plenty of), original songs composed by HF members, or commercial songs that have been granted license to be used only for non-resale/non-broadcast equipment reviews only.
The advantage of this standardized list is that different people can read what a reviewer or member comment says and listen for the same thing (such as "the pluck of the guitar string blah blah" or "the instruments had good separation and I felt like I was a few feet in front of blah").
It is the best way to create a level and apples-to-apples comparison. If myself and
@Nymphonomaniac are listening to the same exact version of a song (both flac etc) on the same IEM (with the same tips), the same source (say an iPhone 7 or xduoo X3), and he hears higher treble frequencies than me, then the reason must be due to his hearing (age, etc) or maybe QC variations. But the point is that when scientists are setting up experiments, as many variables are made constant and standard as possible so that the experiment can be as controlled as possible. This is already done, for example, via standardized measurement parameters for testing the frequency response of IEMs and headphone drivers.
This same basic idea has been brought up before, but from the context of when a reviewer lists what songs they used in their review, YOU get a hold of the same songs so you can hear what they heard. But again, the problem with this is that their copy of X may have been ripped from CD to flac, where I am listening to it on Spotify or YouTube (so it's not truly "the same song". Using my royalty-free music idea, and making all of the songs available for download directly from Head-Fi (as a zip file containing all songs in both flac and 320k MP3 for example)
guarantees that I
can listen to the same exact song a reviewer listened to in his review.
As far as where to find royalty-free music, here's plenty:
https://www.google.com/search?q=royalty+free+music
We would just need to agree on a standardized list of songs that are able to showcase different areas of the frequencies, different features of sound (such as sibilance and soundstage), etc.
Ideas? Comments?