There's nothing wrong with you. Assuming the file came from the same master, no one can reliably tell the difference between 16 and 24 bit files.
So what's the point?
Well, in consumer level audio, there is none. It's only useful in the studio where producers need the additional headroom and data in the mastering process.
I sometimes keep 24/96 files on my PC since I've got about 2TB of bulk storage in there but most of the time, I just downsample and convert...