There are an audible difference between 24-bit/96kHz and 16-bit/44.1kHz to my ears. But it might not be audible for every person on all kind of gear.
I suggest you give it a try yourself.
You find some free 24-bit/96kHz samples at
High Definition Tape Transfers.