All things equal, I always go with the most data possible as hard disk space is cheap. Even if there's a very high probability that you won't need it, it's easier to take lots of information and reduce it to a little, than to do the opposite. Entropy. It's the law.
Anyway, higher bitrates give you peace of mind, so it won't hurt anything. I was a boy scout. "Be Prepared." The boot of my car is half full already just with emergency vehicle repair and first-aid supplies. So you can see my mentality.
But. If they charge a serious premium, don't bother. 44.1khz is generally good enough as far as perceptibility goes.
Other considerations, if you are worried about convenience (sounds like you aren't afraid of a little) are things like the quality of your USB/S/PDIF/I2C/analogue conversion chipsets (many aren't as happy dealing with 192 kHz, as you mentioned) and CPU utilisation, which will be significantly higher with higher sampling/bitrates. This isn't an issue today, unless you are a poor soul still using a Pentium 3 in this day and age. Also, most portable players can't handle anything higher than 48kHz files, and it's a PITA to have to make additional versions of your files.