Well, first you'll need a signal generator, they're kina expensive new, but you can probably find a cheep one at a surplus store, or even DIY one yourself...
Then, simply hook up the signal generator to the inputs of your amp, and set a voltage and frequency (and type of wave)
Then connect the 10X probe to one channel of your scope, and clip the ground clip to the ground, and touch the output with the probe.
Then, adjust the scope, set it to AC, and set the dials to the corresponding voltage and frequencies you set in your function generator...
If you see a nice cleen output, then the amp is stable, if you see it occillating (you'll see it), then there's a problem...
Lots of cool things to do with a scope, i'm sure there are online resources that will teach you how to use it... Its a really important tool for building, designing, and troubleshooting amps, too bad they're simply too expensive for most of us