The following is a list of Jazz Albums that seem to show up in most Jazz recommendation threads as well as most top Jazz Album lists. I am pretty new to Jazz so these recommendations are based on research, not personal opinion or knowledge. (I don't even have all of these titles) Just to be clear, by first and second tier I'm only referring to how often the album gets recommended, not the quality of the music itself. I've only included titles from the late '50's and later. I might add BeBop, Big Band and Dixieland to the list in the future.
The first tier is albums that nearly always show up on any recommended\best Jazz album list. The titles in parentheses are albums that are about a half a notch down from the main album listed and would make a fine substitution if it is cheaper or easier to find.
The second tier is albums that usually get mentioned, especially if the discussion is a longer one.
This list is by no means to be considered comprehensive, its just a bunch of them that I could remember.
Finally I listed some Fusion albums that seem to get mentioned a lot. Some people think that is a good gateway from Rock to Jazz for beginners.
First Tier Jazz Albums for Beginners (Hard Bop & Beyond)
Miles Davis - Kind of Blue
Dave Brubeck - Time Out
John Coltrane - A Love Supreme or Giant Steps (Blue Train)
Cannonball Adderley - Somethin' Else
Charles Mingus - Ah, Um
Herbie Hancock - Maiden Voyage (Head Hunters)
Bill Evans - Waltz for Debby or Sunday at the Village Vanguard (Everybody Digs Bill Evans)
Wayne Shorter - Speak No Evil
Art Blakey - Moanin'
Thelonious Monk - Brilliant Corners (Straight, No Chaser, Monk's Dream)
Horace Silver - Song For My Father
Sonny Rollins - Saxophone Colossus
Getz \ Gilberto - Getz \ Gilberto
Second Tier Jazz Albums
Miles Davis - Sketches of Spain, Birth of the Cool, Miles Ahead, Milestones, ‘Round about Midnight, Steamin', Workin', Relaxin', Cookin'
John Coltrane - My Favorite Things, John Coltrane & Johnny Hartman
Oliver Nelson – The Blues and the Abstract Truth
Eric Dolphy – Out to Lunch!
Hank Mobley – Soul Station
Ornette Coleman – The Shape of Jazz to Come
Thelonius Monk – Genius of Modern Music, Vol. 1, Monk's Music
Charles Mingus – The Black Saint and the Sinner Lady, Blues & Roots
Wes Montgomery – The Incredible Jazz Guitar of …
Lee Morgan – The Sidewinder
Keith Jarrett – The Koln Concert
Clifford Brown and Max Roach - Study In Brown, Clifford Brown & Max Roach
Grant Green - Idle Moments
Kenny Burrell - Midnight Blue
Sonny Rollins - Way Out West
Dexter Gordon - Go
Jazz Fusion
Weather Report – Heavy Weather, Black Market
The Mahavishnu Orchestra – The Inner Mounting Flame, Birds of Fire
Chick Corea – Return to Forever
Miles Davis - In A Silent Way, Bitches Brew, Tribute To Jack Johnson
Return to Forever - Romantic Warrior
Herbie Hancock - Headhunters, Thrust
Pat Metheny - First Circle