Well, your thread reminded me of an album I hadn't listened to in quite awhile. The album is "Stateless" by Lene Lovich originally released in 1979:
Now, the thing is, it may not be bizarre enough to meet your qualifications. I mean, it's a post-punk pop album, or what got called "New Wave" at the time. It's a pop album, so not all that weird. The albums by Devo were probably weirder than this one. Lene Lovich really does have a pretty bizarre vocal style though. Anyway, it's well recorded and I actually think it's quite good. If you want to hear some female vocals that are off the beaten path, it's got them. I guess I would say at least it's unique, rather than truly bizarre. I'm glad your thread reminded me of it.
For something much more recent, try this one:
This album by Broadcast was just released in January 2013. It is the soundtrack for an indie film. It sounds like the soundtrack for some weird 1960s horror movie. If you think you might like something that sounds like a horror movie soundtrack, check it out.
Anyway, those are just two albums that came to mind. Neither one is going to qualify as the weirdest or most bizarre stuff ever, but they're both a little out of the ordinary at least. I'd say they're both worth a spin.