And then I came across this on ebay:

8 RGBs+audio input, 3 RGBs+audio output, 1 svideo/composite+audio output. Fully matrix switchable. The only problems I've encountered are that my component->RGB converter seems to not work with it (I've ordered a different type to see if that one will work) and the svideo output doesn't really seem to work with the few PCBs I've tried. This thing allows awesome output flexability; I can route any source to the cabinet AND the capture card simultaneously, or any combination I choose. Will be real useful when I get my second cab soonish. THe only real issue I have with it is that I'd have prefered one with 5bnc so I could do RGBhv; but luckily for the few sources I have that only output seperate sync, I can just use some bnc tees and it works fine.
The best part is it was only $68.
If anyone else is in a similar situation as far as inputs/output needs go, search on ebay for 'altinex' or 'extron'. Usually some of these pop up every so often. Extron stuff seems to go for a bit more, especially the monster 16x16 switches.