360 with two computers

I am in college living in a small apartment with my wife and newborn. I have two pcs hooked on a kvm switch and my I ply my 360 on my lcd monitor that those computers share. Is there a way that I could hook up those two computers AND my 360 vga cable all together with out unpluging the kvm to play games?

Thanks