Driver and passenger door switches not working

My vehicle currently will not roll down any windows from the driver side. The lock button and mirrors also do not work. It will unlock only. After this failed the passenger side window will not roll down from its own side either. But if you take the switch from the passenger side to the drivers side and hook it up, it will roll down the driver side window and lock and unlock all the doors except the passenger. Both the rear windows work from their own buttons. We got a switch from a junk yard, and it is doing the same thing. The passenger side still is not working either. We fixed the bad ground on the B pillar, and I tested the wires coming into the switch and they have voltage. All the fuses tested well, I tried disconnecting the battery and waiting fifteen minutes, that also failed. What else could it be?