1993 Ford Escort fuel

I have a 1993 ford escort I had to replace the fuel pump. After replacing the fuel pump along with fuel filter when I take a right turn the car starts to sputter like it is out of gas this did not do this before the fuel pump broke. I have used a fuel system cleaner, I also replaced the fuel pressure regulator but it still does this only when right hand turns are made when I take my foot of the gas for a few seconds it goes back to running normal but if I keep my foot on the gas when it is doing this the car will stall