New batteries (two) leaking, overcharging, crank but not start at times and stalling

I wasn't having any problems except for speedometer gauge sporadically working. I had replaced the rear main seal, manifold gasket and PCV valve that need replaced for along time. The Jeep ran good for about a couple weeks I think after making those repairs. Then it started having a slow start, so I went to the parts store to have them check my battery and alternator they said: "battery and alternator check out okay, but the voltage regulator was not working". I put in second new battery and it to start leaking the very next day. I didn't have the money to replace the alternator so I kept driving it until I could afford to buy a new alternator. Eventually the Jeep wouldn't start after shutting it off one day,
it would crank over several times but no start. That was Friday I tried again on Monday and Tuesday as well just got the same response. I finally had it put on a rollback and brought home, thought I would try one more time and it started. So the next day I went out and tried again it started again I went to take it to a friend for help and it shut off a block from my house. The same thing happened again it would crank over but no start. This time I replaced the fuel filter and put in a different battery and primed the carburetor it started. I took it back home. Drove it one more time, but this time all my gauges stop working and it started to stall I gave it gas and barely made it off the road into a parking lot it shut off, started it shut off, started but this start it ran very rough and then shut off. Eventually, I did the same thing as before primed the carburetor and got it home to stay this time at least until I know for sure what It is and what to replace. Can the voltage regulator cause all these symptoms? Please help this frustrated Mom.