1997 Other Saturn Models 4 cyl Front Wheel Drive Manual

I am having an issue starting my car once the engine is warmed up. When I turn the key the first time for the day or when the car engine is cool the car starts right up. If I drive down the street or for a long time and then try to restart, all the electrics and lights come on but all I get is a click and nothing else. After a numerous attempts it will turn over. Any suggestions on what could be causing this? Thank you.