1995 Dodge Intrepid Fuel pump / fuel pump relay

1995 Dodge Intrepid 190000 miles

I have a 95 intrepid, and just recently the car has had problems after a cold night with starting up. When I get up in the morning after it has been cold, the fuel pump doesn't kick in to prime before I fully crank the key. I sit and listen now before I fully crank because if I don't here anything I already know it won't start. Sometimes if I get out of the car and get the ice off of the windows and get back in and try again about 5 min. Later then it primes and starts just fine. The car runs fine after it is started.
The weather hasn't been cold for about a month now and just this past weekend it got cold again and the problem started again. I will be checking the fuses again, and I want to check the relay but have no idea on how to know if it is good or not. I am hoping the fuel pump is not the problem because I have already replaced that once.
Thank you for your help.