Intermittent starting, clicked, but would not turn over

Failed to start, so had it towed home. Change starter. Started three times very cleanly when tested, but on one of the starts, there was a slight delay from turning the key to the engine starting to turn over. This delay was noticed occasionally prior to it failing to start at all. Fourth and subsequent attempts click but don't turn over engine.