Car will not start unless jumped?

I changed the battery which was recharged and replaced the alternator. When trying to start the car, the lights come on until I move the key into the start position. When the key hits start, I get one click and everything turns on until resetting the battery. The car will jump but only then will it give more than one click and actually start cranking.