2008 Other Mazda Models Clicking coming from front of car

I have a 2008 Mazdaspeed 3 I am hearing a clicking sound coming from the front of the car. I dont think its the cv joint because the car only clicks when its cold or has been sitting for a while and it only does it when I pull forward or go in reverse. And it will only do it for about 2sec and then it stops. It does not make the clicking while driving or turning, As soon as I take off it stops and even if I stop the car again down the block after I take off it wont make the clicking sound again until the car is parked and gets cold or has been sitting for a while. Also the cars clicking sounds nothing like a cv joint sound.