Front end rattles on both corners without breaks applied

I have a 2003 2500HD 6L 4x4 with 100K that when I drive on a dirt road have a heavy rattle in both front corners. It is more pronounced in the Left front. The rattles stop as soon as I apply the breaks. Do the caliper bolts wear the mount?

My other truck is a 2004 2500HD 4x4 Duramax with 95K and the left front is just starting to rattle on rough dirt just as above.

The intermidiate shaft is was a changed on the 2003 but never was a problem on the 2004.