Why does my car rattle, shake and hesitate to reverse? And also when iM not pushing on the gas.

Car drives fine when Im accelarating and pushing the gas, when I release the pedal it stutters and shakes. It also does it in reverse, loud noise, hesitates and shakes. Having problems in reverse and it drives fine when im on the gas just gives me problems when not on the gas.