Honda Civic 2004 noise when I relaese the clutch and take off

The throw out bearings usually when they go bad you hear them make noise when you push the clutch in not after you release the clutch pedal. My guess is you could have a bad input shaft bearing in the transmission. But you would have to pull the transmission and start by see if there is any play in the input shaft and see if you can feel or hear anything while turning the shaft by hand. You can hear the noise in neutral idling also?If so then there is a good chance you have a bad input shaft bearing. Can't say for sure unless you get in there and check it out.