1996 Honda Civic Grinding Noise

For the past few months my transmission, atleast I think its coming from my transmission, has been making what sounds like a rotating grinding noise. The noise starts at any random, but usually lower, RPM in first gear and continues through the rest of the gears. However, it seems that the lower the gear the louder the grinding noise is. The only time I found that this rotating sound stops is when the clutch is engaged. I am positive it is something that is rotating because when you engage the clutch and you listen closely, you can hear the griding / spinning noise slow down and come to a complete stop in about a second or so. I recently had my clutch replaced, the noise was still able to be heard before I replaced it, so my shitfing and all that is fine. Do I need a new transmission or a rebuild? Just looking for some help before I take it to a shop and get charged way over price just to have the problem diagnosed.