Transmission not shifting properly and there is a grinding sound, hard to shift in and out of gear

Grinding sound, hard to shift in and out of gear. To try to describe the shifting problem, it's like when you are slowing down to stop and down shift how if you go down shift down a gear and you're still going too fast, how you have to put a lot of pressure on the gear shift, and it chunks hard into gear. Well, that's how it is when shifting into second, and third. But it goes into gear without any problems sometimes. The grinding sounds reminds me of the sound that a tensioner pully makes when it's about to go out. But the noise is coming from the driver's side where there's no belts or pulleys. Noticed this morning on the way to work. When I push the clutch in, the noise gets worse.