Hard downshift from second gear to first gear

I am having an issue with my vehicle down shifting hard from second to first gear. It happens every time I am making a complete stop. It is really only these gears that are giving me that hard downshift. When I accelerate the transmission shifts smooth into every gear. I was told it might be a vacuum leak. I am hoping its not the transmission giving out. Any comments would be much appreciated thnks.