Heater only blowing air out the defrost vents

So, we tried using the heat in the car, but it only works on the front windshield. It won't blow air directly at us, we can't figure out why it how to fix this problem.