Engine will sometimes crank but not start?

The engine will sometimes crank but not start. When this happens, its like I turned the key off. The lights and gauges on the instrument cluster are dead. I have checked all the fuses and found none bad. I think its in the ignition switch in the column because if I turn the switch off and the turn it on very quickly the engine will start. It feels like the switch is not making a good connection.