I am pretty confident that you have a wiring issue. The only way they can stay on is if they are getting power from a different source then the circuit the fuse is on.
If you can turn the flashers on and then pull the fuse, you can then test for power through the circuit until you find where you have it. Clearly you should not have any power when the fuse is pulled so when you find power then you just passed the short.
Lastly I just want to make sure you pulled the fuse for the hazard switch and not the one for the turn signals. They are different.
Images (Click to enlarge)
Monday, November 2nd, 2020 AT 3:15 PM