1990 Chevy Blazer starter

Hey I have a 1990 chevy s-10 blazer with a 2.6L v6. I am having problems with the starter/solenoid, when I go to start it, it will click a coupe of times then when it turns the engine over the solenoid doesn't disengage even if I turn the key off. On the new starters does it come with both starter and solenoid or is it just one or the other causing this problem? When I turn it over and it doesn't really disengage it'll keep cranking until the motor gets tired i'm assuming then usually it'd start right after. Now it won't even click when I try to start it.