some starter relays may "stick" on and not release when the power is cut from the switch. The other possible is the switch gets stuck on, even though the key will turn and come out as "off". Check both of those.