I wouldn't risk it. Without getting too far into the weeds, AV programs, by necessity, have to worm themselves pretty deep into the OS. Even though you may have disabled the obvious parts, others are likely still running and can cause problems.
Also, be careful. Not sure if they're still doing it, but for a while at least Norton was practicing something of a scorched earth policy. If you uninstalled their software, it'd disable all your network connections. They had some BS line about it being for security reasons, but it was punitive, plain and simple.
If you don't like Kaspersky, you can always put Norton back on, so aside from saving a little extra work, there's really no point to doing what you want to do.
I am aware that if two or more internet security programs are installed on the same computer, they will conflict with each other. Just wondering if this will still happen if one of them is disabled but still installed. The reason is I am intending to change security software from Norton to Kaspersky but don't want to uninstall Norton until I'm definitely happy with Kaspersky.