has nothing to do with another programs shortcuts. When you removed the shortcut from the task bar you just eliminated that way to start IE.
Windows 8 is a bit different from Windows 7 as it has a desktop mode and a Metro mode which each has it's own interface to IE. The difference is noticeable.
From what I read is when you install another browser the Metro IE will then launch the desktop version of IE all the time. But what you can do is not make IE the default again but go into Metro and right click on the IE metro shortcut and click pin to taskbar.
What you can do is follow the instructions on this link.
http://www.tekrevue.com/tip/how-to-restore-metro-mode-for-internet-explorer-in-windows-8/
An issue came up that I wanted to check out on Internet Explorer. I set Firefox as my default and 'unpinned' Internet Explorer from my taskbar. So I went to "programs" on my classic shell start menu, and it wasn't listed. I know I can download a copy, but I didn't "uninstall" Internet Explorer.
Dell Inspiron 3647, 3.0GHz, all windows updates
Thanks in advance for any assistance,
Eddie

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic