For example on Windows XP, you should be able to open the Control Panel, double click on the "Network Connections" icon, then RIGHT click on the icon for your dial-up connection, choose "Properties" and you should see a CHECK box that gives the options for placing a connection icon in the lower right system tray.
In fact, most ISP's have an icon of their own displayed in the system tray. Which Internet Service Provider do you use?
Hope this helps.
Is there a way I can install an icon on the task bar that will show when I am connected to the internet? I am using a dial up modem. Thanks