Usually are right click shows a delete feature.

In old XP you only need to wait for the old Network Neighborhood to notice the old places are gone. There was no control exposed to the users to delete those entries.
Bob