Bob
I'm looking for software that will monitor a web directory for new files and automatically download the new ones. Does such a thing exist? What is it called?
For example:
A friend hosts a web directory with PDF's of his e-magazine at http://100.100.100.100/magazine/pdf (sample site, obviously). I want software to monitor that site and only download the new ones.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic