Thank you for being a valued part of the CNET community. As of December 1, 2020, the forums are in read-only format. In early 2021, CNET Forums will no longer be available. We are grateful for the participation and advice you have provided to one another over the years.

Thanks,

CNET Support

Question

Search page Attachment downloads

Nov 21, 2014 3:12PM PST

Hello Experts

I am looking for a Application, where I feed google search link and the application would parse all the search links which come in search and if there is any ppt or pdf or word document should be downloaded in a specified folder.

Webcrawler ? can you please help me.

Regards
P

Discussion is locked

- Collapse -
Answer
Re: application
Nov 21, 2014 5:27PM PST

Not too difficult to write, maybe (depends on the exact requirements) but I doubt if you will find one ready made.

But your requirements aren't very clear:
1. A google link can be to a ppt, pdf or word document, but also to a page that has links to such documents. Do you want to download only the first category, or also the documents on those pages.
2. A google search can easily return 1,000,000 hits on 100,000 pages. Should the application only do the first page or all 100,000?

By the way, you can filter a google search to only contain certain types of documents. Then it's simply a question of downloading all hits one by one. Might be a nice work-around to do it manually that way while you learn programming or are searching for money to hire one.

Kees

- Collapse -
Application New
Nov 21, 2014 10:55PM PST

Thanks a lot Kees_B. I really appreciate your help.

Here are the in the requirement format.

1. The input URL shall be the advanced google search where the file format is only .Pdf, then next iteration would be .ppt or .pptx or .doc or .docx .. so requirement 1: Every link would have definite attachment (either .pdf, .ppt, .pptx, .doc or .docx).

2. The program should pass to the next link of the search URL if the search link has no attachment with no action (This shall not happen as only advanced link with specific format will be searched)

3. There shall be option to store the attachment in specified location

4. Yes I agree with the some limit of page or a few links as feasible to you to program.

I want to thank you ton ..

Regards
P

- Collapse -
That's the easiest variant, indeed.
Nov 21, 2014 10:58PM PST

Now start writing that app, if you can't find it.

Kees