Thank you for being a valued part of the CNET community. As of December 1, 2020, the forums are in read-only format. In early 2021, CNET Forums will no longer be available. We are grateful for the participation and advice you have provided to one another over the years.

Thanks,

CNET Support

Question

Webpage Tracker Workaround

Jul 23, 2014 3:56PM PDT

Hey everyone, new member here.

I need to track changes to a particular webpage. Here's the catch: the webpage requires a log-in (i.e. you must log in to ever reach the page). The webpage trackers I've tried (like Versionista) return the same nonsense you'd get from typing in the URL into any unauthorized computer. Is there anyway around this? Perhaps a program that can authenticate me when necessary or some other workaround? Or even a particular tracker that bypasses this problem all together?

Thanks!

Discussion is locked

- Collapse -
Answer
I'm thinking wget and curl.
Jul 24, 2014 3:06AM PDT
- Collapse -
Still need help
Jul 24, 2014 1:15PM PDT

That will allow wget to retrieve the page as if I was logged in and wget can check the last-modified header to get the most recent version. But how will I be alerted to the change and how will I know exactly what has changed? If a change occurs, I need to know ASAP.

Thanks

- Collapse -
The thing is
Jul 24, 2014 3:20PM PDT

You would have to poll such so my bet is the server may notice and block you in time. The items I noted should do the trick but I can't write the script for you. I'm guessing you want someone to do this for you but there are forums to hire such work out.
Bob

- Collapse -
Actually
Jul 24, 2014 5:06PM PDT

Nope, just looking for help solving a problem, which ( I think) these forums are often for. If the server would notice and block me, then it looks as if the items you noted would not do the trick as far as I can tell, though I truly don't know. To clarify, all I need done is exactly what something like Versionista does which is to be sure I'm notified as soon as a webpage has a change in content and what the change is, except with a webpage that requires logging in. I'm looking to see if anyone more knowledgeable than I has a solution to this, be it some other webware, something involving tools as you suggested, a combination of both, etc. as I'm sure I am not the first to encounter and want to solve this problem.

Perhaps the condescension is in my imagination, thanks for the help either way.

- Collapse -
Re: actually
Jul 24, 2014 6:20PM PDT

Actually the best thing to do is to ask the website owner if he can help you.

Kees

- Collapse -
I'm thinking the web site master may have to help.
Jul 25, 2014 2:16AM PDT

I know what you are asking but know of no ready to use, FRIENDLY to those that don't want to write a script solution for the scenario you presented.

Because you asked, I guessed you already tried add ons like https://addons.mozilla.org/en-us/firefox/addon/alertbox/ and as such trotted out the old solution that folk have used for years (over a decade.) That is, and I apologize if anything sounds condescending but if the apps don't do what you want, then you may have to craft your own solution.

Once in a while folk get upset that others won't write scripts for them. The reason is simple and can further upset some. That is, if you write it yourself then you know what it does and how to fix it later.
Bob