Thursday, 23 December 2010

Tracking changes to web page content

I've updated my list of  services and programs that track changes to web pages at http://www.rba.co.uk/sources/monitor.htm.  I've copied the list here partly for information but also because I'd be interested in hearing other people's experiences of using them and recommendations for  any services I have omitted.

Link checkers such as Xenu Link Sleuth (http://home.snafu.de/tilman/xenulink.html) can alert you to pages that have disappeared or that are redirecting users to another site, but changes to the content are equally if not more important. There are many services that track web page content for changes. Some are free whilst other priced services may offer limited facilities as a free taster.

This lists includes both web based services and software programs for PCs and Intranets.

Web based services


Change Detection

URL: http://www.changedetection.com/

This is a free service allowing you to track an unlimited number of pages. The frequency of the alerts can be daily, weekly or monthly and you can choose to only have alerts for "sizeable changes", when content has been added or removed, or for specific keywords. The email merely alerts you to the fact that there have been changes; you have to click on a link in the email to view them in the Change Detection web site. RSS as well as email alerts avialable.

ChangeDetect

URL: http://www.changedetect.com/

The home page gives the impression that this is a totally free service. It isn't. The free trial version of this service allows you to track a maximum of 5 pages and lasts for two weeks. You can receive web page change notifications via email, ICG or text message. The subscription services allow you to track more pages and password protected pages. ChangeDetect Personal costs USD 1.95 a month and tracks 10 web pages. ChangeDetect Plus costs USD 14.95 a month for 100 web pages and allows you to set up keyword and phrase notification triggers and colour coded notifications. ChangeDetect Professional costs USD 39.95 a month for 500 web pages with content checked twice-daily.

Femtoo

URL: http://femtoo.com/

This service allows you to have up to 10 "trackers" and a maximum of 5000 characters tracked for changes free of charge. There are a number of plans that allow more trackers and additional options which can be found at http://femtoo.com/plans/. You can select the content to be tracked and how it is to be treated (text or numerical). Alerts can be delivered by email, SMS and a personal Tracker RSS Feed. Content is checked every 30 minutes.

FollowThatPage

URL: http://www.followthatpage.com/

The free service provides 100 daily page checks and 1 hourly check. You can track additions, deletions, Google page rank, keywords, and sections of a page. Alerts are sent to you by email. The Pro account gives you 1000 daily checks, 20 hourly checks, 5 10-minute checks and 100 weekly checks.

Infominder

URL: http://www.infominder.com/

The free trial tracks up to 10 pages free of charge for 30 days and allows you to associate categories and descriptions with a "minder". Within the advanced options you can specify how often, in days, the page is to be checked. The most frequent check allowed for free is every 1 day. You can also specify the minimum number of changes that must occur before you are notified and any keywords or phrases that must appear in the changes.

Infominder Professional costs USD 30/yr to track 100 pages, USD 60/yr for 250 pages, USD 120/yr for 500 pages and USD 250 /yr for 1000 pages.

Infominder Premium allows you to monitor changes up to 4 times a day and costs USD 60/yr for 100 pages, USD 125/yr for 250 pages, USD 300/yr for 500 pages and USD 500/yr for 1000 pages.

[Note: The Infominder web pages do not appear to have been updated since 2007 which does not inspire confidence.]

Page2RSS

URL: http://page2rss.com

Page2RSS tracks web pages for changes and notifies you of those changes by RSS. Simply type in the URL of the page you wish to track and then add the feed URL to your favourite feed reader. Excellent tool for pages that do not offer their own RSS feeds.

Watch That Page

URL: http://www.watchthatpage.com/

This is a free service run by ATS Consulting, a Norwegian company that specialises in software development. You can track an unlimited number of pages, which can be grouped into folders and tracked on a daily or weekly basis. There is a keyword matching option that filters the changes that are relevant to you, for example if you are only looking for news where a certain term or phrase occurs such as a company or a product name. Channels enable you to divide your pages into groups based on importance or content type. Each channel can have different properties: some can have keyword matching and daily reports whilst others can be checked less frequently and report all changes. Email alerts can include the text that has changed on your pages or just list the URLs of pages that have changed. If you are a professional or heavy user, you are required to pay a fee. Watchthatpage will notify you by email if you fall into the heavy user category.

Websnitcher

URL: http://websnitcher.com/

Websnitcher is a free services that checks your pages every 3 hours and gives you a detailed list of changed textareas. Email notifications are sent once a day and it also generates RSS feeds from the collected data. It alerts you only to what it considers are relevant changes; the intelligent filter tries to ignore changes in date and what it thinks are irrelevant textareas such as how many users are online.

Desktop programs


Copernic Tracker

URL: http://www.copernic.com/en/products/tracker/

Copernic Tracker is a tracking program that costs US $49.95. Once installed on your PC it enables you to track any number of pages on external sites and intranets. You can track changed words, new links or images. There is a useful advanced query form for tracking specific words within pages, Boolean and other search operators (AND, OR, NEAR).

Copies of page revisions are stored locally so that you can compare changes that occurred in the past and add your own notes for tracked pages and each of their revisions. There are four pre-set tracking schedules: Multiple Times per Day, On a Daily Basis, On a Weekly Basis and On a Monthly Basis. Alerts can be a tray icon, desktop alert or notification message, SMS notification, email report with the tracked page contents and changes highlighted.

Internet Owl

URL:http://www.internetowl.com/

As well as general changes to a page you can track the page for the appearance or deletion of specified text, or track selected areas of the page. You can view changes from within the program or in your browser and be alerted via email, a pop-up on your desktop or a sound. The default checking frequency - minutes, hours or days - can be changed as can the frequency for individual pages. Price: 29.95 USD. 30 day free trial.

Update Patrol

URL: http://www.updatepatrol.com/

Update Patrol checks pages for changes as often as you like and you can monitor single pages or entire web sites. It costs US $69.95 for a standard license and US $129.95 for the pro version. See http://www.updatepatrol.com/editions.html for details of the features supported by each edition. A free trial is available.

Update Scannner for Firefox

URL: https://addons.mozilla.org/en-US/firefox/addon/3362
or http://updatescanner.mozdev.org/en/index.html

A free add-on for Firefox. To monitor a page, display it in Firefox and from the right click menu select Scan Page for Update. You can select how often each page is to be scanned (from 5 minutes to once a week), whether or not to ignore numbers, and if insignificant changes are to be ignored (specify the number of characters from less than 10 to less than 1000 characters). An alert will pop-up at the bottom of the screen when changes are detected. Click the blue up-arrow on the bottom status bar to display the Update Scanner sidebar and pages that have been updated are shown in bold. Click on a site in the sidebar to view the page with highlighted changes.

Website Watcher

URL: http://aignes.com/

The full version of this software is available on a 30 day free trial. It tracks an unlimited number of pages and you can choose to ignore HTML tags, images/banners, numbers and dates. You can enter user names and passwords for password protected pages that you wish to track. Pages can be checked once a day, once a week, or on a specified day or days of the week. You can even specify the checking frequency during a day either in hours or minutes.

You can track entire sites without having to specify each page individually (not available in the Basic Edition). As well as web pages you can track RSS and Atom feeds, but this feature is not really a replacement for a fully fledged RSS reader if you are a serious news junkie.

Prices are 29.95 Euros for the Basic Edition, 49.95 for the Personal Edition, 99 Euros for a single user Business licence, 1990 Euros for a site license and 9990 Euros for an enterprise licence.

4 comments:

  1. I use Copernic, Watchthatpage and changedetect, of these I prefer Watchthatpage despite it having occasional server problems

    I haven't yet found a service that can spot sites that have revolving blocks of text that get changed on a periodic basis. The total content doesn't actually change but gets flagged as if it had

    Steve

    ReplyDelete
  2. Hi Steve,

    Thanks for the feedback. I have yet to find the perfect change tracker. For what I call standard monitoring (I don't need to know the minute something has changed) I still use Watchthatpage. It was one of the first on the scene and even though it does sometimes have server problems, as you say, it does the job. Websnitcher looks interesting so I am giving that a go.

    ReplyDelete
  3. We have used page2rss - it is a bit hit and miss.

    Google offered a similar feature as part of Google Reader but I believe it is now decommissioned?

    ReplyDelete
  4. Hi Alan,

    Thanks for the feedback. I think the problem with Page2RSS and many of the free services is that it all depends how often and when they check the page.

    Was not surprised when they announced that Google Reader had been abandoned. It was a no-go for me right from the start (see http://www.rba.co.uk/wordpress/2010/01/26/google-reader-tracks-web-page-changes/)

    ReplyDelete