Friday 30 December 2011

Google shows postcode boundaries - sort of

Google has started showing UK postcode area boundaries but not in Google maps as one would expect. Using the standard Google search box type in your postcode and at the top of your results Google shows you a map with the boundaries of the postcode area.


Although the boundaries are in roughly the right area, they are not accurate. In this example, the coverage of RG4 5BE extends north and south to the top and bottom of Star Road. Others have reported similar discrepancies in their areas. As a general indication of the location of a postcode area it is fine but do not rely on Google to identify which streets or parts of streets are covered by it. Google also gives information on the nearest bus stop, which in this case is correct but not the only option. If you click through to the full sized Google map the boundaries disappear and they do not appear at all if you do the search straight away within Google Maps. You do, though, see more information on the public transport options.


Alternative bus stops are given and the numbered routes listed. I was rather puzzled by the number 74 and 74 A, which  have never seen, but a quick check revealed that it is the "football" bus that runs once a day and only when there is a match at the Madjeski Stadium. The scheduled times for the next buses are as accurate as the bus company timetables provided via Traveline and Transportdirect. I watched three buses arrive and compared it to Google's schedule: the number 800 was 7 minutes late, the first number 23 was 6 minutes late and the second on time so Google is not using real time data.

Overall, it's not bad. Just remember that the postcode boundaries are approximate so if you need something more precise use the Royal Mail web site. The bus timetable will not tell you if a bus is delayed or cancelled but if you are contemplating moving to the area it is a quick way of assessing how good (or bad) the local public transport is.

Thursday 29 December 2011

Official companies register for the Ukraine

The Ukrainian official companies register can be found at http://irc.gov.ua/ua/Poshuk-v-YeDR.html. The interface and information is in Ukrainian only but Google's translation option does a good enough job to help you through the site. If you use Google Chrome as your browser you can enable its automatic translation prompt by going to Options, Under the Bonnet, and ticking the Translate box. Many thanks to Ladymyr Bondar for alerting me to the site.


Friday 9 December 2011

Online Information pre-conference workshop: Searching without Google

The slides for my workshop "Searching without Google", 28th November 2011, are available on authorSTREAM and Slideshare


There is also an addendum to the presentation that summarises some of the questions and answers covered throughout the day together with "top tips" and sites that the participants themselves suggested. This is also available on authorSTREAM  and Slideshare

The text of the addendum is reproduced below.

Tools for creating your own search engine

Several people said they will investigate setting up a custom search engine for their preferred sources and frequently used web sites. Google's custom search engine is at http://www.google.com/cse/ and Blekko.com lets you set up 'slashtags' to create lists of sites for searching. One person said that they are going to try both and compare ease of use and results.

What can one do when the link to the Google's advanced search screen disappears altogether?

The link to Google's advanced search screen has been moved to the drop down menu underneath the cogwheel in the upper right hand corner of your screen, but several reported that it had even vanished from there for a couple of days last week. Next time you use the screen bookmark its URL so that you can go directly to it (of course Google can always change that!). Also learn the advanced search commands e.g. filetype: site: etc. so that you can type them into the standard search box.

There is a list of commands at http://www.rba.co.uk/search/SelectedGoogleCommands.shtml (also a PDF version)

(The GoogleGuide list of commands at http://www.googleguide.com/advanced_operators_reference.html was last updated in 2008 and contains commands no longer in use)

Tools for monitoring social media and alerting you when a subject is mentioned

Although Google and Bing both include social media in their search results it is often better to use a tool designed specifically for the job. All three of the following offer RSS alerts for searches.
Topsy.com –  searches tweets, videos and photos on Twitter, and now Google+

SocialMention.com (can be slow at times) – blogs, Twitter, bookmarks, video, audio

Icerocket.com – blogs, twitter, Facebook, images

Are there still some directories alive and updated e.g. DMOZ? Or is the war of directories vs search engines over?

The Yahoo directory is still online although it is not easy to find and it has not been updated for several years. Similarly, some sections of DMOZ appear not to have been updated for at least a year and the entries under some headings look like advertising. The day of the mega-directory may be over but specialist and subject specific listings are still being developed. They do, though, require considerable time and effort to maintain and inevitably some are forced to close because of a lack of funding e.g. Intute.

Are there good tools for events search by subject, region, date?

The events databases that some of us accessed via services such as DataStar have long gone so it is not possible for example to search for events on nanotechnology taking place next year between June and September in Europe. Possible alternative search strategies include:

- identifying major events venues and their calendars
- locating relevant trade and industry newsletters, portals, magazines that may list events in their sectors
- relevant trade and professional bodies and associations

Are there tools that search the live web rather than using indexes of cached pages?

Biznar.com, Mednar.com and some social media search tools search the "live" web but they are limited to searching a small number of sites and are slower than Google and Bing in returning results. There are no free public search tools that search the entire web live – it would take far too long – and by the time the search engine would have finished the information would be out of date!

Searching for scientific publications that are not published in major English language journals

Google and Google Scholar are still a good starting point for this type of search, but it was suggested by several of the workshop participants that Open Access journals could also be investigated as well as national digitised collections and subject specific listing and portals.

Searching news in other languages (alternatives to Google News)

Country versions of Google News give priority to local content but you can identify news sources in individual countries at the Newspaper & News Media Guide http://www.abyznewslinks.com/. You cannot search the publications from this site but it will tell you what is available and the language of publication.

What will be the trend of the next 5 years? More competition? More takeovers of the smaller search engines? More specialist tools?

All of that! Many smaller specialist search tools continually emerge and many of them quickly disappear or are bought up by the competition. It is impossible to predict exactly what will happen, or even if Google will remain the dominant search tool on the web. If Google's popularity starts to wane it probably will not be because a "Google-killer" arrives on the scene but because Google goes too far in trying to take control and automatically "improve" results for users. Many of us feel that it is already going in that direction.

Top tips and tools to try back at work

  1. Custom Search Engines – use Google CSE (http://www.google.com/cse/) or set up a 'slashtag' on Blekko.com so that you can quickly and easily search those sites you regularly use. Note: they will not include password protected sites or sites where you need to conduct a database search

  2. Biznar.com – real time federated search of selected key business resources

  3. Chemspider.com – brings together chemical information from a wide range of resources. Maintained by the Royal Society of Chemistry

  4. Investigate image search sites other than Google. (Multicolr http://labs.ideeinc.com/multicolr/ was specifically mentioned

  5. Paper.li – gather together tweets and/or Google+ posts containing links based on keywords or from a user and their twitterstream. Results are presented in an easy to read newspaper style.

  6. http://www.zanran.com/ – searches for data and statistics contained in graphs, charts and tables

  7. http://duckduckgo.com/  – alternative search engine that does not customise or personalise your web results

  8. http://integrals.wolfram.com/ - Wolfram Mathematica online integrator. Ideal for maths homework.

  9. http://www.coremine.com/ – Norwegian initiative providing an interesting visual interface to the biomedical literature

  10. Central Index of Digitized Imprints (zvdd) http://www.zvdd.de/ Access to and search options for German digitized works from the 15th Century to the present. Collections are listed at http://www.zvdd.de/dms/browsen/. See also http://www.europeana.eu/portal/  "to explore the digital resources of Europe's museums, libraries, archives and audio-visual collections"

Sunday 20 November 2011

Yahoo Site Explorer closes - try Blekko instead

A reminder that Yahoo Site Explorer is closing down tomorrow (November 21st ) and I assume that the link and linkdomain commands will go with it, although they are not specifically mentioned (http://www.ysearchblog.com/2011/11/18/site-explorer-reminder/). Webmasters are being told to use Bing Webmaster Tools. This enables you to analyse links to your own domains but is no use if you want to find who links to other web sites as part of research. Bing, or Live.com as it then was, removed its link and linkdomain commands in November/December 2007 and Yahoo was left as the only reliable alternative. The link command enabled you to find who linked to a specific page on the web and linkdomain found links to anywhere on a specified web site. Both were useful ways of finding other sites containing similar content and discovering what others were saying about a page. Google's link command is useless as it picks up a minuscule number of results, which now leaves Blekko (http://blekko.com/) as the only realistic alternative.

Blekko enables you to track down linked pages in two ways but both lead to the same results. The first is to use their slashtags '/links' and '/domainlinks' with a URL or domain name. For example http://www.rba.co.uk/sources/registers.htm /links will find pages that link to my official company registers page whereas http://www.rba.co.uk/ /domainlinks finds all inbound links to my site rba.co.uk.

The second route is via your search results. Below each entry is a downwards pointing arrow. Click on this and select 'links' from the pop-up box.



You will then see a list of sites that link to that page.

To view inbound links to the whole of the web site click on the seo option below the result and you will see some statistics together with the total number of inbound links.



Click on the inbound links number and Blekko presents you with a list of domains containing links to yours and how many.


To see exactly where the links are located and where they go to on your site just click on the number in the links column.


I have only looked in detail at a couple of sites but Blekko seems to do a good job and is certainly far superior to Google. The Blekko data on my own site seems to correspond with that available from Bing Webmaster Tools but of course I cannot compare other sites in the same way. My initial thoughts are that for link searching Blekko is definitely worth adding to your research toolkit.

Friday 18 November 2011

Google: Verbatim for exact match search

Well it looks as though the user feedback to Google on the discontinuation of the +/plus sign for enforcing an exact match search has paid off. Google removed the plus sign as a web search option a few weeks ago and told searchers to use double quotes around terms instead.The double quote marks option does not always force an exact match and increasingly Google is ignoring them and making  some of your search terms optional. (See my blog posting Dear Google, stop messing with my search, http://www.rba.co.uk/wordpress/2011/11/08/dear-google-stop-messing-with-my-search/). The official reason for the change was that hardly anyone used it: the real reason has become clear with Google implementing its Google+ Direct Connect Service. This enables you to go direct to an individual's or company's Google+ page by prefixing their name with the plus sign, for example +BASF.

For those of us who really do NOT want Google to second guess what we are looking for there is now a Verbatim command. Google's Inside Search blog (http://insidesearch.blogspot.com/2011/11/search-using-your-terms-verbatim.html) says:

  With the verbatim tool on, we’ll use the literal words you entered without making normal improvements such as
  • making automatic spelling corrections

  • personalizing your search by using information such as sites you’ve visited before

  • including synonyms of your search terms (matching “car” when you search [automotive])

  • finding results that match similar terms to those in your query (finding results related to “floral delivery” when you search [flower shops])

  • searching for words with the same stem like “running” when you’ve typed [run]

  • making some of your terms optional, like “circa” in [the scarecrow circa 1963]

So be warned: when using Verbatim you are rejecting Google's "improvements"!

Verbatim can be found in the options on the left hand side of your results page, which means that you have to run your search before you can implement it. Go to the menu to the left of your results and click on 'More search tools' at the bottom. This will open up a menu that includes the Verbatim option.


It works!. When I run a Verbatim search on St Laurence I get only St Laurence and not St Lawrence as well. And my Heron Island Caversham UK parrot search now finds only those pages that contain all of my terms. There is one drawback in that Verbatim is all or nothing. I often want to have an exact match search on just one or two of my terms but am happy to have Google mess around with the remainder. Verbatim works on your whole search strategy but I think that you can include advanced search commands in your strategy. Running searches such as '"Heron Island" Caversham UK ~parrot' or '"Heron Island" Caversham UK parrot OR pigeon' followed by Verbatim gives me what I would expect. However, more complex searches incorporating filetype: and site: gave me very bizarre results. I need to do more research on this part of the strategy.

Overall, I welcome Verbatim and thank Google for listening to its users. However, as Phil Bradley has said it is a tool that "Google should not need to have created" (Google Verbatim tool http://philbradley.typepad.com/phil_bradleys_weblog/2011/11/google-verbatim-tool.html)

Monday 14 November 2011

Free UK company information: Company Director Check

Company Director Check (http://company-director-check.co.uk/) is a sister database to Company Check (http://companycheck.co.uk/), which I reviewed earlier this year (http://www.rba.co.uk/wordpress/2011/01/10/free-uk-company-information/). It provides free access to information on current and past directors of UK companies that until now has only been available for a fee. Director searches can unearth links between apparently unrelated companies and help you identify "families" or groups of companies. It can also bring to light interesting patterns of behaviour. For example, I carried out a search on a director whose business activities had aroused my suspicions. I knew he had run companies in the past that had been dissolved and his most recent venture had gone into liquidation. Looking at the list of companies of which he had been director it became clear that 6-8 weeks before a company was dissolved or went under he would set up a completely new company. This had happened so often that it was not just me who had begun to smell a rather large rodent. I understand that he is "currently under investigation"!

If you are viewing a company in Company Check click on the director's name and you are taken straight to their record in Director Check. Alternatively just run a search on the person's name in Director Check. A list of possible matches will be presented to you, which you can refine by entering a postcode. Alternatively just work through the list until you are certain that you have found the correct person. Do not be surprised if you find a director has multiple IDs. There is nothing "dodgy" about this, it just reflects the way the system has evolved over the years. Companies House have carried out a massive exercise to try and fix this but there are still some multiple IDs in the database.

The information that is provided includes full name, short name, month and year of birth, address and past and present directorships.


The status of each directorship - active, dissolved, resigned - is displayed followed by a summary of each of the companies. More detailed information on the individual companies can be found on the Company Check web site.

Now that so much directorship information is freely available it will be interesting to see if more directors make use of the option to provide a service rather than their home address for the public record.

Definitely one to add to your business research toolkit.

Tuesday 8 November 2011

Dear Google, stop messing with my search

I have been complaining for several months that Google does not always "AND" your search terms and delivers results that do not contain all of your terms, or their synonyms, in the page itself or in links to the page. There was a time when you could force Google to deliver exactly what you wanted by prefixing your terms with a plus sign. That option has now gone and Google says that you have to use double quote marks around your terms and phrases instead. Not only is it tedious to have to surround every term with "..." but it does not always work!

The evidence
I recently took a photograph of autumn leaves on Heron Island in Caversham and uploaded it to Flickr. At the time I hadn't noticed that there was a bird hiding amongst the leaves and when it was pointed out to me I assumed it was a pigeon of some sort. Someone else, however, thought it might be a parrot. I have not heard of any sightings of parrots in my area but decided to check Google to see if there were any reports. My first search strategy was parrot "Heron island" caversham UK


Over 8,000 results! Unbelievable - which it was. Looking at the top results and their cached copies revealed that Google had decided to forget about parrots or birds of any kind and look for just "heron island" caversham UK.


Changing the search to "parrot" "Heron island" caversham UK reduced the number of results to 84.

This time Google was leaving out Caversham or UK or both. Amending the strategy yet again so that both caversham and UK were within quote marks reduced the number of hits to 23.


 There were a handful of directory listings containing all of my terms but the rest contained only one or two of my terms, for example the Tripadvisor page shown below.


There was no obvious logic as to why these irrelevant pages had been chosen by Google - remember that the grand total was a mere 23 - and they were not advertisements. Using advanced search and the allintext option made no difference whatsoever. For the final version of my search Bing found 15 pages that contained all of my terms but sadly nothing to do with parrots in Caversham, UK. DuckDuckGo found three documents but again no sighting of a parrot of the feathered variety in my neighbourhood.

I was disappointed that my original identification of the bird seems to have been correct but extremely annoyed with Google. I had to wade through irrelevant documents and wasted time tweaking my search only to find that Google was ignoring my strategy anyway. I could understand it if my search had zero results and Google wanted to give me something, but there were some documents that did have all of my words. Various scripts that automatically add quote marks around your terms have been written since Google withdrew the + sign for general searching. These really aren't much help because I sometimes want Google to look for variations of some of my terms and Google seems to be ignoring the quotes marks when it feels like it. More reasons to look seriously at the alternative search tools that are out there.

Monday 7 November 2011

DuckDuckGo - silly name but a neat little search tool

Fed up with Google ignoring your search terms and giving you something completely different? Confused by irrelevant tweets and postings in your results? At the recent Internet Librarian International conference in London one of my fellow participants told me that he would not mind Google collecting his search and personal information if it gave him better results but he said that it seems to make them worse. Judging by the comments from some of the other conference goers Google's attempts at personalisation and semantic search are not always delivering what the searcher needs. There are several steps you can take to try and depersonalise your results but even then Google can still mess up the search. Perhaps it's time to seek out a different search tool.

Yahoo is now using Bing's database and search results for web and image search so you might just as well go straight to Microsoft's Bing (http://www.bing.com/). The trouble is that Bing is starting to behave like Google by messing with your search terms (Bing becomes more like Google and personalises http://www.rba.co.uk/wordpress/2011/10/07/bing-becomes-more-like-google-and-personalises/). So what are the other serious alternatives? DuckDuckGo (http://duckduckgo.com/), also known as DDG, may have a silly name - it certainly put me off from using it for some time - but once you get over that it does have a lot going for it.

It has been around for a while and when it was launched one of its main selling points was that it does not track or share your search and web browsing habits, or try to personalise your results (see https://duckduckgo.com/privacy.html for more information). That's all very well but how good are the results?

The home page is minimalist as are most search engine's these days.


As soon as you start typing  you'll notice that there are no suggestions appearing in a drop-down menu below the search box. Some may regard that as a good thing but I do occasionally find them helpful if I am researching an unfamiliar area. In compensation DDG offers "search ideas" on the results page that make up for the absence of suggestions and related search options. The results page is clean and uncluttered with search ideas on the right hand side of the screen. You add one of the "ideas" or terms to your search simply by clicking on it, but you cannot add more than one and the search ideas disappear from subsequent results pages. The only way I can see of adding more than one is to type them into the search box yourself.


When you hover over an entry a "more results" link appears that finds more articles from that site and if you look at the results URL you will see that the site: command is used. There is no link to an advanced search screen but there are an incredible number of what DDG calls "Goodies". The ones that I have found to be most useful are:
  • site: followed by a domain name -  searches for your terms within the specified site
  • inbody:  followed by your search term - looks for your term in the main part of the page
  • intitle: followed by your search term -  looks for your term in the title of  the page
  • filetype: followed by a file extension - looks for specified file formats containing your terms
  • sort:date to sort by date (uses results from Blekko)
  • region: followed by the standard two letter country code e.g. regions:fr to boost pages from France
Then there are the DDG !bang commands (https://duckduckgo.com/bang.html). These automatically take you to other search engines, for example your search terms followed by !images runs an image search on Google and !videos will run a video search on Bing. Details on general syntax, keyboard short cuts and 'tech goodies' are at  http://duckduckgo.com/goodies.html  and  http://duckduckgo.com/tech.html. It all looks somewhat daunting but it is worth working your way through them and drawing up your own list of what you think you might use on a regular basis. If you still find it all a bit too much to take in then use the options under the arrow next to the search box at the top of the results page. This brings up a menu of some of the more popular types of searches.


For some searches DDG gives you a red box at the top of the results page containing "zero-click" information extracted from pages and DDG's Topic Lists for example a possible answer to your question or the result of a conversion/calculation. For a search on Mapledurham watermill it gave me a description and link to Wikipedia along with links to DDG Topics Lists for Grade II* listed buildings in Oxfordshire and museums in Oxfordshire.



My request to convert euros into pounds came up with a calculation generated by Wolfram Alpha.


Would I use DuckDuckGo as my default search tool? Difficult to say at this stage. I do miss Google's time search option but DDG's sort:date goes some way to offset that, and I regret to say that there are times when I miss Google's localisation and personalisation. Looking for pubs or restaurants in Reading and Caversham is so much harder in DuckDuckGo. However, I am getting a feel for the type of searches that work well on DDG and for general web searching it is a good alternative to Google and Bing. It does not play around with your search terms, supports advanced search commands and most important of all it delivers relevant results, some of which are not always in Bing or Google.

Wednesday 26 October 2011

Google dumps '+' operator

You will either have read about this on other blogs or found out yourself when searching that Google has dumped the '+' operator. This was a useful way to stop Google automatically searching for variations and synonyms of your terms. The theory was that by prefixing your term with a plus sign Google would be forced to look for an exact match. Try it now and Google tells you to use double quotation marks around the term instead. To be honest, the + sign has not worked reliably for several months but I often have the same problems with the double quotation marks. If I search on St. "Laurence" or "St. Laurence" Google still includes page on St Lawrence in my results.

Search Engine Land has covered the news and the reason why + has been dumped in "Google Removes The + Search Command" http://searchengineland.com/google-sunsets-search-operator-98189. It suggests + has been dumped because of Google+, their social network, and Google now suggests auto completing your friend’s names when you use the operator. As Danny Sullivan comments "it seems to have been tossed out and replaced by quotes because of a problem Google created for itself, by picking stupid names for its social network."

I've noticed anther worrying trend - Google does not always look for all of my terms in the page. Viewing the cached copies of some of my results I see that not only are some of my terms missing from the page itself but they are not even in links to the page. So is Google now deciding when to 'OR' our search terms?

Friday 7 October 2011

Bing becomes more like Google and personalises

So you thought you could escape filtering and personalisation of search results by fleeing Google and running into the arms of Bing? Afraid not. Bing has announced that it is rolling out a new personalisation feature called adaptive search. Details are on Bing's blog Adapting Search to You (http://www.bing.com/community/site_blogs/b/search/archive/2011/09/14/adapting-search-to-you.aspx). According to Bing the “more you search, the more Bing can learn”.

The feature is being rolled out first in the US and is cookie based. The cookie and personalisation lasts for 28 days if you are not signed in to Bing and 18 months if you are. You can clear and turn off your search history at any time.

Bing seems to be trying to be more and more like Google all the time. I tried one of my test searches on Hewish mild and Bing did a Google on me by unilaterally deciding to include results for Jewish mild in my results. Placing a plus sign before Hewish did force an exact match but the related searches it offered me all involved Jewish - Jewish Chronicle, Jewish jokes, Jewish festivals etc. Yahoo does exactly the same, which is not surprising since it uses the Bing database and search algorithms.

Wednesday 5 October 2011

Build your own web naughty list on Google

Google first announced that it was introducing an option for users to exclude web sites from results in March of this year (Google lets you create your own naughty list http://www.rba.co.uk/wordpress/2011/03/12/google-lets-you-create-your-own-naughty-list/). Then it disappeared, reappeared, disappeared and then reappeared for some people and only if you were logged in to a Google account. Now it is back for everyone. Run a search, view a result and then use the back button to get back to your results list. You should now see a link next to the result offering to block all further pages from that site.


If you are not already logged in to a Google account you are prompted to do so.
Next time you run a search that would normally include pages from a blocked site Google displays a message at the bottom of the results offering you the options to show the blocked results or to go to 'Manage blocked sites' where you can unblock them altogether.


You can also manage your blocked sites by going to your Google account dashboard.


Be warned: this does not only affect your results. Google.com is using this data as part of their general search ranking algorithms "to help users find more high quality sites". This may be extended to other countries in the future. So don't block sites unless you really mean it. If you want to remove a site from just one particular search then use the site: command prefixed with a minus sign in your search strategy. For example -site:wkipedia.org

The original announcement can be found at "Hide sites from anywhere in the world - Inside Search" http://insidesearch.blogspot.com/2011/09/hide-sites-from-anywhere-in-world.html

Sunday 2 October 2011

Google de-clutters results

Google has been busy de-cluttering its web results page again. The 'similar' pages link disappeared from entries on the results page a while ago and was moved to the preview copies of results pages. Now the cached link has gone as has the magnifying glass for the preview. Hover over a result, though, and a double arrow appears to the right of it. Click on the arrow and the preview copy appears along with the 'Cached' link and sometimes a 'Similar' link.


I've noticed that fewer pages have a Similar link, which makes me wonder if Google will do away with it all together in the not distant future. If Google carries on at this rate there won't be anything on the results page at all!

Please note: this is what I see on my screen. What you see may be totally different.

Saturday 24 September 2011

Public Data Explorer survives Google Labs

Public Data Explorer has escaped the cull at Google Labs, from which it  has now "graduated". There were signs that it might survive when Google started adding public data charts to the top of the results for some statistics searches. It can now be found at  http://www.google.com/publicdata/. Public Data Explorer allows you to search and compare sets of public data such as population, energy consumption, mobile phone usage and government debt across countries. You can select the countries or states that you wish to compare and view the data as line graphs, bar charts, map visualizations or bubble charts.


Data sets include information from the OECD, World Bank, Eurostat and various US government departments. There is also an option to upload your own data sets - details are at http://www.google.com/publicdata/admin. This probably accounts for some of the very specific data that is now available,  for example: Australian Population Estimates, Unemployment rate Italy and Catalan municipalities indicators. The full list is at http://www.google.com/publicdata/directory. It is worth exploring the more generic titles such as "World Bank, World Development Indicators" and "OECD Factbook 2010" to uncover the full range of what is available.

Thursday 22 September 2011

New Facebook: a bit good, a lot bad

I woke up this morning hoping that last night's memories of Facebook were a bad dream. No such luck. If you are just an occasional Facebook user or only log in once a day, brace yourselves for the new experience that is "New Facebook".

Here in the UK the changes started to roll out yesterday afternoon. The first thing I spotted was what looked a Twitter stream in the upper right hand corner of the screen. Interesting, I thought, I don't direct my whole Twitterstream to Facebook anymore so what is it doing there. On closer inspection it turned out to be a streaming feed of Facebook updates from my friends. I actually quite like this. Hover over one of the updates and you see any associated comments and conversations. It is also very easy to scroll down through the list and catch up with the latest news from your friends and pages. Below that box are my events and below that....nothing! No adverts, no photo updates from friends. Apparently the absence of adverts depends on what system you are using. Phil Bradley has reported that they are visible on his desktop computer but not on his laptop. (Phil Bradley's weblog: New Facebook, new disaster http://philbradley.typepad.com/phil_bradleys_weblog/2011/09/new-facebook-new-disaster.html). As I only have laptops here I can't compare and contrast but I'm sure that Facebook will 'fix' the missing adverts problem fairly soon.

What was puzzling me was why is there an update feed on the right hand screen as well as in the main middle part of the screen? The answer is because Facebook has started messing around with how it presents the updates. Top Stories are back and very much in evidence, not as a separate link but actually inserted into the top of the feed. As with the previous incarnation there is no clue as to what criteria are used to decide which humble updates becomes top stories. I was delighted to see, though, that the first one in my news feed was a complaint about the new interface! This was quickly followed by two more in similar vein. You can get rid of them individually by clicking on the little blue corner in the upper left hand corner of the story but there is no way of removing them altogether. This is a really bad move by Facebook and one that I suspect is going to seriously annoy people.


At least I am viewing all of the updates from all of my friends, aren't I? It turns out I am not. Some of you may recall that a while back Facebook decided to show updates only from those people with whom you interact most. Another not-so-smart move by Facebook. I am sure that many people do as I do and follow people and organisations just to keep up to date with what is happening and rarely comment or "interact" with them. That does not mean I am not interested in what they are doing. There used to be an edit option at the bottom of your feed where you could change the default to see all updates. I checked the new version of the feed and there is still an Edit options link but this now only gives you the ability to hide posts from a person, page or group. Therefore I assumed that everything is automatically appearing in my news feed. It isn't. Hover over the name of a person in your feed and a box pops up showing their avatar, mutual friends and two ticked buttons labelled Friends and Subscribed. When I clicked on the Subscribed option I saw that I was getting "Most updates", not all.


I mostly use Facebook to keep up with close friends and family and there are times when it is important that I receive ALL updates. I have not yet found a way to change this setting for all of the people I follow on Facebook; it has to be done one at a time. I can understand that one may not want to have the same setting for all friends so an obvious solution would be to have an option associated with lists. This brings me to my final disaster in New Facebook.

I have been playing around with lists in Facebook for a couple of months and was pleased to read that New Facebook was to implement a much easier way of managing them, much in the style of Google+. New Facebook displays its own default list names, such as Family and Close Friends, on the left hand side of the screen and suggests who you might like to add to each one. Most of these suggestions are nonsensical. You can create new lists of your own but what about existing lists compiled under Old Facebook? Can they be incorporated into one of the default lists or form the basis of a completely new one? Mine can't because they have vanished into thin air! I have no idea where they have gone, the help files are useless on this and no-one else seems to have experienced the problem. I am rebuilding my family and 'important people' lists but I can't be bothered to go any further than that. And there is no option to change the Subscribed options for a whole list. If there is it is very well hidden.

Overall I do not like the changes and find some of them infuriating. I shall probably now be using Google+ a bit more, but some of my close friends and family are only on Facebook so it looks as though I shall still have to visit at least once a day. I do so under protest.

Friday 9 September 2011

Business Information: Top Ten Tips from Bristol

The University of the West of England (UWE) hosted the UKeiG 8th September workshop on business information. The list of participants included people from academic libraries, public libraries, the legal sector and freelance researchers. The day got off to an interesting start with one of the participants telling me that a colleague of theirs thought there wasn't any quality business information on the web! I hope I proved them wrong. Some of the materials provided on the day can be found on my web site at http://www.rba.co.uk/bi/. Please note that SocialMention, which is mentioned in the latter part of the PowerPoint presentation, has been down for nearly five days and we have to assume that it is "no more". [Update 10th September: after nearly a week offline SocialMention is now back online].

Those of you who have attended my Google, general search or business information workshops will know that towards the end of the afternoon I always ask the group to come up with a list of top ten tips. These can be useful sites that they have discovered during the day, essential services that they already use or commands that help focus the search. A combined list of tips from previous business information workshops is at http://www.rba.co.uk/bi/TopBusInfoSearchTips.pdf. Below, in no particular order, are the new tips from the 8th September workshop.


1. Biznar http://www.biznar.com/ Biznar is a federated search engine that runs your search in real-time in about 80 resources. There is a list on the Advanced Search screen where you can deselect individual or groups of resources. Many of the workshop participants de-selected Google Groups, which seemed to their dominate results, and some went as far as to exclude the whole Blogs and Social Networks group. The results are combined into a single list and on the left hand side of the scree are organised into folders such as Topics, Authors, Publications, Publishers and Dates. These are computer generated but can help you narrow down your search.

2. Export.gov http://export.gov/"Helping U.S. companies export". Information on markets and doing business outside of the US. As the strap line of the web site suggest this is aimed at US companies but the reports contain information that is relevant to anyone looking at external markets.

3. Guardian Data Store http://www.guardian.co.uk/data Visualizations and mashups of data relating to major stories in the news. Links to the original datasets are provided so that you can download the raw data.

4. Company Check http://www.companycheck.co.uk/and Company Director Check http://company-director-check.co.uk/. Both services use Companies House data. Company Check provides 6 years of figures and graphs for Cash at Bank, Net Worth, Total Liabilities and Total Current Liabilities free of charge and lists the directors of a company. Click on a director's name and you are taken to the Company Directory Check - launched last week - where you can view other current and past directorships for that person.

5. Companies House http://www.companieshouse.gov.uk/. The official registry for UK companies. Services such as Company Check and Bizzy (http://bizzy.co.uk/) may provide more information free of charge but it is always worth double checking with Companies House to see if there is more up to date information. The list of documents available for a company in combination with the free services may be enough for you to make a decision on whether or not to do business with that company. Use the free WebCHeck service to locate the company in the register and then click on "Order information for this company". You will then see a list of available documents: titles such as "Struck off and dissolved" followed by "Application for administrative restoration" might suggest that you should run a mile!

6. Zanran http://zanran.com/ This was recommended for identifying charts, graphs and tables of data in PDFs and Excel spreadsheets. Run your search and Zanran comes up with PDF and spreadsheet files that match your criteria. Hover over the file icon in your results list and you will see a preview of the page that contains your data. We did come across a few oddities: my test search on gin vodka sales uk came up with the bar menu for the Time & Space Restaurant at the Royal Institution of Great Britain. The Zanran "About us" page tells you more about what they do (http://zanran.com/help/about_us)

7. Applegate directories http://www.applegate.co.uk/ A collection of business directories for electronics, engineering, plastics, rubber, chemical, oil, gas and recruitment services covering the UK. Recommended for generating lists of companies by location.

8. Kompass http://www.kompass.com/. Well established directory with world-wide coverage (some of us can remember the black, hard copy volumes!) Search is free and some results are free. Pay as you go options are reasonably priced and there is extensive country and industry coverage.

9. Public libraries' databases and resources. A reminder from the public libraries contingent that you can access their resources free of charge for personal use from your desktop using the identification on your library card, for example NewsUK and the The Times Digital Archive. Some library authorities also provide access to business databases.

10. Google Advanced Search Use the advanced search screen or commands to help focus your search on statistics and market research. For example use the 'filetype:' command to search for spreadsheets containing statistics or PDFs of industry/government reports. Use 'site:" to focus your search on academic or government sources, for example site:ac.uk.

Saturday 3 September 2011

Google can seriously damage your news

Many of us have known for a while that the search engines, and in particular Google, customise results. What you see on your screen will not necessarily be what someone else sees on theirs even with what appears to be an identical search. Location, browser, search history, your browsing behaviour and your social networks are just some of the factors that are used by Google to personalise your results. 

I recall sitting next to Marydee Ojala at a business information conference in the Czech Republic in 2008 and under discussion was a search visualisation tool. We both ran the same search - Czech coal production, I think it was - and from the maps that were generated on our screens it was obvious that we had completely different sets of results. Marydee had what we decided was an "unadulterated" set with pages that did include the keywords but were not exactly on topic, for example a report on a local football match sponsored by Czech Coal. In contrast, my results were mostly Czech coal production statistics and news on the energy sector in the region. I regularly research the European energy sector and the search engine underlying the visualisation tool used my search history to adjust the results accordingly.

Fast forward to a couple of weeks ago and a request appeared on one of my discussion lists from Mary Ellen Bates for people to run a search on Israel in Google News and to send her a screen shot of what we saw. 37 people responded within 6 hours and the results are very interesting indeed. Full details are on Mary Ellen's blog (Is Google really filtering my news?  http://www.librarianoffortune.com/librarian_of_fortune/2011/09/is-google-really-filtering-my-news.html) but here are a few highlights:
  • One story appeared in more than 90% of the search results, another appeared in 70% .... Of the remaining 14 stories, none were seen by more than 30% of the searchers, and most were seen by less than 15% of the searchers
  • More than a quarter of the stories showed up in only one searcher’s search results
  • Almost one in five searchers saw a story that no one else saw
  • Only 12% of searchers saw the same three stories in the same order
The 6 hour spread of the responses may account for some of the differences. Google is constantly picking up stories and changing the grouping and ranking of the articles. Nonetheless, the results still show that you need to use your advanced search skills and look at more than the top headlines for the full picture. To quote Mary Ellen: "Bottom line: Holy moley, Google does filter the news. You really need to go beyond the first few search results if you want to get a relatively well-rounded view of the news."

Wednesday 31 August 2011

Fed up with buses vanishing from the timetable? Go to FixMyTransport


FixMyTransport (http://www.fixmytransport.com/) is a new web site run by those excellent people at MySociety. MySociety also runs TheyWorkForYou (http://www.theyworkforyou.com/), which tells you what your MP and Parliament is up to, FixMyStreet (http://www.fixmystreet.com/) for reporting local problems to councils, and WhatDoTheyKnow (http://www.whatdotheyknow.com/) for Freedom of Information requests. There is a full list at mySociety - our projects (http://www.mysociety.org/projects/).

Subtitled "Euston, we have a problem" FixMyTransport was built to help resolve common public transport problems and is aimed at smaller problems such as "persistently broken ticket machines, buses that always leave early, or silly rules that appear to do nothing but create inconvenience for travellers." Sound familiar? Want to do something about it other than moan? Use FixMyTransport to report a problem and they will send it to the relevant company or authority. Any reports or messages you send will be public and you cannot use this site to directly apply for compensation for cancelled or severely delayed trains.

Each train company has its own Passenger's Charter and levels of compensation for delays and the quickest way to apply is to download and use the train company's form, which of course is usually well hidden. You could report the delay via FixMyTransport but the train company will probably reply that you need to use their form. Bear in mind that you have to apply within 28 days if your claim is to have any chance of success so going direct is the best way to ensure you submit your claim on time. A Google search may bring up the information you need but you might have to resort to an advanced 'site:' search on the train company's web site, for example site:crosscountrytrains.co.uk delays compensation. A list of train operating companies is available on http://www.nationalrail.co.uk/tocs_maps/tocs/. There is also a list of Passenger's Charters at "Train delays and cancellations – your complete guide to refunds and compensation" (http://www.bitterwallet.com/train-delays-and-cancellations-your-complete-guide-to-refunds-and-compensation/23772) but this is now out of date and four of the links no longer work.

FixMyTransport is still in beta and they welcome feedback on how you think it could be improved. If you use public transport in the UK, bookmark and use this site.

Tuesday 30 August 2011

Google Related is not Google related:

Google recently announced a new toolbar called Google Related (http://www.google.com/related/). It is available as a Chrome extension and as part of the Google Toolbar for Internet Explorer but not for the latest versions of Firefox. Google Related displays a bar along the bottom of your screen that shows videos, maps, images and web pages relevant to the page you are currently on. Nothing new here, I thought. Google has had a related: command and links to similar pages next to entries on your results page for a long time but Google Related is in fact very different.

If I view similar results for the  First Great Western home page or type in related:http://www.firstgreatwestern.co.uk/ I see a list of sites that are similar in type and content to First Great Western for example National Rail Enquiries, Virgin Trains, Trainline, Arriva, Southwestern Trains.


If you have found a page that contains the type of information you are looking for 'related:' has always been a good way to find additional sites containing similar content and of similar quality. The option is also available on the Advanced Search screen, but you have to click on the '+ Date, usage rights, region, and more' link and it is at the bottom of the page under 'Page specific tools' (Anyone would think they were trying to hide it from us!).

Google Related's results are very different. Once installed it monitors every page you browse and offers content about or directly related to your current page.


Google does not always find related information for every page and currently only supports English language pages. I found that it worked for about 60% of pages that I viewed. There also seems to an unhealthy abundance of Wikipedia articles: one would be more than enough. It does sometimes come up with interesting additional information but there are times when it is not needed and its intrusion infuriating. I really do not want it getting in the way when I am booking train tickets, as in the above example, or listening to BBC Radio 4. Thankfully it can be switched off for individual pages or whole sites but I cannot see a way of switching it back on if I later change my mind. You should also be aware that Google personalizes the results of the Related bar by watching how you search and navigate the web, so what I see in the bar for a particular page will eventually not be what you see.

Overall, some of the information it finds is interesting but to be honest I have not found much that is vitally important to my search or browsing activity. If you are curious have a go and see if it works for you.

Thursday 21 July 2011

Google axes Google Directory and to close Labs

Yesterday I heard that Google had axed Google Directory (Google Kills Google Directory, Says Web Search Is Faster http://www.seroundtable.com/google-directory-gone-13731.html). If you try to access the directory you will see a message telling you that it is no longer available and "We believe that Web Search is the fastest way to find the information you need on the web. If you prefer to browse a directory of the web, visit the Open Directory Project at dmoz.org".


The directory was not one created by Google but a version of Dmoz.org, The Open Directory Project. I began using Dmoz when it started as an alternative to the Yahoo Directory, which Yahoo had stopped updating. I have not used it for several years, though. The quality of an increasing number of the entries was suspect and the number of dead links unacceptable. I have just revisited Dmoz and the quality seems to have deteriorated even further. It is as tedious as ever to navigate and one often ends up with a list of commercial pages advertising companies and services. I did not have much joy with the search option either (powered by AOL Search). Marketing  pages dominated all of my search results. I will not be mourning the passing of Google Directory.

Google does not seem to have made an official announcement about the directory and in the time honoured fashion has simply dropped the service. It has, though, dropped the bombshell that it is to close down Google Labs. (Official Google Blog: More wood behind fewer arrows http://googleblog.blogspot.com/2011/07/more-wood-behind-fewer-arrows.html). They will carry on with "in-product experimentation channels like Gmail Labs or Maps Labs. We'll continue to experiment with new features in each of our products". Android apps will be available on Android Market. There is further comment at "Google Labs To Be Closed As Larry Page’s Product Streamlining Continues" (http://searchengineland.com/google-labs-to-be-closed-86575)

This is something I did not expect at all and I will miss the single point of access to Google's experiments. Fusion Tables (http://www.google.com/fusiontables/) has already "graduated" but what is to become of experiments such as the Art Project, Google Correlate, Image Swirl and the Public Data Explorer? Google simply says that updates will appear on the Labs website (http://www.googlelabs.com/). The close down emphasises the importance of not become totally reliant on Google search features and services. Get to know the alternatives - they are sometimes better!

I am now wondering what will be next in the firing line.

Wednesday 20 July 2011

Company Information: Company Check gives more UK data for free

I first reviewed Company Check (http://www.companycheck.co.uk/) earlier this year (Free UK company information http://www.rba.co.uk/wordpress/2011/01/10/free-uk-company-information/). Since then they have made more UK company information available free of charge. As well as Cash at Bank the service also shows 6 years of figures and graphs for Net Worth, Total Liabilities and Total Current Liabilities. Data is taken from official Companies House documents. Documents can be purchased through UK Data (http://ukdata.com/) but they are much more expensive than ordering direct from Companies House (http://www.companieshouse.gov.uk/) or bizzy (http://bizzy.co.uk/). UK Data's detailed credit reports are worth considering though if you want more in depth analysis. Although Company Check lists the company directors it does not show other directorships as does bizzy. (See my previous posting Company information: Bizzy for UK company data and credit ratings http://www.rba.co.uk/wordpress/2011/07/19/company-information-bizzy-for-uk-company-data-and-credit-ratings/). This is another very useful site that I recommend you add to your company information toolkit.

Tuesday 19 July 2011

Company information: Bizzy for UK company data and credit ratings

There are numerous services that take UK Companies House data and repackage it. Some of the data is offered free of charge but more detailed information and additional analysis such as credit reports are priced. bizzy (http://www.bizzy.co.uk/) is one such organisation but uniquely it also offers free credit ratings for many UK limited companies. (Note that it is the overall rating and not the full report that is available free of charge.)

To search bizzy simply enter the name of a company and bizzy presents you with a list of likely matches. Click on the company you want to view and as well as documents available for purchase you can see free of charge the names of the directors together with a list of the other companies of which they are directors, industry sector, date of incorporation, registered address, and a list of competitors and peers.


To see the credit rating of the company you have to register with the site. Ordinary registration is free but there is also a bizzy PLUS account (£9.99/month or £99/year). The PLUS account allows you to view credit limits, mortgages and CCJs, includes a Risk Tracker for monitoring companies of interest, and gives you a 15% discount on all purchases. If you have the bizzy FREE account you will only be able to see credit ratings that are from 100 down to 30. Those below 30 show "Not public for this company" for their credit rating. If you have signed up for the bizzy PLUS all credit ratings are displayed.

The bizzy credit scores are as follows:
 85 and 100 - 'Excellent Creditworthiness',
70 and 84  - 'Very Good Creditworthiness'
50 and 69  - 'Good Creditworthiness'
30 and 49  -  'Creditworthy'
15 and 29  -  'Credit Against Collateral'
0 and 14 -  'Caution - Credit At Your Discretion'

I ran a check on a company for a friend of mine. They had heard rumours about the company and were uncertain as to whether it was safe to do business with them. Would the company go under? There was little to go on at Companies House as the company was filing abbreviated accounts and had not filed documents for the previous year. I used bizzy FREE to run the search and no credit rating was displayed. In order to see how bad it was I bought the credit report (£11.99). bizzy gave the company a rating of zero and the long list of outstanding CCJs for unpaid bills was all the evidence we needed to avoid the company like the plague. (The company concerned has now gone into liquidation).

Official documents filed at Companies House and bought direct from them cost £1 but can be bought via bizzy for £0.99. That is only 1 pence less than the Companies House price and might not be enough on its own to tempt you onto bizzy but the additional free information might. An important part of company research is uncovering what the directors are up to and bizzy makes it very easy to view a list of directorships held by a person. On the Companies House web site this is only possible if you subscribe to the full service rather than the free Webcheck option.

I have found that the information on bizzy is often more up to date than that provided by some of the larger credit rating companies and bizzy covers every UK limited company, even very small ones. I tried searching for three small companies using http://www.do-business.net/sbc, which I have often used in the past, and none of them were in the database.

Bizzy also searches official information and sells credit reports on companies in other European countries. It is not obvious how you do this until you start searching on the company name. Above and to the right of the list of companies on the results page is a 'Search Country' box and it is from the drop down menu that you select the country.


Remember, though, that the amount of information that companies have to disclose varies from country to country and may consist of little more than name, registration number, status and address.

If you are researching UK companies I recommend that you consider including bizzy in your toolkit, but should you go for a FREE or PLUS account? It all depends on how much company research you think you'll do in a year. If it is just a handful then perhaps the free option will suffice but more than that and bizzy PLUS with its 15% discount and standard display of credit limits, mortgages, and CCJs makes more economic sense.

Monday 18 July 2011

A good year for culling Google search options

2011 is proving to be a vintage year for disposing of Google search options. Google, in common with most search engines and database providers, is quick to announce wonderful new search features but tardy in telling users about discontinued tools. In fact, it generally takes several messages to the Google support forums about something not working in order to elicit the news that a service has been withdrawn.

UK Google Maps property search was one of the first to go this year. Google had done deals with several UK online estate agents so that when you ran a search in Google Maps on your post code together with the word property you were presented with a Google map showing all the properties for sale or rent in your area. You could even specify price range, the number of bedrooms and bathrooms.


The service was discontinued in February of this year with "low usage" being given as one of the reasons. That's hardly surprising because after the launch Google did almost nothing to promote it and did not even offer a hint on the UK Maps home page that it existed.

Next to go was starred results. This enabled you to star or bookmark pages in your results list so that next time you ran a similar search they would appear separately at the top of your results.


The ability to create new starred results was removed but your existing starred results remain and will continue to appear in search results (No More Starred Results in Google Search http://googlesystem.blogspot.com/2011/03/no-more-starred-results-in-google.html)

The 'define:' command was the next to be axed although the same functionality is still available under the Dictionary link in the left hand menu on the results page. Instead of simply prefixing your term or abbreviation with define: you now have to run a search on it and then click on Dictionary. The results are the same but it requires a couple of additional clicks to get there.

Next up were the numerous changes to the appearance and layout of the results page in the runup to the launch of Google+. One casualty was the 'Similar' link that used to appear next to most entries in the results page. This would find pages similar in content and from similar types of organisations to your selected page. Although it has gone from the results the related: command is still available and it remains on the Advanced Search screen. Another victim of the revamp was the Wonderwheel. This was a great way of exploring concepts and alternative search terms within a search, especially if you are working in a subject area new to you.


The closest alternative is the Related Searches option in the menu on the left hand side of the results screen. It doesn't allow for the same ease of navigation between searches and doesn't match the variety of terms and phrases that the Wonderwheel offered.

The latest disappearance is Realtime search, which returned mostly Twitter results. The contract giving Google direct access to Twitter expired on July 1st and Google have not renewed the contract. This started out as a very useful Twitter search tool as Twitter's own search at http://search.twitter.com/only returns results from the last few days and many of the advanced search commands do not work. More recently, though, Google Realtime became unreliable and started returning increasingly bizarre results, usually with hashtags because it would automatically correct what it thought was a spelling mistake. You can still use Google to search Twitter by combining your search terms with site:twitter.com but it does not pick up everything. Bing Social is a little better and Topsy.com is generally good but neither pick up everything.

As an example, I recently attended and spoke at the South West and Mid Wales Library Partnership staff conference. The hashtag was #swamp11 and two days after the event the archive document I created in Tweetdoc (http://www.tweetdoc.org/) listed 185 tweets, which tallied with the number in my own record. Bing Social finds 75 tweets, Topsy tracks down a mere 38 and when you force Google to do an exact match search together with site:twitter.com you get a paltry 4 results.

And finally.... a search option that many researchers find invaluable seemed to have vanished over the weekend. A link to the Advanced Search screen had vanished from the Google home page, as had Language Tools. Both are now hidden under the gear icon in the upper right hand corner of the screen.

What will go next? Who knows except Google and they always seem reluctant to tell us. As Gary Price said in his article on the Search Engine Land site (http://searchengineland.com/official-the-google-wonder-wheel-is-gone-84105):

"..taking a service offline is up to the company. Users are free to go elsewhere or share their opinions with Google. What we hope for is simply for the company to let users know what’s going on versus waiting around, speculating, and wasting time."