Top search tips from Exeter and Bristol

A couple of weeks ago I was in Exeter and Bristol leading workshops for NHS South West on "Google & Beyond". We covered advanced Google commands, Google Scholar and alternatives to Google. Below are the combined top tips from the two sessions. I may have missed a couple from the list as I could not read my writing, so if you attended one of the workshops let me know if I've omitted your suggested tip.

1. Verbatim Yet again, this has topped the list of useful Google search options. Google automatically looks for variations on your search terms and sometimes drops terms from your search without telling or asking you. To make Google run your search exactly as you have typed it in, first run your search. Then click on ‘Search tools’ in the menu above your results, in the second line of options that appears click on ‘All results’ and from the drop down menu select Verbatim.


2. Be aware of personalisation. Even if you are not signed in to a Google account Google personalises your results according to your search and browsing behaviour. Personalisation is not necessarily a bad thing but if your want to burst out of the filter bubble, as it is often called, use a private browser window or incognito (Chrome). Google will then ignore tracking and search cookies on your machine and will not personalise your results. To call up a private browser or incognito window use the following keys:

Chrome -  Ctrl+Shift+N
FireFox - Ctrl+Shift+P
Internet Explorer - Ctrl+Shift+P

3. site: Use the site: command to focus your search on particular types of site, for example site:nhs.uk, or to search inside a large, rambling site. You can also use -site: to exclude sites from your search.


4. intext: Google’s automatic synonym search can be helpful when looking for alternative terms, but if you want a term to be included in your search exactly as you have typed it then prefix the word with intext:.


5. filetype: Use the filetype: command to limit your research to PowerPoint for presentations, spreadsheets for data and statistics or PDF for research papers and industry/government reports. Note that in Google filetype:ppt and filetype:xls will not pick up the newer .pptx and xlsx formats so you will need to include those in your strategy, for example filetype:ppt OR filetype:pptx, or run separate searches for each one. In Bing.com, though, filetype:pptx will pick up both .ppt and .pptx files.


6. Advanced search commands and search options Learn how to use the search commands (for example intext:, filetype: and site:). Many of these can be used on the advanced search screen that can usually be found under the cog wheel in the  upper right hand area of the screen, but that link sometimes disappears so learning the commands is a better bet. A list of the more useful Google commands is at http://www.rba.co.uk/search/SelectedGoogleCommands.shtml.


7. Combine advanced search commands. Practise combining the advanced search commands for a more precise, focused set of results.


8. Google Reading level. This changes the type of results that you see. Run your search and from the menu above the results select ‘Search tools’, ‘All results’ and from the drop menu ‘Reading level’. Options for switching between basic, intermediate and advanced reading levels should then appear just above the results. Click on the Advanced option to see results biased towards research. Google does not give much away as to how it calculates the reading level and it has nothing to do with the reading age that publishers assign to publications. It seems to involve an analysis of sentence structure, the length of sentences, the length of the document and whether scientific or industry specific terminology appears in the page.


9. Numeric range. This command is unique to Google. Use it for anything to do with numbers – years, temperatures, weights, distances, prices etc. Simply type in your two numbers separated by two full stops as part of your search. This is a good way of limiting your search, for example, to forecasts over the few years.


10. Limiting your search by date. To limit your search by date, for example the last month or year, first run your search. Then click on 'Search tools' in the menu above the results and from the second row of options that appears click on 'Any time'. Select your time period or a custom range from the drop down menu.


11. Use the minus sign to exclude documents containing a word. If you do not want documents containing a specific word prefix that word term with a minus sign. The minus sign can also be used with commands such as site: and filetype: to remove an individual site or type of document from your results.


12. Million Short http://millionshort.com/. If you are fed up with seeing the same results from Google again and again give Million Short a try. Million Short runs your search and you can choose to remove the most popular web sites from the results. Originally, as its name suggests, it automatically removed the top 1 million but now you can choose to remove the most popular 100, 1000, 10k, 100k or million sites. The page that best answers your question might not be well optimised for search engines or might cover a topic that is so “niche” that it never makes it into the top results in Google or Bing.


13. Creative commons searches for images. Rather than search for images and go through them individually to find one that you can legally use in your document or presentation, use advanced search options or tools that allow you to select the appropriate license from the start. In Google, use the usage rights menu on the image advanced search screen to search for images with the license you need. The US version of Bing images includes a license option in the menu at the top of your results.
    
    Double check the license of the photo on the website or blog hosting it. The license you need may be associated with a different image and yours could, for example, be 'all rights reserved'.Flickr has a page where you can search for images with a specific Creative Commons license at http://www.flickr.com/creativecommons.

14. Compare in Google. This is not a Google command but if you type in a search such as compare carrots with cabbage Google will create a table comparing the properties of the two items. Google has been known to get some of the data wrong, though, so it's worth double checking the figures before you use them.


15. Web archives. Want to see what was on a website a few years ago or trying to track down a document that seems to have vanished from the web? Try the Internet Archive Wayback Machine at http://www.archive.org/. Enter the URL of the website or document and you should then see a calendar of the snapshots that the archive has of the site or document. Choose a date from the calendar to view the page. The archive does not have everything but it is worth a try. See also the UK National Archives of old government websites and pages at http://www.nationalarchives.gov.uk/webarchive/ and the UK Web Archive at http://www.webarchive.org.uk/ukwa/.


16. Statistics sites. Although you can often find statistics via Google, you may find dedicated official statistics sites quicker and more reliable. Some of the sites we covered during the workshops were:
    
    
    

    NHS Statistics Links http://www.nhs.uk/Pages/LinkListing.aspx?CategoryId=Statistics
    UK National Statistics Publication Hub http://www.statistics.gov.uk/
    Office for National Statistics http://www.ons.gov.uk/
    Welsh Government Statistics http://wales.gov.uk/topics/statistics/
    Welsh Assembly Government StatsWales http://statswales.wales.gov.uk/
    UK Open data http://data.gov.uk/
    Eurostat http://ec.europa.eu/eurostat/
    European Union Open Data Portal http://open-dat.europa.eu/en/
    Zanran http://www.zanran.com/

    
    

    
    

Google workshop - top tips

Last week's workshop on Google had a wonderful mix of participants from the academic, government, public, NHS and legal sectors. And true to form, Google decided to change a few things on the day. The link to the Google News advanced search completely disappeared (it wasn't that good anyway!) but now seems to have reappeared. The search options that appear at the top of the results pages had changed compared with screen shots that I had taken 2 days previously; they options now seem to change according to the type of query so we suspect that this is an example of Hummingbird (Google's new algorithm). The Google custom search engine interface has changed yet again and presented challenges to even those of us who are regular users. And then there was the new Google log-out/log-in interface which had us all flummoxed until the end of the day. (That merits a separate blog rant).

In the time honoured tradition, at the end of the day the group was asked to come up with their top 10 tips for searching Google. Here is what they came up with.

1. Verbatim Several people shouted out this one as the number 1 tip for searching Google. Google automatically looks for variations on your search terms and sometimes drops terms from your search without telling or asking you. To make Google run your search exactly as you have typed it in, first run your search. Then click on ‘Search tools’ in the menu above your results, in the second line of options that appears click on ‘All results’ and from the drop down menu select Verbatim.


2. site: command Use the site: command to focus your search on particular types of site, for example site:ac.uk, or to search inside a large rambling site. You can also use -site: to exclude sites from your search.


3. Advanced search commands and search options Learn how to use the search commands (for example intext:, filetype: and site:), Many of these can be used on the advanced search screen that can usually be found under the cog wheel in the  upper right hand area of the screen, but that link sometimes disappears so learning the commands is a better bet.  A list of the more useful Google commands is at http://www.rba.co.uk/search/SelectedGoogleCommands.shtml


4. intext: Google’s automatic synonym search can be helpful in looking for alternative terms but if you want a term to be included in your search exactly as you have typed it in then prefix the word with intext:.


5. Country versions of  Google. The country versions of Google give priority to the country’s local content, although it might be in the local language. This is a useful strategy when searching  for industries, companies and  people that are active in a particular country. Use Google followed by the standard ISO two letter country code, for example http://www.google.de/ for Google Germany, http://www.google.no/ for Google Norway.


6. Google.com Apart from presenting your search results in a different order Google.com is where Google launches new features and search options first. As well as seeing pages that may not be highly ranked in Google.co.uk you will get an idea of how Google search may look in the UK version in the future. It also has some unique search options such as recipes!


7. Google Scholar http://scholar.google.com/ Google Scholar collects all the versions of an article under an 'All versions" link. Click on the link to see the full list, which might include free or open access copies of the paper.


8. Search by image Click on the camera icon in the image search bar to upload a photo or link to an image on the web. Google will then try and find similar images. There were comments from some of the workshop participants that this does not seem to always work as well as it used to, which reflects my own recent experience of the option. It is still worth a go, though, if you want to find different versions of an image.


9. Hummingbird Keep an eye out for new layouts and ways of searching that are now appearing since Hummingbird was launched. For example, you can now compare the properties of two similar items: compare cabbage with spinach will show a table comparing the nutritional value of the two vegetables.


10. Google Custom Search Engines (CSE) Several of the participants had a go at setting up their own CSE. Ideal for bringing together websites that you search individually on a regular basis.

Edited highlights of the presentations can be found on authorSTREAM at http://www.authorstream.com/Presentation/karenblakeman-1975041-make-google-behave-techniques-better-search-results/ and http://www.authorstream.com/Presentation/karenblakeman-1975022-google-scholar-citation-indexes/

Google to start using your photo and reviews to endorse ads

If you have a Google+ account you should have received an email from Google with the innocuous subject line "An Update for Google+ Page Owners and Managers". Don't ignore it because it contains important information about changes to Google's terms and conditions that take effect on November 11th, 2013. From that date Google may start using your profile name and photo to endorse ads. Several people have already posted extensively about this so I will not go into much detail here. Tony Hirst has already written an excellent article on this at http://blog.ouseful.info/2013/10/12/googles-new-terms-mean-you-could-soon-been-acting-as-a-product-endorser/, which also addresses other privacy issues and account settings that you may wish to review and change.

If you do not want your photo and name used in advertisements you have to opt out because Google seems to have automatically added everyone to the scheme. Sign in to your Google+ account and go to the settings page. You should see a new option for "Shared endorsements" that is switched on. Click on the Edit link to change it to "Off". Of course, Google tries to discourage you from doing this by saying that "your friends will be less likely to benefit from your recommendations".

Click continue to carry on and switch endorsements off.

Interactive maps of UK renewable energy generation

I recently mentioned Gridwatch (How the UK’s electricity is generated as a way of tracking how much energy is passing through the National Grid and the technology used to generate that electricity. Although Gridwatch is a great way of observing the total amount of electricity that is generated by each technology - gas, coal, wind etc - it does not go into any detail with respect to individual installations. The Digest of UK energy statistics (DUKES) produced by the UK  Department of Energy & Climate Change (http://www.gov.uk/government/organisations/department-of-energy-climate-change/series/digest-of-uk-energy-statistics-dukes) includes a spreadsheet listing all of the operational power stations, fuel that they use, installed capacity, location, and the year that generation began. The direct link to the spreadsheet is http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/226895/dukes5_11.xls. This is historical data and the current list refers to plants in operation at the end of May 2013.

UK Energy Watch has a map (http://www.ukenergywatch.org/Electricity/PowerStations) showing the location of UK power stations of 400 MW or larger, so it is by no means comprehensive. It does allow you, though, to click on a plant and display current generation except for CCGT stations (Combined Cycle Gas Turbine).

There are more options available when it comes to what are called renewables (for example wind, solar, biomass, hydro). The DECC's RESTATS interactive map at http://restats.decc.gov.uk/app/pub/map/map/ enables you to search by technology, region, county, planning authority and application status. It also has a separate map for wind farm capacities.

The site information includes installed capacity, details of the planning application but not how much energy is actually being produced. RESTATS says that "Information is held on the performance of operational projects but owing to the need to maintain the commercially sensitive nature of these data, specific site details and performance figures are not disclosed".

The UK Data explorer has produced a renewables map at http://ukdataexplorer.com/renewables/ that uses the RESTATS data and shows operational renewable electricity sites over 0.01 MW. The different colours represent the type of plant and the area of the circles indicate installed capacity (maximum power output).

To see details of a specific installation you should be able to hover over a point on the map. This did not work for me with some of the smaller plants and when I tried to zoom in on an area I often lost the background map.

The Interactive Map of Renewable and Alternative Energy Projects in the UK at http://www.renewables-map.co.uk is another interactive map and can be filtered by technology type and planning status.

According to the website the information is gathered from "a wide range of web resources, in all cases these will be referenced, usually by a link to that information. Locations are either taken from existing data, usually from planning applications, or by painstakingly identifying the location on the ground using online maps." I am not sure how up to date the map is and I noticed that the smaller hydro installations along the Thames are missing. Another problem that I have experienced with this site is that when I click on "More details" for an installation I get far too many "internal sever errors". However, when the information does appear it includes useful comments on the technology, links to relevant websites and the latest news.

The final one in my list is from the energy generating company RWE Innogy (http://www.rwe.com/web/cms/en/194914/rwe-innogy/sites/production-data-live/). Its interactive map provides information on most of its European plants and includes wind farms, hydro power plants and biomass CHP (Combined Heat and Power). The production data is updated every minute. To see information on an installation, click on its icon on the map. The information includes live production, location, type of installation and when production started.

These are by no means the only websites offering interactive maps and information on UK energy production, and none of them give the full picture. They are good starting points, though, if you are interested in researching individual technologies or individual power stations.

Google announces Hummingbird...hmmm

Google announced a major new search algorithm to celebrate its 15^th anniversary called Hummingbird, because it is “precise and fast”. Interestingly, the change was implemented about a month before the announcement was made and most of us did not notice any difference! That is probably because Google is continually making minor changes to the way it presents results, and then there are the live experiments that we are all subjected to (Just Testing: Google Users May See Up To A Dozen Experiments  http://searchengineland.com/just-testing-google-searchers-may-see-up-to-a-dozen-experiments-141570). So, even if we do suspect that our results have changed, it’s difficult to know whether it’s the usual combination of personalisation and experiments or the new algorithm.

Phil Bradley has written a neat summary of what Hummingbird is (http://philbradley.typepad.com/phil_bradleys_weblog/2013/09/what-is-google-hummingbird.html) and Danny Sullivan has compiled an FAQ at http://searchengineland.com/google-hummingbird-172816. There is also a short video on the BBC website at http://www.bbc.co.uk/news/business-24292897 in which Amit Singhal, VP, Google Search talks about the launch and the future direction of Google search.

I have not noticed any significant differences in either desktop or mobile search but that is probably a good thing. We tend to spot changes only when Google completely messes up. I suspect that we’ll see little difference when using advanced commands such as filetype or site; Hummingbird seems to be geared more towards handling natural language queries. It is far too early to say how this is going to affect in depth research, but if you suddenly find strange things happening to your search it could be Hummingbird and not you.

If you are keen to find out more about how Google works and how to get better results I am presenting a workshop later this month in London that has been organised by UKeiG. Further details are on the UKeiG website. Alternatively, if you have had enough of Google and want to explore alternatives there is the Anything but Google workshop, again organised by UKeiG.

Top tips from the latest business information workshop

Delegates at yesterday's business information workshop in London came up with an interesting combination of websites and search commands for their end of day top tips.

1. OFFSTATS - Official Statistics on the Web  http://www.offstats.auckland.ac.nz Excellent starting point for official statistical sources by country, region subject or a combination of categories. All of the content in the database is in the public domain and available through the Internet.
   
2. GMacker http://gmacker.com/web/content/gDateRange/gdr.htm Google's Verbatim in the search options menu on the results page is great. Google's date option from the same menu is great. But you cannot use both together. You can use the daterange: command, though, with Verbatim but it's complicated. GMacker is a much easier way to do it. Type in your search on the GMacker page, select your dates from the calendars and click on 'Google Search'. When the results appear on Google simply apply Verbatim in the usual way.


3. Domain Tools http://www.domaintools.com/ A useful tool for identifying who owns the domain name of a website.


4. 7 side http://www.7side.co.uk/ was recommended for its International company information services.


5. Zanran http://zanran.com/This is a search tool for searching information contained in charts, graphs and tables of data and within formatted documents such as PDFs, Excel spreadsheets and images. Enter your search terms and optionally limit your search by date and/or format type.


6. News alerts, news curation services and automated newsletter generation. Use Google alerts, RSS feeds and newsletter generation sites such as Paper.li (http://paper.li/) and Scoop.it (http://www.scoop.it/) to keep up to date and share news with colleagues.


7. site: command Use the site: command to focus your search on particular types of site, for example site:ac.uk, or to search inside a large rambling site. You can also use -site: to exclude sites from your search.


8. Numeric range This command is unique to Google. Use it for anything to do with numbers – years, temperatures, weights, distances, prices etc. Simply type in your two numbers separated by two full stops as part of your search. A good way of limiting your search to pages or news covering a company's activities over two or three years in the past.


9. OpenCorporates "The Open Database Of The Corporate World" http://opencorporates.com/ Provides access to open corporate data on 55 million companies in 75 jurisdictions. You can search all jurisdictions at the same time or select just one. Results can be filtered by type of data held, current status, company type, SIC. A link to the original registry page for a company is always included with the displayed information.


10. DataMarket http://datamarket.com/ A portal to thousands of free and priced datasets. Free to search, and create charts and visualisations of the free data.

Google expands define but drops dictionary

Google has added extra information to its web definitions. When using the 'define' command, an expandable box now appears containing additional synonyms, how the word is used in a sentence, the origins of the word, the use of the word over time and translations. At the moment it is only available in Google.com and you no longer need the colon immediately after define. So, for definitions of dialectic simply type in define dialectic.

The box gives definitions and synonyms of the word and the 'More' link gives you an example of its use in a sentence.

Click on the grey, downward pointing chevron to open the box and see information on the origin of the word, translations (beware - some are rather bizarre!), and use of the word over time. The last is powered by the Google Books Ngram Viewer, which shows the frequency of words in Google Books. Click on the graph, and you are taken to the Ngram Viewer where you can drill deeper into the data and see the use of the word in context.

Compare this with the old version of define results that are still displayed in Google.co.uk:

The new 'define' box in Google.com certainly gives you much more varied information, but the Dictionary search option that provided extra definitions has been dropped. It used to be under 'Search tools', 'All results'. It can still be seen in Google.co.uk.

The new define only works on English words or words that have been absorbed into the English language. It can cope with schadenfreude and correctly defines tikka as "an Indian dish of small pieces of meat or vegetables marinated in a spice mixture". When I asked it to define balti, though, it came up with a simple web definition of it being a city in Moldova. The standard Google web search results came up with the common UK usage of it as a type of curry served in a steel balti bowl. Our (UK) use of the word is probably too local for it to be have been picked up by Google. Similarly, phrases such as "chicken tikka" generally pull up a single web definition although some do trigger the translation options, for example "climate change", "global warming".

Overall, I like the new 'define' but I regret the loss of the extra definitions that the Dictionary search option offered. Sometimes, the definitions that 'define' offers are somewhat impenetrable. The Dictionary option provided a list of alternatives that were more understandable.

Dunkirk little ships and the Reading Festival

It is August bank holiday weekend and in Reading that means Reading Festival (http://www.readingfestival.com/). Festival goers started arriving in dribs and drabs on Wednesday but yesterday (Thursday) the main invasion started. The stages and campsites are upstream from Reading town centre and most of the fans arrive by train. A few walk to the campsite, many pile onto the extra buses laid on by Reading Buses, but it appears that the majority use what has become, over the last few years, the traditional means of transport - boats.

Every year boats ferry people to and from the festival site and among them are usually a couple of Dunkirk little ships. The emergency evacuation of Allied soldiers from the beaches and harbour of Dunkirk in France took place between 27 May and 4 June 1940. What were needed for the evacuation were boats with shallow draught, and hundreds of pleasure boats, private yachts and launches on the Thames and estuaries along the South and East coasts were involved in the evacuation.

Some of the "little ships", as they came to be called, are still around and last year I saw the Princess Freda and Devon Belle at work over the festival weekend. I've already seen Devon Belle (pictured left) this year.

The Association of Dunkirk Little Ships (ADLS) was founded in 1966 following the 1965 25th anniversary commemoration of the Dunkirk evacuation. The ADLS web site (http://www.adls.org.uk) has a section that lists the specifications and history of the surviving little ships. The entry for Devon Belle, previously Seymour Castle, can be found at http://www.adls.org.uk/t1/content/devon-belle-previously-seymour-castle. It does not yet record the purchase of the boat by Thames Rivercruise (http://www.readingchronicle.co.uk/news/reading/articles/2010/05/20/46728-little-ship-sails-again/).

Check the ADLS database next time you go on a river trip. You may be cruising on a piece of history.

How the UK's electricity is generated

Gas and electricity supply, and energy in general, are constantly in the headlines in the UK. Reports on the anti-fracking protests at Balcombe recently dominated discussions on the topic but the central issue remains. How do we meet our energy needs in the future: gas, coal, nuclear, renewables? Looking at the level of current consumption and how it is generated is key to understanding the nature of the problem. For electricity, there is detailed data available on the status of the UK National Grid and can now be viewed via a service called Gridwatch.

Gridwatch (http://www.gridwatch.templar.co.uk/index.php) shows the demand for electricity in the UK at any one time, the source and how it is being generated. The site is maintained by Templar Consultancy and uses near real-time data from BM Reports on what the UK's electricity grid is doing. The data is updated every 5 minutes.

The data is presented as a series of dials so that you can easily see how much energy is generated and how that changes throughout the day. Most of the screen is taken up with dials for demand, coal, nuclear, CCGT (gas) and wind.

The right hand area of the screen shows how much electricity is generated through pumped hydro, hydro, biomass and oil, and the level of imported electricity.

 

Move your cursor over a dial for further information on the different technologies and sources of generation. Coal and nuclear power stations are always switched on and provide most of what is called the base load of electricity required throughout the day. Gas makes up the difference and covers peak demand and balances the variable output from renewables such as wind.

Not much changes during the summer months but the demand can increase dramatically during very cold weather in the winter. It is interesting to see how the dials shift as soon as people get up in the morning. Also, the amount of electricity produced via wind turbines drops to almost zero during stormy weather. The turbines are switched off in high winds to protect them from damage.

Warning: this site can be addictive, especially if you start monitoring it during late autumn and winter!

For more data and statistics on UK energy go to the Department of Energy and Climate Change (DECC) at https://www.gov.uk/government/organisations/department-of-energy-climate-change/about/statistics

Google adds in-depth articles to results

Google is rolling out a new addition to search results called "In-depth articles" (http://insidesearch.blogspot.ca/2013/08/discover-great-in-depth-articles-on.html):

"To understand a broad topic, sometimes you need more than a quick answer. Our research indicates perhaps 10% of people’s daily information needs fit this category -- topics like stem cell research, happiness, and love, to name just a few. That's why over the next few days we’ll be rolling out a new feature to help you find relevant in-depth articles in the main Google Search results."

The articles appear as a block of three at the bottom of your results, if you only display 10 results per page, or in the middle of the page if you display more. As Google says, they appear if your search is fairly broad and they do not appear for every query. I had to run several different searches before I found an example. At present it is only available in Google.com

My search on thorium reactor started with a Wikipedia article at the top, which seems all too often to be the default.

Further down the page was a block of three "in-depth" articles from Wired, Cosmos Magazine and Nature.

They do not appear at all if you use a Chrome Incognito window or your browser's private browsing option. They also disappear if you apply Verbatim to your results.

How useful are these articles? They are certainly lengthy and in depth but only the one from Nature was fairly recent (December 2012). The one from Wired was published in 2009 and the Cosmos Magazine article appeared in 2006. I tried limiting my search to articles published in just the last year using Search Tools, Any time, Past year. The documents in the main results changed but the in-depth articles remained the same. The Nature article is highly relevant but there are more recent documents to be found than those from Wired and Cosmos. This raises the question as to how these articles are selected. I have not yet found any reliable information on how it is done, although Google's Webmaster Central Blog has provided a checklist that may help get an article into the triumvirate (http://googlewebmastercentral.blogspot.co.uk/2013/08/in-depth-articles-in-search-results.html). The Moz Blog has run an analysis on 352 searches and found that the major news sources feature heavily (see http://moz.com/blog/inside-indepth-articles for further details).

In theory, in-depth articles are a good way to find an overview of a topic but do check the dates. They may be horrendously out of date.

Statista: statistics, industry and market data

Statista (http://www.statista.com/) is a portal for statistics, market data, market research and survey results. It aggregates data on over 600 international industries from more than 18,000 sources, including market researchers, trade organizations, scientific journals, and government databases. You can get a rough idea of what the service covers from the list of topics at http://www.statista.com/topics/, although this does give the impression that it is heavily US biased, which is not the case.

Searching Statista is straightforward. The default is to include what it calls word fragments, so a search on the term bank will also find banking. This can be changed to identical words if you require an exact match. To search for phrases place double quote marks around your terms, and documents containing a specific term can be excluded by prefixing the word with an exclamation mark. You can 'OR' terms by inserting the vertical bar symbol (|) between them, for example dog | cat. To refine your search further use the options on the right hand side of the results page. These include date of publication, region, free/fee-based/all, and category.

Trying to view the data and charts that you find can be a frustrating process as most of the information is only available on subscription. There is a limited amount of free information but you still have to register for what Statista calls its basic free access. The premium account for an individual user is USD 49/month and runs for a minimum of 12 months. This is automatically renewed so make sure you cancel before the year is up if you no longer wish to use it. The corporate subscription is USD 199.90/month. Again the subscription runs for 12 months. A free trial is available for the corporate service but not for individual users. Prices for universities, libraries and education are available on request.

On the results page you can easily identify the subscription content by the red plus sign next to the chart icon to the left of the result. A red 'P' indicates a priced report that is free to corporate clients but can be purchased by basic and premium account holders.

Clicking on a result takes you to a page where the data is displayed as a chart or graph depending on what Statista thinks is the most appropriate for that statistic, but you can change the representation if you wish. There are also options for downloading the data in various formats and links to the original source.

Information is provided on the source and includes title of the original document, the publisher, publication date, time period covered by the survey and the geographical regions covered. Statista also adds notes such as definitions of terms used in the original report and observations on possible missing data.

Much of the information on Statista can be found by via Google or Bing using advanced search commands and options, but you will probably have to wade through a significant amount of irrelevant information before you find the data you need. Statista can certainly save you a considerable amount of time, and the data displays are a great way of helping you identify the potential usefulness of a report, as can the metadata and notes.

Is the subscription worth it? It is definitely cost effective for corporates in terms of saving search time and ensuring accuracy and quality of information. I have had good feedback about Statista from several of my clients. I am not so sure about individual users. Some of my own research is highly specialised and I am not convinced that Statista covers all of the areas of interest to me. It is difficult for me to assess its value without trialing the full service first, and there are no pay as you go options such as a day or weekly rate. I might even consider paying for a month's access for a project but it is a full year's subscription or nothing. Nevertheless, I recommend you take a serious look at it and if you are contemplating a corporate subscription you can ask for a free trial. It is now on my list of essential research tools.

Bing adds Creative Commons search to images

Bing has added public domain and Creative Commons options to its image search but only if it thinks you are in the US. This is a feature that Google has long offered as part of its image advanced search but Bing have only recently added it as an option. If you are looking for an image to include in a presentation, article or promotional literature you have to make sure that the copyright license allows you to do that. Get it wrong and you could be on the wrong end of a very expensive law suit (Bloggers Beware: You CAN Get Sued For Using Pics on Your Blog http://www.roniloren.com/blog/2012/7/20/bloggers-beware-you-can-get-sued-for-using-pics-on-your-blog.html). 

Images that are in the public domain give you free rein to do whatever you want with them but it can be difficult to find photos that match your requirements. You may have more luck with Creative Commons images.

Bing image search now has an option to restrict your search to a specific license, but only if you are using the US version of the search engine. For those of us outside of the US we have to change our 'country/region'. Bing frequently introduces new search options that are only available on the US version. They obviously think that the rest of the world is irrelevant.

On Bing's home page you should see in the upper right hand corner of the screen a 'Sign in' option and a cog wheel. Click on the wheel to go to the settings page where you will see an option to change your location. Click on 'Change your country/region" and select 'United States- English'. Then head off to Bing images.

Run your search and running across the top of the results page you should see a menu with 'License' at the end of it. Click on this and a drop down menu will appear with options such as 'Public domain', 'Free to share and use', 'Free to modify, share and use commercially'.

Select the license you need and only images with that license will be included in the results. In the example below I have run a search on Caversham, which is where I live, and selected the 'Free to share and use' license. The results include one of my own Flickr photos of Queen Anne's school.

I have a major problem with the terminology used by Bing to describe some of the licenses, and it is also a problem with Google. Misunderstanding the terms of the license could land you in serious trouble and both Bing's and Google's descriptions can be confusing and misleading. 'Free to modify, share and use commercially' is straightforward. You can modify the image, share it and even use it as part of commercial publication, brochure, website or whatever. But what about 'Free to share and use'? I often run this one past people in my workshops and seminars, many of whom are not familiar with copyright. Usually, their immediate response is that they can share and use it however they want, even commercially. Then there might be a pause and someone will ask "What's the difference between that license and 'Free to modify, share and use commercially". A great deal, and a substantial dent in your finances if someone decides to sue you for copyright infringement, but to most people it is not obvious. It wasn't obvious to me the first time I saw the options! 'Free to share and use' is only allowed for non-commercial purposes. Is it so difficult to add 'non-commercial' to the description?

Always click through to the original source of the image. If it is a Flickr photo the copyright license will be clear. My photo of Queen Anne's school is indeed Creative Commons free to share and use, but non-commercially and with attribution (you are required to credit me as the photographer). You may also find that the license that Bing or Google indicates is associated with an image may not be correct. On many occasions I have identified, via Google, an appropriately licensed image for a presentation or paper only to discover that it was 'all rights reserved' and that the Creative Commons license referred to another image on the page. If in doubt, ask. And if you cannot identify who is responsible, or they do not respond to your emails then do not use it.

If you are wondering where Google's image license options are, they are on the advanced search screen. You first have to run your search in Google images and then click on the cog wheel in the upper right hand area of the results page.

Select 'Advanced search' and on the next screen go down to almost the bottom of the page and 'Usage rights'. Click on the downward pointing arrow next to 'not filtered by license' and select the license you require. By the way, 'not filtered by license'  does not mean public domain - it covers every image that Google has indexed regardless of whether it is all rights reserved or completely free to use.

And finally, if the perfect image for your project is all rights reserved do not despair. Contact the owner of the photo. If it is a worthy project or a local community cause they may give you a free license.

Are your Flickr photos backed up?

Are your Flickr photos backed up? If Flickr accidentally deleted part or all of your account would you be able to quickly restore your collection? My own complete photo collection that has been gathered together from mobile devices and various cameras is stored on my laptop and an external hard drive, but my Flickr photos are a small subset and are organised differently. I would not relish having to rebuild my Flickr sets from scratch.

Flickr has just announced that it will be down for planned maintenance tomorrow (Thursday 24th) from 4 PM PDT to 10 PM PDT. As far as I am aware there have been no major data losses so far as a result of maintenance and upgrades by Flickr, but it once accidentally deleted a user's entire account (Flickr user gets back account after its accidental deletion http://thenextweb.com/media/2011/02/03/flickr-user-gets-back-account-after-its-accidental-deletion/). Flickr did, however, eventually manage to restore the account.

You cannot assume that maintenance and upgrades will be without incident, though. A couple of years ago some bloggers using Google Blogger lost posts as a result of problems that arose during maintenance. (Blogger still down; 30 hours of posts lost http://www.neowin.net/news/blogger-still-down-30-hours-of-posts-lost). My husband was one of those whose posts never reappeared but thankfully he had backups. Some of his articles are quite long and detailed so he is in the habit of preparing them offline before uploading to Blogger. He also has a full backup created using Blogger's Import/Export option (it can be found under Settings, Other). Flickr, however, does not offer an option to export your data so one has to resort to third party tools.

One of the best tools I have found to date for backing up a Flickr account is Bulkr (http://clipyourphotos.com/bulkr). This has to be downloaded to your computer and requires Adobe AIR to be installed. The free version allows you to download your photostream (small, medium or large sizes but not the original) and up to 15 sets.

 If you want to download all of your sets, the original sized photos and include the metadata (title, description, tags) then you will need to upgrade to the Pro version, which currently costs USD 29.99/year. There is a Pro+ option, which is a one time payment currently offered at USD 49. Bulkr does not download comments.

An alternative is MyFlickrBackup (http://myflickrbackup.com/), which costs USD4.99 and requires .NET Framework Client Profile to run. It downloads original sized photos and all of your sets, but not the metadata. Two other programs that have been recommended to me but which I haven't yet tried are FlickrDownload (http://www.onstation.org/flickrdownload/) and photoSync (http://webecoz.com/).

I'd be interested in hearing your experiences of any of the above, or if you know of other useful Flickr backup apps.

Has Google dumped RSS alerts or not?

Google closed down its RSS Reader on July 1st and shortly afterwards stories that it had also discontinued RSS alerts started to circulate. The first one I saw was by Google Operating System (Google Alerts Drops RSS Feeds  http://googlesystem.blogspot.co.uk/2013/07/google-alerts-drops-rss-feeds.html) quickly followed by Search Engine Land (Google Alerts Drops RSS Delivery Option http://searchengineland.com/google-alerts-drops-rss-delivery-option-165709). Both reported that when they went to manage their RSS alerts Google told them that they would have to convert all of their feeds to email alerts. From this it was assumed that Google had decided to abandon RSS altogether, which confused me because I was still receiving RSS feeds for alerts I had set up in News and Blogs. 

It transpires that Google no longer offers alerts for web searches. That is no great loss to me as I have always found the web alerts to be unreliable. News and blog search alerts are a different matter, though, as I usually have about 70-80 running at any one time. I could set up a separate email account for the alerts but I find it so much easier to organise and view them in an RSS reader.

Two weeks later and my feeds continue to come through. I can still set up new alerts for Blog searches by running the search and then clicking on the RSS link at the bottom of the page.

The eagle-eyed amongst you will have spotted that they have not yet removed the link inviting you to subscribe to the feed in Google Reader!

The procedure for a News RSS alert is more long winded and you need a Google account to set it up. First sign in to your account and go to Google News. In the upper right hand area of the screen there is a cog wheel. Click on the wheel and a set of personalization options should appear underneath it.

In addition to the standard categories that you can add or remove there is a box into which you can type in your own "topic". Click on the + button to add it to the list and save the personalization. Your search topic should now appear in a list on the left hand side of the screen.

Click on your topic and at the bottom of the results page you should see an RSS icon which takes you to the feed for that search.

So the good news is that Google blog and news alerts are still available as RSS feeds. The bad news is that they are complicated to set up in news, and the links and text on the blog search results page have not been updated to reflect the discontinuation of Google Reader. This strongly suggests that RSS is very low on Google's list of priorities so it really could be axed across the board.

If Google does decide to "retire" RSS and you want to carry on receiving RSS rather than email alerts there are several alternatives. So far, the best of the free services for me is the Netvibes Dashboards (http://www.netvibes.com/), which uses a number of tools including Google. Even if I ignore the Google results, Netvibes generally comes up a comprehensive and relevant set of alerts on my topic. Overall, I would rather not have the hassle of setting up my alerts afresh but Google has a habit of finishing off services with little or no warning. Now is the time to start looking for replacements.

Top Tips from SWAMP

Towards the end of June I headed off to Swansea Central Library to facilitate a workshop on search tools and techniques for finding business information and statistics.

The session was organised for the libraries of the wonderfully named SWAMP - South West and Mid Wales Partnership.

We had fantastic views from the library of the sea and shore line so they did very well to remain focused on the work in hand. The top tips that the group suggested at the end of the day were a mixture of search techniques and business information sites.

1. Persistence.
Don't give up and don't get stuck in a rut. If your first attempts fail to produce anything useful try a different approach to your search. Try some of the tips mentioned below: use advanced search commands, a different search tool or go direct to a website that covers your subject area or type of information.

 2. Verbatim.
Google automatically looks for variations on your search terms and sometimes drops terms from your search without telling or asking you. To beat Google into submission and make it run your search exactly as you have typed it in, click on ‘Search tools’ in the menu above your results, then click on the arrow next to ‘All results’ and from the drop down menu select Verbatim.

3. Private Browsing.
To stop search engines personalising your results according to your previous searches and browsing behaviour, find out where the private browsing option is in your browser (in Chrome it is called Incognito). This ignores all cookies and past search history and is as close as you can get to unfiltered results.

Short cuts to private browsing in the main browsers are:

Chrome - Ctrl+Shift+N

FireFox - Ctrl+Shift+P

Internet Explorer - Ctrl+Shift+P

Opera - Ctrl+Shift+N

Safari – click on Safari next to the Apple symbol in the menu bar, select Private Browsing and then click on OK.

4. The site: command.
Include the site: command in your search to focus your search on particular types of site, for example site:ac.uk, or to search inside a large rambling site. You can also use -site: to exclude sites from your search. For example, if you are searching for information on Wales and Australian websites mentioning New South Wales keep coming up include -site:au in your search.

5. The filetype: command.
Use the filetype: command to limit your research to PowerPoint for presentations, spreadsheets for data and statistics or PDF for research papers and industry/government reports. Note that in Google filetype:ppt and filetype:xls will not pick up the newer .pptx and xlsx formats so you will need to incorporate both into your strategy, for example filetype:ppt OR filetype:pptx, or run separate searches for each one. In Bing.com, though, filetype:pptx will pick up both .ppt and .pptx files.

6. Guardian Data Store (http://www.guardian.co.uk/data/)
For datasets and visualisations relating to stories in the news. This is proving to be a very popular site on both the public and in-house workshops. As well as the graphs and interactive maps the source of the data is always given and there are links to the original datasets that are used in the articles.

7. Company Check (http://www.companycheck.co.uk/)
Company Check repackages Companies House data and provides 5 years of figures and graphs for Cash at Bank, Net Worth, Total Liabilities and Total Current Liabilities free of charge. It also  lists the directors of a company. Click on a director’s name and you can view other current and past directorships for that person.

8. BL BIPC industry GuidesThe British Library Business Information and IP Centre’s industry guides at  http://www.bl.uk/bipc/dbandpubs/Industry%20guides/industry.html highlight relevant industry directories, databases, publications and web sites. Excellent starting points if you are new to the sector.

9. Web archives for documents, pages and sites that are no longer "live".
Most people know about the Internet Archive's Wayback Machine at http://www.archive.org/and its collection of snapshots of websites taken over the years. There is also a collection of old UK government webpages at http://www.nationalarchives.gov.uk/webarchive/, and the British Library has a UK web archive at http://www.webarchive.org.uk/ukwa/.

10. Keep up to dateKeep up to date with what the search engines are up to, changes to key resources and new sites. Identify blogs and commentators that are relevant to your research interests and subject areas and follow them using RSS or email alerts.

Farewell AltaVista

Yahoo is finally pulling the plug on AltaVista on July 8th. It appears as a one line entry in Yahoo's latest list of closures (http://yahoo.tumblr.com/post/54125001066/keeping-our-focus-on-whats-next) with the comment "Please visit Yahoo! Search for all of your searching needs". AltaVista was started by Digital Equipment in 1995 and quickly became the default search engine for many of us. I still meet people who have remained loyal to AltaVista even though it lost its unique search features a long time ago. Danny Sullivan has written a short history and eulogy for the search engine at http://searchengineland.com/altavista-eulogy-165366 - "A Eulogy for AltaVista, The Google of its Time". Great though it was, some of us had already defected to the Inktomi powered search engine HotBot by the time Google had arrived on the scene. Alas, HotBot is now a shadow of its former self and AlltheWeb, which Yahoo had also acquired, was closed down in April 2011.

I've unearthed the AltaVista chapter and summary that I wrote for an early edition of Search Strategies. The chapter is at http://www.rba.co.uk/search/altavista/AltaVistaChapter.pdf and the summary sheet at http://www.rba.co.uk/search/altavista/avsumm.pdf

Google drops the tilde operator

It seems that Google has dropped the tilde (~) synonym operator (http://googlesystem.blogspot.co.uk/2013/06/googles-tilde-operator-no-longer-works.html). Although Google automatically looks for variations on your terms, placing a tilde before a word seemed to look for more variations and related terms. It meant that you didn't have to think of all the possible permutations of a word. It was also very useful if you wanted Google to run your search exactly as you had typed it in except for one or two words. The Verbatim option tells Google to run your search without dropping terms or looking for synonyms, but sometimes you might want variations on just one of the words. That was easily fixed by placing a tilde before the word. Now we are left with the OR command, which is unreliable at the best of times.

I must admit I didn't see this one coming. My money was on another option going first.

Many thanks to Aaron Tay (@aarontay) for the alert.

Update: @dmrussell (https://twitter.com/dmrussell) has confirmed via Twitter that it was removed because it wasn't much used and Google could not justify the cost of maintaining the index and code.

North Wales Libraries Partnership Top Tips

The John Spalding Library in Wrexham hosted the North Wales Libraries Partnership (NWLP) workshop "Search is more than just Google". Delegates from public, government, academic and NHS libraries gathered together to look at the effect of mobile technologies on search, open access, getting better results from Google and alternative search tools.

The consensus reached during one of the breaks was that Cyril, one of the library's residents and pictured on the left, should have ignored Google's nutrition advice and gone for the more authoritative sources available in the library and on the web. If only he had waited and attended the workshop he would have known exactly where to look!

There was much discussion on how mobile devices change how we can search - not always for the best - and there was concern, as usual, over how much we willingly give away about ourselves to services such as Google and Facebook. Open access was debated in the afternoon along with possible directions for academic publishing.

An edited set of the slides is available on authorSTREAM at http://www.authorstream.com/Presentation/karenblakeman-1856150-search-google/ and Slideshare at http://www.slideshare.net/karenblakeman1/search-is-more-than-just-google.

The Top Tips that the group came up with included some of the usual advanced Google commands but others concerned cloud computing and social media. Here they are.

1. Back up your stuff. Having your data hosted in the cloud means you don't have to worry about it disappearing when your laptop or server crashes. But what if your cloud service goes under or your account is deleted for some reason? Have you made a local backup of your essential files and treasured family photos? One of the participants mentioned the Library of Congress digital preservation toolkit for preserving family memories (http://www.digitalpreservation.gov/personalarchiving/).

2. Private browsing for "un-personalising" search results. If you want to make sure that your results are not being influenced by past searches and browsing behaviour, find out where the private browsing option is in your browser (in Chrome it is called Incognito). This ignores all cookies and past search history and is as close as you can get to unfiltered results.

3. Change the order of your search terms to change the order in which results are listed. This is an old trick but still seems to work.

4. Use advanced search commands such as site:, filetype;, intext:, to focus your search. Some of the commands are available not just in Google but also in Bing and DuckDuckGo.

5. Create "newspapers" of articles mentioned on Twitter, Facebook, Google+ or news sites by using services such as Paper.li (http://paper.li/). These can be generated from hashtags, keyword searches or your own Twitterstream. Have a look in the Paper.li news stand to see if someone has already created a paper on your topic. Paper.li automatically compiles the newspaper but there are other services such as Storify (http://storify.com/) and Scoop.it (http://www.scoop.it/) that enable individuals to curate the content that appears in their personal newspaper.

6. Guardian Data Store for datasets and visualisations relating to stories in the news (http://www.guardian.co.uk/data). This was so popular that it was mentioned twice for inclusion in the top tips. What people liked about this is that the source of the data is always given and there are links to the original datasets.

7. Million Short http://millionshort.com/. If you are fed up with seeing the same results from Google again and again give Million Short a try. Million Short runs your search and then removes the most popular web sites from the results. Originally, as its name suggests, it removed the top 1 million but the default has changed to the top 10,000. The page that best answers your question might not be well optimised for search engines or might cover a topic that is so “niche” that it never makes it into the top results in Google or Bing. One person loved it because the type of research they do often pulls up pages of Amazon and eBay results in Google. Not a problem with Million Short

8. Google Reading level to change the type of results that you see. Run your search and from the menu above the results select ‘Search tools’, ‘All results’ and from the drop menu ‘Reading level’. Options for switching between basic, intermediate and advanced reading levels should then appear just above the results. Click on the Advanced option to see results biased towards research.

9. Beware fragmented discussions. Articles can be posted and reposted in many different places: blogs, websites, LinkedIn, Facebook etc. with the result that potentially useful and informative discussions are dotted all over the place. Learn how to locate fragmented discussions in your subject area and where they are likely to occur.

10. Try something other than Google. Take a look at the slides for a few(!) suggestions of what you could use.

Google adds nutrition facts

Google is now showing detailed nutritional facts for food. Type in the name of a food and Google brings up a side panel to the right of the standard results showing images, Calories per 100g, levels of fat, cholesterol, carbohydrate, protein and selected vitamins and minerals.

You can bring a specific nutritional fact to the top of the results by including it in the search, for example iron in spinach.

Typing in just the name of a food works in most cases but for some you have to be more specific to pull up the facts. Butter and olive oil are two where you have to include additional terms, for example calories. It also does not have facts for the more unusual foods such as scorzonera and salsify.

The general description is taken from Wikipedia. The sources for the facts include USDA (US Department of Agriculture) so the figures for Daily Values may not be the same as the EU Recommended Daily Allowance.