HaystackSearching for a specific piece of information in a huge mass of data is akin to trying to find a needle in a haystack. This type of search is a simple operation that may or may not be successful, depending on the parameters entered by the user and the quality of the search engine.

Unfortunately, no matter how advanced a search technology may be, problems with accurate search results arise simply because the system has no way of personalising the experience. For example, if I am a trader in African wheat futures in a trading organisation and I look for ‘wheat’, I will obviously receive far more information than I need and most of it will probably be irrelevant. So to fix this perhaps I should add the prefix ‘African’ to look at wheat from a specific geographic area. This narrows it down somewhat, but I may also get unrelated information about Africa. However, there is one type of information I will not get – information that tells me what I need to know, but does not actually contain the words I specified. We will come back to that later. It is time to organise the haystack.