Searching the Web
Summary Description 5 Minute Guides looks at search engines and directories.
Author

Publication

Roullas Top10 Simon Vandore

APC
Yes


Editorial InformationArticle Location
Article Topic 5 Minute Guides
Story Order
Story Group 001203
Post Date 28/11/2000 07:54 AM Status First Sub Entered by Simon Vandore on 28/11/2000 06:54 AM


ImagesLead Picture


Heading Image




Content
Introduction


Body
What is a search engine?
A program that automatically indexes information on Web sites in order to answer user queries is commonly known as a search engine. Examples include AltaVista, Hotbot and LookSmart. They are programmed to automatically surf the Web, following link after link to discover new content, adding the information to a searchable index. The front-end for carrying out searches is normally another Web page. For example, a user types 'frogs' into the front-end and the search engine returns all the Web pages it has discovered that contain the word 'frogs'.
How is a search directory different to a search engine?
Sometimes a search engine just isn't good enough. Machines don't understand context, and the results you get from that 'frogs' search might not include pages about tadpoles or swamps, both of which are relevant to research about frogs. Directories of Web pages compiled by human beings are a good alternative, especially if you know exactly what you're looking for, but don't know where to find it.
The biggest example is Yahoo, which was begun in 1994 by two students of Stanford University in the US and has evolved into a multinational company. Yahoo and other directories allow you to 'mine' data by clicking through related subject headings. For example, if searching for 'frogs', you might proceed through the nature category to amphibians, then to frogs, then perhaps choose a page relating to tadpoles.
Some sites, particularly those that attempt to be a one-stop portal for all Internet activity, such as Go.com, offer both search engines and directories. There is no 'best' option for finding information -- search engines tend to provide more results, but directories can be more accurate.
What if I want to search a number of engines or directories?
Some sites, such as Dogpile and Metacrawler, offer a combined interface to multiple search sites. You type the query in once and it is automatically sent off to each search engine in the correct format and you receive results from each on one page. It can take a long time for the all results to be returned, and you can often get better results by refining your search on a single search engine, but these combined interfaces can give you a good idea of where to start.
How can I search more effectively?
Search engines work best if your query is as specific as possible. When searching for information on frogs that live in swamps, it would be a good idea to include the words 'tadpole' and 'swamp' in your search, along with 'frogs'. Alternatively, you can refine your search as you proceed, searching for 'swamp' within your results for the original 'frogs' search.
Once you figure out which search sites work best for you, it's a good idea to learn some advanced search methods. Some sites use Boolean logic, where you can create search strings such as 'frogs AND tadpoles NEAR swamp', but others have their own syntax. For example, on AltaVista you can get more accurate results by learning how to structure your search. If you want to search for information about Jane Doe who starred in a Scottish TV show called 'Shopping', you might not get the right results if you simply typed her name into the search box. AltaVista would simply give you all documents containing the word Jane or the word Doe. Putting the name into quotation marks as "jane doe" (case does not matter) makes AltaVista find all pages that contain the two words together. A plus sign in front of a search term means the resulting documents must contain that exact term, while a minus sign means they must not contain it. Therefore, to get the most accurate result from AltaVista your query might be +'jane doe' +scotland +shopping.
How do I make sure my own site is included in a search engine or directory?
Often a search engine will find your site without prompting, as will the human compilers of directories. However, to ensure speedy indexing and make your information more highly available, it is best to submit your site to as many search engines and directories as possible. You can visit each site and do this yourself, or you can rely on a combined submission interface such as submit-it.com.
When creating Web pages that you want to be indexed, it is important to include <meta> tags that the search engine can pick up and use to categorise the information. For example, a description in the format <meta name="description" content="about frogs, tadpoles and other life in the swamp"> and a set of keywords written as <meta name="keywords" content="slime, spawn, lilypads, ribbit"> can help people to find your page. You can also use <meta> tags to tell a search engine to ignore your page.
What are some of the more unusual search engines and directories?
Askjeeves.com is a powerful search engine which takes queries in everyday language. It is presented as a virtual butler who is there to answer all your questions. For example, you can ask Jeeves 'Who is the prime minister of Australia?' and the search engine will provide links to information about the current PM.
The Google search engine is also unusual in that it ranks results based on how many other pages on the Web have a link to each page it returns. The artificial intelligence used by Google often seems like it can read your mind, but there are also times when it is downright unhelpful. Keep a number of search sites bookmarked and you can't go wrong.


Related MaterialsRelated Articles


Related Links




Bulletin Summary

WAP Summary

Cross-Publishing InformationShort Headline


Clipping Information

Corporate IT No This field should be marked 'Yes' for any story of interest to corporate readers
CIT Lead No Newswire Lead No Section Lead No (These fields are controlled by all those handy buttons and agents)