Wednesday, March 11, 2020

Directories, Search Engines & Traffic

Want to know the difference between a search engine and a directories and why each is so important to your success? This section will give you all of that information and more.

You would be using search engines so you know how they work from the user perspective. 

From your own experience as a user, you also know that only those results that list at the top of the heap are most likely to attract you. 

It doesn’t amuse you to know that your search yielded 44316 results.
Perhaps even number 50 on your list will not get your custom or even your attention. 

Thus you know that getting listed on the top or as near to the top
is crucial. Since most of the search engine traffic is free, you’ll usually find worth your time to learn a few tricks to maximize the results from your time and effort. 

In the next section, you will see how search engine works – from
your perspective as a website owner.

Web Crawlers

It is the search engines that finally bring your website to the notice of the prospective customers. 

Hence it is better to know how these search engines actually work and how they present information to the customer initiating a search.

There are basically two types of search engines. The first is by robots called crawlers or spiders.
Search Engines use spiders to index websites. 

When you submit your website pages to a search engine by completing their required submission page, the search engine spider will index your entire site. 

A spider is an automated program that is run by the search engine system. A Spider visits a web site, reads the content on the actual site, the site's Meta tags and also follow the links that the site connects to. 

The spider then returns all that information back to a central depository, where the data is 
indexed. It will visit each link you have on your website and index those sites as well. 

Some spiders will only index a certain number of pages on your 
site, so don’t create a site with 500 pages! The spider will periodically return to the sites to check for any information that has changed. 

The frequency with which this happens is determined by 
the moderators of the search engine. 

A spider is almost like a book where it contains the table of contents, the actual content and the links and references for all the websites it finds during its search, and it may index up to a million pages a day. 


One of the things that a search engine algorithm scans for is the frequency and location of keywords on a web page, but it can also detect artificial keyword stuffing or spamdexing. 

Then the algorithms analyze the way that pages link to other pages in the Web. 

By checking how pages link to each 
other, an engine can both determine what a page is about, if the keywords of the linked pages are similar to the keywords on the original page. 

Most of the top-ranked search engines are crawler based search engines while some may be based on human compiled directories. 

The people behind the search engines want the same thing every webmaster wants  traffic to 
their site. 

Since their content is mainly links to other sites, the thing for them to do is to make their search engine bring up the most relevant sites to the search query, and to display the best of these results first. 

In order to accomplish this, they use a complex set of rules called 

When a search query is submitted at a search engine, sites are 
determined to be relevant or not relevant to the search query according to these algorithms. 

And then ranked in the order it calculates from these algorithms to be the best matches first. 

Search engines keep their algorithms secret and change them often in order to prevent webmasters from manipulating their databases and dominating 
search results. 

They also want to provide new sites at the top of the search results on a regular basis rather than always having the same old sites show up month after month.


A search engine robot’s action is called spidering, as it resembles the multiple legged spiders. 

The spider’s job is to go to a web page, read the contents, connect to any other pages on that web site through links, and bring back the information. 

From one page it will travel to several pages and this proliferation follows several parallel and nested paths simultaneously. 

Spiders frequent the site at some interval, may be a month to a few months, and re-index the pages. This way any changes that may have occurred in your pages could also be reflected in the index. 

The spiders automatically visit your web pages and create their listings. An important aspect is to study what factors promote deep crawl the depth to which the spider will go into your website from the page it first visited.


Most search engines claim that they index the full visible body text of a 
page. In a subsequent section, we explain the key considerations to ensure that indexing of your web pages improves relevance during search. 

The combined understanding of the indexing and the page-ranking process will lead to developing the right strategies. 

Meta Tags 

The Meta tags ‘Description’ and Keywords have a vital role as they are indexed in a specific way. Some of the top search engines do not index the keywords that they consider spam. 

They will also not index certain stop words (commonly used words such as ‘a’ or ‘the’ ‘of’) so as to save space or speed up the process. 

Images are obviously not indexed, but image descriptions or Alt text or text within comments is included in the index by some search engines.


Hybrid Search Engines are both crawler based as well as human powered. In plain words, these search engines have two sets of listings based on both the mechanisms mentioned above. 

The best example of hybrid search 
engines is Yahoo, which has got a human powered directory as well as a Search toolbar administered by Google. 

Although, such engines provide both listings they are generally dominated by one of the two mechanisms. Yahoo is known more for its directory rather than crawler based search engine.


Search engines rank web pages according to the software’s understanding of the web page’s relevancy to the term being searched. To determine 
relevancy, each search engine follows its own group of rules. 

The most important rules are 

• The location of keywords on your web page; and 

• How often those keywords appear on the page (the frequency) 

For example, if the keyword appears in the title of the page, then it would be considered to be far more relevant than the keyword appearing in the text at 
the bottom of the page. 

Search engines consider keywords to be more relevant if they appear sooner on the page like in the headline rather than later. 

The idea is that you’ll be putting the most important words the ones that really have the relevant 
information on the page first.

Meta Tags Versus Back Link Popularity 

Meta tags are often labeled as the secret to getting high rankings, but meta tags alone will not get you a top 10 ranking. 

On the other hand, they certainly don’t hurt. Detailed information on meta-tags and other ways of 
improving search engine ranking is given later in this chapter. 

Fact is, these days with popularity playing a more major role in search engine positioning, meta tags do not carry as much weight as they used to. 

In the early days of the web, webmasters would repeat a keyword hundreds of times in the Meta tags and then add it hundreds of times to the text on the web page by making it the same color as the background. 

However, now, major search engines have algorithms that may exclude a page from ranking if it has resorted to keyword spamming in fact some search engines will downgrade ranking in such cases and penalize the page.

Meta Search Engines 

Dogpile is a meta search engine that searches the Internet's top search engines such as About, Ask, FAST, FindWhat, Google,LookSmart, Overture and many more. 

With one single, powerful search engine, you get more relevant and comprehensive results. When you use Dogpile, you are actually 
searching many search engines simultaneously. 

Dogpile, founded in 1996, is the most popular Internet meta-search engine. The site joined the InfoSpace Network in 2000 and is owned and operated by InfoSpace, 

A Search Engine Is Just A Tool 

A search engine is just a tool. It's only as smart as the people who master minded it. 

If Ix Quick is smarter and more relevant in its findings than other metasearch engines and many highly qualified people would agree that it is.

it's because it was conceived to meet the needs of some of the most inquisitive minds in the world those of researchers, educators, 
scholars and the world scientific community.

No comments:

Post a Comment