Turn Spider Traps Into Spider Food By Russell Wright At Isnare.com Ezine Articles

Some web pages on your website may not be listed in the search engines, even when you have submitted your website for inclusion. This is because dynamic pages cause the spiders give up and go home.

A “spider” is a search engine robot that shows up and crawls all around your website in order to determine its value. A spider is basically deaf, dumb and blind. It uses a proprietary impersonal algorithm to do two things:

# It will read the content on your webpage to determine keyword saturation, density, consistency and frequency.

# It will follow the internal and external links from your site and determine the relevancy of these links in relationship to your content.

It is estimated that there are over 100 other factors that spider-bots are programmed to analyze. All of these factors may contribute to your ranking for any given keyword or keyword phrase.

A dynamic web page is generally one that serves content based on filling out a form of some kind. The key point here is that search engine spiders cannot find web pages that are dynamically created. There are no links for them to follow. An example of a dynamic page is a “search this site” field. The page that is served is dependent upon the content of the keyword typed in by your visitor.

A spider cannot follow the “search this site” form, nor can it keep track of the popular pages that your visitor may query.

Companies like Icon Interactive™ use proprietary technology to make sure that all of your dynamically generated web pages are spidered and archived by the search engines. This technology allows you to keep track of the most popular dynamically generated pages and assures submission of these pages to the search engines.

If somebody comes to your website and uses your “search this site” form, whatever page they end up clicking will be added to a list of links to be submitted to the search engines. This list is transformed into a webpage and is automatically added to your website.

When the spider visits your website next time, instead of getting trapped in your dynamic page, it will include the links that people have been choosing. This makes sure that your deeper, more obscure pages are automatically spider food.

Perhaps even more importantly this system will serve as a simple clickstream function. You will be able to find out the exact pathway a visitor uses to arrive on certain pages of your website from a dynamic page. This is not possible with most website statistic software.

Published At: Isnare Free Articles Directory http://www.isnare.com
Permanent Link: http://www.isnare.com/?aid=19318&ca=Internet

Important Notice DISCLAIMER: All information, content, and data in this article are sole opinions and/or findings of the individual user or organization that registered and submitted this article at Isnare.com without any fee. The article is strictly for educational or entertainment purposes only and should not be used in any way, implemented or applied without consultation from a professional. We at Isnare.com do not, in anyway, contribute or include our own findings, facts and opinions in any articles presented in this site. Publishing this article does not constitute Isnare.com's support or sponsorship for this article. Isnare.com is an article publishing service. Please read our Terms of Service for more information.