Google Technical guidelines

Use a text browser such as Lynx to examine your site, because most engine see your site much as Lynx would. If fancy features such as JavaScript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine may have trouble crawling your site.

Allow search bots to crawl your sites without session IDs or arguments that track their path through the site. These techniques are useful for tracking individual user behavior, but the access pattern of bots is entirely different. Using these techniques may result in incomplete indexing of your site, as bots may not be able to eliminate URLs that look different but actually point to the same page. Make sure your web supports the If-Modified-Since HTTP header. This feature allows your web to tell whether your content has changed since we last crawled your site. Supporting this feature saves you bandwidth and overhead. Make use of the robots.txt file on your web . This file tells crawlers which directories can or cannot be crawled. Make sure it’s current for your site so that you don’t accidentally the Googlebot crawler. Visit http://www.robotstxt.org/wc/faq.html to learn how to instruct robots when they visit your site. You can test your robots.txt file to make sure you’re using it correctly with the robots.txt analysis tool available in Google webmaster tools. If your company buys a content management system, make sure that the system can export your content so that search engine spiders can crawl your site. Use robots.txt to prevent crawling of search results or other auto-generated that don’t add much value for users coming from search engines.

Related posts

  • SEO i subdomen

    Search Engine Optimisation i pozicija subdomena na pretraživacima . Postavljanje poddirektorijuma kao subdomain-a  nece naneti nikakve štete optimizaciji na pretraživacima. Postavljanjem subdomain-a dobijate mogucnost da […]

  • TNX Network?

    TNX.NET link ads advertising system based on points (tnx points) with 43033 users, 32821896 links in the system and 34261517 indexed pages. Text links can […]

  • Website and support

    Fun video about website down and how support solve this. Have fun get  a hosting!! Credit for this fun video goes to The Website is […]

  • Server administrator

    A server administrator, or admin has the overall control over a server The admin for a server is typically the owner and financier of the […]

  • Need a Laptop ?

    Toshiba Protege R 500 state of art laptop, From Toshiba: ,,The Ultimate Ultraportable Ultralight at just over two pounds, and offering a stunning silhouette, the […]