Friday, October 1, 2010

Requirement OF Robots.txt File For website

In Search Engine Optimization every one knows the important of Robots.Txt File this file is really important for every website and even blog. every one thinking that what is robots.txt what it really does that every site and even blog require it what happens if my blog or site don't have robots.txt file.

robots.txt file is use to instruct search engine robots about different pages on your website to be crawled and indexed. it is really easy to create robots file for website let me help you to create it for blogger.

robots.txt have some attributes like

all = "ALL"
none = "NONE"
directives = directive ["," directives]

directive = index | follow

index = "INDEX" | "NOINDEX"
follow = "FOLLOW" | "NOFOLLOW"

You can try Meta tag For Robotos.txt and place in your html try below one

  • < metaname ="robots" content = "index,follow">
  • < metaname ="robots" content = "noindex,follow">
  • < metaname ="robots" content = "index,nofollow">
  • < metaname ="robots" content = "noindex,nofollow">
  • < metaname="robots" content="all">
  • < metaname="robots" content="none">

2 comments:

SEO services said...

NIce looking post that was really great information

Seo Ahmedabad said...

Robots.txt file is use to instruct search engine robots about different pages on your website to be crawled and indexed. it is really easy to create robots file for website let me help you to create it for blogger.

Post a Comment

Twitter Delicious Facebook Digg Stumbleupon Favorites More

 
Design by Free WordPress Themes | Bloggerized by Lasantha - Premium Blogger Themes | Free Samples By Mail