In Search Engine Optimization every one knows the important of Robots.Txt File this file is really important for every website and even blog. every one thinking that what is robots.txt what it really does that every site and even blog require it what happens if my blog or site don't have robots.txt file.
robots.txt file is use to instruct search engine robots about different pages on your website to be crawled and indexed. it is really easy to create robots file for website let me help you to create it for blogger.
robots.txt have some attributes like
all = "ALL"
none = "NONE"
directives = directive ["," directives]
directive = index | follow
index = "INDEX" | "NOINDEX"
follow = "FOLLOW" | "NOFOLLOW"
robots.txt file is use to instruct search engine robots about different pages on your website to be crawled and indexed. it is really easy to create robots file for website let me help you to create it for blogger.
robots.txt have some attributes like
all = "ALL"
none = "NONE"
directives = directive ["," directives]
directive = index | follow
index = "INDEX" | "NOINDEX"
follow = "FOLLOW" | "NOFOLLOW"
You can try Meta tag For Robotos.txt and place in your html try below one
- < metaname ="robots" content = "index,follow">
- < metaname ="robots" content = "noindex,follow">
- < metaname ="robots" content = "index,nofollow">
- < metaname ="robots" content = "noindex,nofollow">
- < metaname="robots" content="all">
- < metaname="robots" content="none">