21 Feb, 2010 | Written by Goginoo | under Robots.txt
A lot of us have a serious problem with the duplicate content issue in Levitra effectiveness target=”_self”>WordPress blogs, and a lot of people don’t know even if WordPress makes duplicate content issue and they don’t know why they get poor rank for their websites in SERP.
A lot of people get confused about what to type in Robots.txt file to avoid duplicate content issue in WordPress blogs, they afraid to type command that maybe hurt their websites in the SERP.
So today I will give these people the best command that they should type in Robots.txt file to avoid duplicate content and to avoid hurting the rank of the websites in the search engines.
First, you should know what problems in WordPress that makes duplicate content in the search engines.
1) Categories and tags: many of use have tags and categories with the same names, for example:
Category name: Search Engine Optimization, Order viagra Tag name: Search Engine Optimization.
So this will make a duplicate issue in the search engines, you should disallow search engines robots to index the categories or Tags so you should not index both of them in the search engines.
2) WordPress PHP, Plugins, Themes, Cache, and Includes files, you have to disallow robots to index these files, this will not help your blog to get high rank it’s will be useless if you index these files.
3) WordPress archives, Buy Revia Online Pharmacy Feeds, Comments and Comments pages, Trackback, Pingback, Stats, Author, and categories slug. Vardenafil levitra
If you keep those in the search engines you will get duplicate content issue in the search engines. Viagra o levitra
Two serious problems with duplicate content issue in Comments and Categories slug, example:
1) Comments page: I’m sure that you had a post that indexed two times in the search engines like; The original post URL 2) The original post URL but with Comment-page1 at the end of the URL, example: http://yourblog.com/posturl/comment-page1 .
I had these problem once and I was so crazy because these problem every time I publish a post I get duplicate content issue because these issue, but finally I solved this problem and I will tell you how without editing in your WordPress files (some people had to solve these problem by adding some codes in a WordPress php file).
2) Category slug: what I mean here is your categories URLs will be indexed in the search engines like this: http://yourblogdomain.com/category/seo and you will see the same category also indexed as: http://yourblogdomain.com/seo this URL should be indexed in the search engines not the URL above, and we will solve this problem also.
Before I give you the best command in Robots.txt for WordPress you should do this in WordPress admin control panel to solve the “comment-page” duplicate content issue (you have to do this step also you should disallow indexing it in the Robots.txt file).
Go to your WordPress admin control panel, click on “Settings” from the dashboard then click on “Discussion” then you will see this:
Solving comments-page duplicate content issue in WordPress:
combivir style=”color: #000000;”>
Look at the screenshot above please uncheck the “Break comments into pages” then save your changes.
This will not break the comments into pages (if you have 200 comments in one page, if you don’t uncheck this you will have 4 pages with same post URL with “/comment-page” in the end of the post URLs).
Now I will give you the best command in Robots.txt file for WordPress blogs (Please read about Robots.txt article).
Robots.txt commands for WordPress blogs:
User-agent: *
Sitemap: http://yourblog.com/sitemap.xml
Allow: /wp-content/uploads/
Wellbutrin SR Online #ff0000;”>Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /wp-includes/
Disallow: /wp-content/
Disallow: /wp-content/plugins/
Disallow: /wp-content/cache/
Disallow: /wp-content/themes/
Buy Brand Levitra Online Pharmacy No Prescription Needed style=”color: #ff0000;”>Disallow: /*?*
Disallow: /*?
Disallow: /archives/
Disallow: /feed/
Disallow: /comments/feed/
Disallow: /comments
Disallow: /feed/$
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/trackback/$
Disallow: /*/*/feed/$
Disallow: /*/*/feed/rss/$
Disallow: /*/*/trackback/$
Disallow: /*/*/*/feed/$
Disallow: /*/*/*/feed/rss/$
Disallow: /*/*/*/trackback/$
Disallow: /tmp/
Disallow: /tag/
Disallow: /category/
Disallow: /category/*/*
Disallow: /author/
Disallow: /wp-*
Disallow: /tag/
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.cgi$
Disallow: /*.php$
Disallow: /trackback/
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Disallow: /z/j/
Disallow: /z/c/
Disallow: /stats/
Disallow: */comment-page/
Disallow: /*/feed/
Disallow: /*feed/
Paste these commands in your Robots.txt file and save your changes, but you should know this will take some time to make the changes in the search engines so be patient.
I hope this helped you, please if you liked this post share it with people, with your family and friends.
Good Luck.
