Posts Tagged ‘link exchange’
Google Webmaster Tools Diagnostics: Web Crawl
October 14th, 2008 • seo
Tags: google webmaster tools, keyword tool, learn seo, link exchange, live webmaster tools, robots txt, search engine optimization, seo, seo tool, seo tools, sitemap, web master tool, web master tools, webmaster, webmaster central, webmaster resource, webmaster tool, webmasters tools, website monitoring, website optimization, website tools
Yesterday I wrote my first post on Google Webmaster Tools which aimed to give an introduction about webmaster tools. Today I’ll go over the Diagnostics section which gives details of results of web crawl and mobile crawl and also provide content analysis of your web site.
Let me start with Web Crawl. Here is a screen shot of Web Crawl Diagnostics page:
In this page seven sub-section are listed. Which are:
- Errors for URLs in Sitemaps
- HTTP errors
- Not found
- URLs not followed
- URLs restricted by robots.txt
- URLs timed out
- Unreachable URLs
I’ve already explained what these sections cover in my previous post about Google Webmaster Tools. Web Crawl Diagnostics page gives details of the errors encountered. It provides the problematic URL as well as the exact reason of problem (HTTP404, HTTP500, robots.txt?). Normally we can group these problems in to two sets. Problems in one set occurs when bots unable to reach the content (your server is down, or you’ve misconfigured your site, or you’re blocking Google bot via robots.txt). The other set is about problematic URLs. Some reasons can be:
- Some external web pages links to some non-existent content in your site: A URL pointing to a non-existing article in your blog.
- Some pages in your site links to non-existent content else where in your site: You give links to a previous post, later you decided to delete that post. And the links you’ve provided remains broken.
- Content is there but URL is broken: For example you list items in your web site by their titles (i.e. web page of “my item” is “http://www.example.com/items/my+item”). And you forgot to handle a special case where titles contains a slash: Web page of “My Item / Item Color” will be “http://www.example.com/items/my+item/item+color” which will definitely be a problematic URL. You actually have an item in your database but you’re unable to link to it.
This list can be extended.
To reduce the problems in the first set there’s not much work to do: You have to check your server status. If it was down for a time, next time Google bot visits number of problems will reduce. If the problems are robots.txt related, you have to recheck your rules.
Second set is complicated a bit. Because there can be too many reasons. The page pointing to your site (providing wrong URL to Google Bot) will definitely be of great use. Until today there were no way of knowing this. Fortunately, today a new post on Google Webmaster Central Blog announced a new feature of Google Webmaster Tools, which is exactly what we are looking for. In each subsection there is a column named “Linked From” under which the pages linking to that problematic URL is listed. Using this information it’ll be much easier to track the problem.
That’s it for now. I’ll go over the content analysis next time.
Say No To NoFollow!
October 3rd, 2008 • seo, wordpress
Tags: backlink, Blog, comment, internet marketing, link building, link exchange, link popularity, nofollow, search engine, search engine optimization, search engine ranking, seo, submit url, u comment i follow, web promotion, wordpress, Wordpress Plugins
nofollow is an HTML attribute value used to instruct some search engines that a hyperlink should not influence the link target’s ranking in the search engine’s index. It is intended to reduce the effectiveness of certain types of search engine spam, thereby improving the quality of search engine results and preventing spamdexing from occurring in the first place.
This is what Wikipedia says about nofollow attribute. It means that, if you use nofollow attribute in your links, search engine spiders will not use that link in target site’s ranking calculations. Under normal terms if a site links to your page, it’ll add some value to your page’s ranking. However if that site add a nofollow attribute, than that value will not be counted by search engines. After some time, spammers realized that they can build a large link set just posting automatic comments to random blogs or adding links to wikipedia. To remedy this situation, authorities suggested to add a nofollow attribute automatically to the links in comments etc. However it seems that this doesn’t work any more. Spammers still post automated comments. For wordpress - and most of popular content managements systems - the best way to keep spam away is comment moderation. For the search engine optimization view, allowing do-follow comments will encourage your readers to drop comments since each comment will be counted as a backlink to their site. So no need to talk more about the benefits of dofollow links : ) Just say no to nofollow!
For Wordpress you can use the NoFollow-Free plugin to change the Wordpress’ default behaviour.


