This one for BESHAR

first of all, i linked to you in this post, so if you click on this post title, it will redirect you to your blog, so people would know who you are.

second of all, i thought bloging is about sharing information and life style, not about investegating. i didn't know it matters to you how people are like or where they from or how young or old they are.

now look at these pictures, i took a screen capture from one of my favorite blogs so far, sorry macaholic i used your blog, now beshar, look closly...>>> i can be here, or ....>>> or here!!!

i can list ten thousand pictures with ten thousand different locations...

does it really matter???

finally, if you felt that you were intimidated by me, don't... you are a successful computer engineer, you practically studied this your entire life, and i'm just a 13 year old after all, no?

Nasty Google Spider

a spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. the major search engines on the Web all have such a program, which is also known as a "crawler" or a "bot" Spiders are typically programmed to visit sites that have been submitted by their owners as new or updated. entire sites or specific pages can be selectively visited and indexed. spiders are called spiders because they usually visit many sites in parallel at the same time, their "legs" spanning a large area of the "web" spiders can crawl through a site's pages in several ways. One way is to follow all the hypertext links in each page until all the pages have been read.


google spider

google has 2 spiders so far --->

the normal google spider: 66.249.64.47 - "GET /robots.txt HTTP/1.0" 404 1227 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

the additional google spider: 66.249.66.129 - "GET / HTTP/1.1" 200 38358 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

please tell me the difference between these two google spiders

the new Google spider uses a slightly different user agent: "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)".

this means that Googlebot now also accepts the HTTP 1.1 protocol. The new spider might be able to understand more content formats, including compressed HTML.


why google does that?

google hasn't revealed the reason for it yet.

but there are two main theories:

• the first theory is that google uses the new spider to spot web sites that use cloaking, javascript redirects and other dubious web site optimization techniques. as the new spider seems to be more powerful than the old spider, this sounds plausible.



• the second theory is that google's extensive crawling might be a panic reaction because the index needs to be rebuilt from the ground up in a short time period. the reason for this might be that the old index contains too many spam pages.

ok, i get it, but what the hell does that mean to my blog/webpage?

if you use questionable techniques such as cloaking or javascript redirects, you might get into trouble. if google really uses the new spider to detect spamming web sites, it's likely that these sites will be banned from the index.

to obtain long-term results on search engines, it's better to use ethical search engine optimization methods. general information about Google's web page spider can be found here.