what is bots
2 posters
Page 1 of 1
what is bots
what is bots,ie when it tells you who is on the forum it says registered users,guests and bots????
what is that all about
what is that all about
bhillfan- Posts : 105
Join date : 2010-03-14
Age : 52
Location : sunny bellshill
Re: what is bots
far too complicated to explain to you mate. so just enjoy and dont worry about it
Bobby Dazler- Posts : 40
Join date : 2010-04-17
Re: what is bots
Bobby Dazler wrote:far too complicated to explain to you mate. so just enjoy and dont worry about it
hoy baw heed,lol
my IQ is more than 140,whats yours,i'm smarter than the average bear you know
bhillfan- Posts : 105
Join date : 2010-03-14
Age : 52
Location : sunny bellshill
Re: what is bots
LOL! when I see you next ill explain how all that part works
Bobby Dazler- Posts : 40
Join date : 2010-04-17
Re: what is bots
Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google search engine.
If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]
Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to other known pages on the web in order to be crawled and indexed or manually submitted by the webmaster.
A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth.[3] This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides "Webmaster Tools" that allow website owners to throttle the crawl rate.[4]
If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file,[1] or by adding the meta tag to the webpage.[1] Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".[2]
Currently Googlebot only follows HREF links and SRC links.[1] Googlebot discovers pages by harvesting all of the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to other known pages on the web in order to be crawled and indexed or manually submitted by the webmaster.
A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth.[3] This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides "Webmaster Tools" that allow website owners to throttle the crawl rate.[4]
Bobby Dazler- Posts : 40
Join date : 2010-04-17
Re: what is bots
got it now
bhillfan- Posts : 105
Join date : 2010-03-14
Age : 52
Location : sunny bellshill
Page 1 of 1
Permissions in this forum:
You cannot reply to topics in this forum
|
|