Big Google

[eXtr33m]

I sometimes see:

Code: Select all

Users browsing this forum: eXtr33m, Google [bot] and 0 guests

Whos that?! I dont like him.

[Cookie]

its google's spiderbot who is indexing the page -_-

[natirips]

You can often see many other bots (i.e. Yahoo, Hotmail,...)

[wurst]

ye, search engines come to several internet sites in order to suck.

phpbb3 has a special feature, that recognize the so-called "browser agent"
through this, search engines will see another page layout, optimized for them.
additionally, some content dont get shown at all (eg. images from "charm of an urt player")

ah, and ye: the board handles them as users, showing up in online peoples list...

[SKracht]

... i sometimes use Google Bot or Slurp, MSN as User Agent

[wurst]

hm, cause of what?

[Unclefragger]

some news sites used to block content for people paying/registering but google was free to index -> change your client ident and you can read it all. (forgot which news sites those were)

Also I think almost all forums and CMS do offer bot viewing and some even offer extensive logging and luring

[wurst]

ah ye ure right, "real-time google cache"
didnt never ever thinkabout since there was allways teh cache...

[eXtr33m]

Ye i know whos that but i dont have good feeling indexing thing just wanted to know whats your opinion..

[wurst]

the opinion about google?