Question be carefull with (Persistent) redirect!

[limits]

only for information!

Persistent or normal redirects

this redirects also googlebot, if you dont add all google ip's on withelist !

google have lots of new crawler without useragent identification !

Googlebot <-UA list :: udger.com

if you redirect this, specialy with persistent, the spider get blocked!!!!

maybe you get a penalty because cloacking or double content...(i'dont no ?)


i try diferent version, also v2.0.5pl2

ps: my spiderlist is up to date.




ps2:
error if i start new thread.

The following errors occurred with your submission
The question Product Version: is missing required info.
get this error, also if i choice the rigth version!

also if i use v2.0.5pl2
. , ?
thats way i use 1.0.0, thats works

 

[Fillip H.]

You need to use 2.0.5pl2, no v or commas

Anyway, could you please be a bit more specific as to what feature you're referring to?

 

[limits]

You need to use 2.0.5pl2, no v or commas

i try to edit my first thread, but can not add this version.
show screnshot.


avter save change, i'm get this message:

Anyway, could you please be a bit more specific as to what feature you're referring to?

sorry if you dont understand wat i'm mean.

its only a information or warnig, if you use redirect, you also redirect google bots,
also if you check the box "Exclude bots (spiders, crawlers, etc.) x"
so the bot get blocked after persistent redirect.

because this only check the spider identification, example "googlebot" "googlemedia" etc. but ther is also gogle crawler without identification, show my screenshot.
google visit my forum also as "guest"

 

[limits]

ok totaly off topic, but you can delete after you check it.


i'm changed my domain name from .net to .club
i'm add this new url yesterday in the client area.

but the forum dont accept if i'm add the new domain.

also the version nr i'm explain bevore is realy not working here.

mac osx 10.8.5
firefox 33.0

please check this video !!
klick here swf file 40 mb

 

[limits]

ok back to the topic.
i hoer from some webmasterfriends, the new google crawler without identification doublecheck the website for cloaking.

that means, if you let show googlebot a diferent content then the anonym crawlwer without identification.

thats way i think you have to be carefull.

because you mark the checkbox dont redirect the spiders.
but the anonym spider get redirectet, so you get diverent content.

so be shure you add also all google ip's to the withelist!

hoppe you understand wat i mean

sorry my english, i'am swiss made

 

[Fillip H.]

I see, this mod uses vBulletin's own "is bot" flag to determine whether the user in question is a bot, so you might want to change the spiders_vbulletin file to detect those additional IPs if possible.

 

[limits]

my spiderlist is up to date!
here you finde the newest xml-spider list sept 2014
OzzModz

the problem is the usseragent is missing from this spider ip's

so the xml list dont catch the ip as a spider.

spiders are user agent based, not ip based!

example:

<spider ident="Google favicon">
<name>Google Favicon</name>
</spider>
<spider ident="Google Page Speed Insights">
<name>Google Page Speed Insights</name>
<info>Google Page Speed Insights</info>
</spider>
<spider ident="Google_Analytics_Snippet_Validator">
<name>Google Analytics Snippet Validator</name>
<info>Google_Analytics_Snippet_Validator</info>
</spider>
<spider ident="gooblogsearch">
<name>Goo Blog Search</name>
<info>http://help.goo.ne.jp/help/article/704/</info>
<email>https://goo.e-srvc.com/cgi-bin/goo.cfg/php/enduser/ask.php</email>
</spider>
<spider ident="Googlebot">
<name>Google</name>
<info>http://www.google.com/bot.html</info>
</spider>

 

[Fillip H.]

In that case, you'll have to use the IP addresses, sorry

 

[limits]

ok i'm find the problem.
the table in the vbulletin db usersession >> useragent is to small.
vbulletin original only use 100 sign

i'm upgrade this to 255 sign, and now there is enough space vor the full spider identification, and all works fine now!

see picture



after edit the table size:


hope this help to make this mod safe


edit:
this is the useragent were the 100 sign is to small.
https://developers.google.com/webmasters/smartphone-sites/googlebot-mobile

 

[Fillip H.]

We can't alter global vBulletin columns in that way, this is a bug you'd best report at the vBulletin Bug Tracker