What's the deal with the [Bot]'s?

Chat about anything not covered in these forums, but keep it civil!

Post » Wed Apr 23, 2008 6:45 am

Has anyone else noticed there are [Bot]'s logged into the forum from time to time? So far I have seen Yahoo [Bot] and Google [Bot]... where do they come from and what the heck is up with that?
Tired of crappy file hosts that are crappy? Get DROPBOX - https://db.tt/uwjysXJF
Moderator
B
45
S
17
G
37
Posts: 2,853
Reputation: 25,966

Post » Wed Apr 23, 2008 6:49 am

They come from, you guessed it, Yahoo and Google. They're archivers. They are the sole reason one day everybody who types "Oh, that crazy SoldjahBoy!" into Google is gonna come up with this page right at the top of their search results.
B
3
S
2
G
4
Posts: 310
Reputation: 2,120

Post » Wed Apr 23, 2008 6:51 am

[quote="CaptainOblivious":2w3p73ib]They come from, you guessed it, Yahoo and Google. They're archivers. They are the sole reason one day everybody who types "Oh, that crazy SoldjahBoy!" into Google is gonna come up with this page right at the top of their search results.[/quote:2w3p73ib]

[size=200:2w3p73ib]O.o[/size:2w3p73ib]
Tired of crappy file hosts that are crappy? Get DROPBOX - https://db.tt/uwjysXJF
Moderator
B
45
S
17
G
37
Posts: 2,853
Reputation: 25,966

Post » Wed Apr 23, 2008 6:56 am

B
3
S
2
G
4
Posts: 310
Reputation: 2,120

Post » Wed Apr 23, 2008 7:09 am

If you put a quote in front of the search string it returns a certain other thread here.
B
4
S
2
G
6
Posts: 161
Reputation: 2,597

Post » Wed Apr 23, 2008 8:26 am

They browse all forums, just PHPBB3 shows them now.

Pretty much every thread seems to be getting indexed :shock:
B
3
S
2
G
5
Posts: 1,777
Reputation: 5,529

Post » Wed Apr 23, 2008 9:33 am

If possible this forum should URL rewrite the page addresses to just .html files (as I have done on my forums). Google favours what appear to be static pages when archiving rather than dynamic ones with querystrings.
Image Image
Scirra Founder
B
125
S
37
G
25
Posts: 3,945
Reputation: 44,922

Post » Wed Apr 23, 2008 2:14 pm

The [Bot]s are just Google, Yahoo, MSN etc. crawling the web for their search indexes - they were there before as anonymous users, but phpbb3 recognises them now.

I don't know how to rename each page to a .html - besides, doing that can trick google in to using more of your bandwidth than it ought to.
Scirra Founder
B
359
S
214
G
72
Posts: 22,952
Reputation: 178,580

Post » Wed Apr 23, 2008 2:24 pm

http://downloads.phpbb-seo.com/phpbb3-s ... te-38.html

Worth doing imo if you want some more referals from search engines.
Image Image
Scirra Founder
B
125
S
37
G
25
Posts: 3,945
Reputation: 44,922

Post » Wed Apr 23, 2008 11:51 pm

[quote="Gullanian":3i52bgwx]http://downloads.phpbb-seo.com/phpbb3-seo-url-10/advanced-phpbb3-seo-mod-rewrite-38.html

Worth doing imo if you want some more referals from search engines.[/quote:3i52bgwx]
I think all you have to do is put an unlinked HTML file in the root directory of the host with keywords in it... that should do the trick ;)
Tired of crappy file hosts that are crappy? Get DROPBOX - https://db.tt/uwjysXJF
Moderator
B
45
S
17
G
37
Posts: 2,853
Reputation: 25,966

Next

Return to Open Topic

Who is online

Users browsing this forum: No registered users and 2 guests