Become a google bot

Go down

Become a google bot Empty Become a google bot

Post  Shadow on Wed Sep 02, 2009 12:27 am

What you'll need:
The Modify Headers extension for firefox.

What you can do:
Many sites allow google to look into their forums, in order to get more traffic by getting more google search results. By pretending to be the google search indexer (aka spider, bot) we can access parts of these sites off limits to guests.

Example URL:
I found this address today doing a google search, and noticed that although I didn't have access, google had a cached version. Head over to this url, and you should get the same error as me.

First, head over to google and type in 'browser headers'. The first link should take you to a page which gives you all the information your browser sends to web servers. This information, specifically the User-Agent field, is how the google bot tells web servers what it is. Go back to the google search, and click on the 'cached' link.

Notice in the 'User-Agent' field, where it once showed your browser info, now it says:
Mozilla/5.0 (compatible; Googlebot/2.1; +

Download the Modify Headers extension.

And open it up. Next you need to make a rule, modifying the 'User-Agent' header to say 'Mozilla/5.0 (compatible; Googlebot/2.1; +'
Once you're done, make sure it's enabled, and browse over to the example url. Even though you're not logged in, you should be able to browse their forums.


Posts : 54
Join date : 2009-08-28
Age : 27
Location : Arizona

Back to top Go down

Become a google bot Empty Re: Become a google bot

Post  Ali_THE KILLER on Wed Sep 02, 2009 12:57 am

wow,nice but u know i dont get it right?
but ill try

Posts : 120
Join date : 2009-08-28
Age : 24
Location : home

Back to top Go down

Back to top

- Similar topics

Permissions in this forum:
You cannot reply to topics in this forum