<?xml version="1.0" encoding="UTF-8"?> <rss
version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
> <channel><title>gHacks Technology News &#124; Latest Tech News, Software And Tutorials &#187; paysites</title> <atom:link href="http://www.ghacks.net/tag/paysites/feed/" rel="self" type="application/rss+xml" /><link>http://www.ghacks.net</link> <description>A technology news blog covering software, mobile phones, gadgets, security, the Internet and other relevant areas.</description> <lastBuildDate>Sat, 11 Feb 2012 09:52:46 +0000</lastBuildDate> <language>en</language> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <generator>http://wordpress.org/?v=3.3.1</generator> <atom:link rel="hub" href="http://pubsubhubbub.appspot.com"/><atom:link rel="hub" href="http://superfeedr.com/hubbub"/> <item><title>Google Bot has privileges</title><link>http://www.ghacks.net/2007/08/15/google-bot-has-privileges/</link> <comments>http://www.ghacks.net/2007/08/15/google-bot-has-privileges/#comments</comments> <pubDate>Wed, 15 Aug 2007 06:36:03 +0000</pubDate> <dc:creator>Martin Brinkmann</dc:creator> <category><![CDATA[Browsing]]></category> <category><![CDATA[The Web]]></category> <category><![CDATA[access]]></category> <category><![CDATA[disguise]]></category> <category><![CDATA[Google]]></category> <category><![CDATA[googlebot]]></category> <category><![CDATA[paysites]]></category> <guid
isPermaLink="false">http://www.ghacks.net/2007/08/15/google-bot-has-privileges/</guid> <description><![CDATA[Last year I was describing a way to get into the website Experts-Exchange.com by disguising yourself as the Googlebot. Apparently a similar story makes its way around the Internet these days with a more detailed approach detailing the steps that you have to partake to be identified as Googlebot.]]></description> <content:encoded><![CDATA[<p>Last year I was <a
href="http://www.ghacks.net/2006/07/11/free-answers-from-experts-exchangecom/">describing</a> a way to get into the website Experts-Exchange.com by disguising yourself as the Googlebot. Apparently a similar story makes its way around the Internet these days with a more detailed approach detailing the steps that you have to partake to be identified as Googlebot.</p><p>It is not enough to simply change the User-Agent string to Googlebot if the website in question checks for cookies, uses Javascript for detection or compares the IP to make sure it is indeed in Google&#8217;s IP range. Using just the User-Agent might work to gain access into some websites but others probably will not work because they perform additional checks.</p><p>Here are the five factors that are important:</p><p><span
id="more-1875"></span><ul><li>IP: Use <a
href="http://www.google.com/language_tools?hl=en">Google Translate</a> to surf the site</li><li>User-Agent: Use the Firefox Extension <a
href="https://addons.mozilla.org/en-US/firefox/addon/59/">User-Agent Switcher</a> and add the information about <a
href="http://www.useragentstring.com/Googlebot2.1_id_1697.php">Googlebot</a>.</li><li>Javascript: Use a Firefox Extension like <a
href="https://addons.mozilla.org/en-US/firefox/addon/722">No Script</a> to turn it off.</li><li>Cookies: Use the Firefox Extension <a
href="https://addons.mozilla.org/en-US/firefox/addon/cookiesafe-ff-4-compatible/">Cookie Safe</a> to block cookies that the site tries to set.</li><li>Referrer: Use the Firefox Extension <a
href="https://addons.mozilla.org/en-US/firefox/addon/953/">RefControl</a> to disable the Referrer.</li></ul><p>The <a
href="http://www.thegooglecache.com/uncategorized/googles-real-back-door/?surf-as-google">website</a> describing the techniques is currently down because it was not able to handle the massive amount of visitors that Digg and other sites sent to it.</p> ]]></content:encoded> <wfw:commentRss>http://www.ghacks.net/2007/08/15/google-bot-has-privileges/feed/</wfw:commentRss> <slash:comments>9</slash:comments> </item> </channel> </rss>
