Answers ( 2 )

  1. 2016-05-25 13:05

    Yes, it is possible to detect Google Bot via HTTP_USER_AGENT, but You will probably will get Google Ban and PR set to 0.

  2. 2016-05-25 17:05

    Yes, you can set a page which ONLY the google bot sees, please read:

    https://developers.google.com/webmasters/ajax-crawling/docs/learn-more#what-the-user-sees-what-the-crawler-sees

    In order to make your AJAX application crawlable, your site needs to abide by a new agreement. This agreement rests on the following:

    1. The site adopts the AJAX crawling scheme.

    2. For each URL that has dynamically produced content, your server provides an HTML snapshot, which is the content a user (with a browser) sees. Often, such URLs will be AJAX URLs, that is, URLs containing a hash fragment, for example www.example.com/index.html#key=value, where #key=value is the hash fragment. An HTML snapshot is all the content that appears on the page after the JavaScript has been executed.

    3. The search engine indexes the HTML snapshot and serves your original AJAX URLs in search results.


    This technique isn't so easy to set up, but it is possible.

◀ Go back