Take the 2-minute tour ×
Web Applications Stack Exchange is a question and answer site for power users of web applications. It's 100% free, no registration required.

I am interesting in Google AdSense bot's algorithm and behavior with web site. I did not work with AdSense and i do not have account. So i need your help to understand:

1) Gbot from time to time downloads all pages from web site. Am i right?

2) Gbot do not understand dynamic content (loaded by ajax). So i must generate static content and return it within html page and this pages must show identical content for all users and for Gbot?

3) Because of (1) and (2) i cannot use only root path http://example.com with some "main" widget. I must generate unique pages for example http://example.com/thread?id=101 ?

4) Gbot downloads pages (1) for grabbing (indexing) keywords from them and then store (on it's servers) these information for example by key/value (where key is page path, value is tag cloud). Am i right?

5) When web site has been opened in browser by user. Integrated html AdSense's code loads some JavaScript. As i understand by "googling" this JavaScript do not index page, but makes call (with some parameter key==page_path) to Google's server and gets appropriate ad links. Then shows this ad links in it's frame. Is it right behavior? Maybe JavaScript makes some local indexing of page's content?

6) How Gbot and AdSense's JavaScript work with cookies? As i understand AdSense can use cookies for show appropriate ad links. If it is right, please give me some use cases;)

I know that "true" algorithm is known only by engineers from Google. But some of you had experience with AdSense and AdSense html/javascript. Please correct my vision of it;)

Thank you very much for any advice!!!

P.S. This question is very important for me. It is not some question for fun! So Please do not close it;)

share|improve this question
1  
Please, post each question in a separate thread. –  Simone Carletti Nov 24 '10 at 8:35
    
This sounds like it would be more appropriate for Webmasters –  Al E. Nov 24 '10 at 12:53
add comment

1 Answer 1

up vote 1 down vote accepted

1) Gbot from time to time downloads all pages from web site. Am i right?

The bot attempts to download a page as soon as it is requested for the first time. Then, it will try to keep the content of the page up-to-date by accessing it periodically.

Google uses a shared cache. Because Google has several bot (AdSense, Google Crawler, ...), the most update cache will be used by AdSense. This feature minimizes the impact of Google bot on your site.

2) Gbot do not understand dynamic content (loaded by ajax). So i must generate static content and return it within html page and this pages must show identical content for all users and for Gbot?

I don't know whether it's a good idea. However, I can confirm AdSense bot can't show ads based on content loaded from AJAX.

3) Because of (1) and (2) i cannot use only root path http://example.com with some "main" widget. I must generate unique pages for example http://example.com/thread?id=101 ?

It can be helpful. Avoid using parameters like id or sessionid. Rewrite the URL, if you can. eg. http://example.com/thread/101

4) Gbot downloads pages (1) for grabbing (indexing) keywords from them and then store (on it's servers) these information for example by key/value (where key is page path, value is tag cloud). Am i right?

Who knows? I mean, you have to be a Google engineer to know how Google stores its data. Why does information is it important for you? BTW, this is not really that simple. One example is the "shared cache" feature I described before.

5) When web site has been opened in browser by user. Integrated html AdSense's code loads some JavaScript. As i understand by "googling" this JavaScript do not index page, but makes call (with some parameter key==page_path) to Google's server and gets appropriate ad links. Then shows this ad links in it's frame. Is it right behavior? Maybe JavaScript makes some local indexing of page's content?

The JavaScript simply displays the ads. It also notifies Google about the existence of the page, if it still doesn't know about it. In this case, an AdSense bot will crawl the content in about 2 seconds.

6) How Gbot and AdSense's JavaScript work with cookies? As i understand AdSense can use cookies for show appropriate ad links. If it is right, please give me some use cases;)

It's better to have cookies enabled.

share|improve this answer
    
thank you for your answer!;) –  Edward83 Nov 24 '10 at 12:09
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.