Test sul tempo di crawl di una risorsa linkata da Twitter

Tempi di accesso dei crawler

Log completo degli accessi dei crawler

Data e ora Indirizzo IP User-agent
25/10/2009 17:52:07 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
25/10/2009 19:56:06 79.20.51.49 msnbot/1.0 (+http://search.msn.com/msnbot.htm)
25/10/2009 19:56:17 79.20.51.49 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
25/10/2009 19:56:24 79.20.51.49 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
25/10/2009 19:56:30 79.20.51.49 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
26/10/2009 13:14:01 10.150.15.16 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
26/10/2009 19:40:20 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
26/10/2009 20:11:41 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
26/10/2009 23:03:58 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
30/10/2009 14:06:55 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
31/10/2009 14:33:29 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
01/11/2009 16:04:45 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
03/11/2009 22:59:18 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
06/11/2009 11:14:29 66.249.65.55 SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
06/11/2009 13:43:30 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
07/11/2009 14:09:34 67.195.112.231 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
09/11/2009 10:46:58 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
11/11/2009 22:36:40 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
12/11/2009 19:21:54 66.249.71.251 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
14/11/2009 23:42:43 66.249.65.55 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
16/11/2009 15:18:20 67.195.115.28 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
17/11/2009 19:52:57 66.249.71.251 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
18/11/2009 09:34:26 66.249.71.169 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
21/11/2009 11:13:30 66.249.71.169 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
22/11/2009 19:19:42 66.249.65.73 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
25/11/2009 16:47:51 66.249.65.87 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
25/11/2009 21:07:40 67.195.115.28 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
29/11/2009 03:31:35 66.249.65.230 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
03/12/2009 03:02:15 66.249.71.181 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
04/12/2009 14:08:01 66.249.71.181 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
09/12/2009 20:29:18 66.249.65.230 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
09/12/2009 21:55:32 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
10/12/2009 23:31:09 66.249.65.225 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
17/12/2009 08:07:26 66.249.65.58 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
24/12/2009 06:53:15 66.249.65.23 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
27/12/2009 10:08:44 66.249.65.41 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
30/12/2009 08:43:21 66.249.65.47 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
05/01/2010 22:19:49 66.249.65.23 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
06/01/2010 21:43:06 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
07/01/2010 21:46:11 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
08/01/2010 10:03:37 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
09/01/2010 00:55:57 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
10/01/2010 23:32:04 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
11/01/2010 22:47:53 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
12/01/2010 21:53:28 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
13/01/2010 22:57:32 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
15/01/2010 13:16:43 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
15/01/2010 22:39:22 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
16/01/2010 22:11:14 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
18/01/2010 07:29:52 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
18/01/2010 22:08:36 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
24/01/2010 03:49:50 66.249.65.44 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
29/01/2010 10:44:24 66.249.65.48 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
31/01/2010 00:44:00 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
05/02/2010 16:13:34 66.249.65.35 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
07/02/2010 00:46:36 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
12/02/2010 04:40:59 66.249.65.5 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
13/02/2010 04:21:47 65.55.106.180 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
14/02/2010 03:48:52 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
19/02/2010 21:31:03 66.249.65.5 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
21/02/2010 12:31:56 67.195.112.121 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
25/02/2010 22:43:04 66.249.65.77 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
28/02/2010 13:38:04 67.195.115.93 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
01/03/2010 13:21:12 207.46.195.235 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
02/03/2010 20:14:26 66.249.65.108 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
04/03/2010 00:00:27 66.249.65.108 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
04/03/2010 16:02:10 66.249.65.121 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
06/03/2010 20:36:17 66.249.65.59 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
07/03/2010 13:40:09 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
07/03/2010 20:48:11 66.249.65.59 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
08/03/2010 20:43:54 66.249.65.59 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
09/03/2010 21:15:44 66.249.65.180 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
10/03/2010 20:50:59 66.249.65.180 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
11/03/2010 21:13:34 66.249.65.177 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
13/03/2010 17:23:35 66.249.65.181 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
15/03/2010 00:34:06 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
18/03/2010 08:42:08 207.46.195.239 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
19/03/2010 22:31:46 66.249.65.135 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
22/03/2010 09:57:43 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
26/03/2010 22:05:29 66.249.65.171 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
01/04/2010 19:08:01 66.249.65.164 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
03/04/2010 13:46:27 207.46.204.236 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
04/04/2010 19:51:56 207.46.204.240 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
06/04/2010 19:01:56 66.249.65.164 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
12/04/2010 10:44:43 66.249.71.227 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
17/04/2010 06:28:20 66.249.71.236 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
19/04/2010 16:48:45 207.46.204.239 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
22/04/2010 05:00:17 66.249.65.134 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
26/04/2010 20:51:32 66.249.65.164 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
02/05/2010 15:10:57 66.249.65.248 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
06/05/2010 09:03:23 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
07/05/2010 08:40:39 66.249.65.208 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
11/05/2010 23:50:08 66.249.65.245 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
13/05/2010 09:05:20 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
20/05/2010 09:10:44 67.195.115.31 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
21/05/2010 16:30:18 207.46.13.50 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
29/05/2010 21:14:15 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
31/05/2010 09:19:09 66.249.65.237 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
04/06/2010 05:14:06 207.46.199.44 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
05/06/2010 21:16:45 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
12/06/2010 21:21:12 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
19/06/2010 09:31:35 66.249.71.242 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
23/06/2010 16:28:38 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
08/07/2010 20:23:27 66.249.66.12 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
10/07/2010 04:35:46 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
20/07/2010 18:36:59 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
22/07/2010 05:14:21 207.46.13.140 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
29/07/2010 01:14:35 66.249.66.227 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
02/08/2010 01:46:39 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
07/08/2010 11:04:02 66.249.66.35 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
14/08/2010 16:01:16 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
23/08/2010 22:20:09 207.46.204.192 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
26/08/2010 03:41:13 66.235.124.59 Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
27/08/2010 19:31:06 66.249.66.35 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
28/08/2010 16:30:12 67.195.113.219 Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)