From: | "Marc G(dot) Fournier" <scrappy(at)postgresql(dot)org> |
---|---|
To: | Jeroen Ruigrok/asmodai <asmodai(at)wxs(dot)nl> |
Cc: | "Marc G(dot) Fournier" <scrappy(at)postgresql(dot)org>, Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>, pgsql-www(at)postgresql(dot)org |
Subject: | Re: META Tags on Archives |
Date: | 2004-02-02 14:52:57 |
Message-ID: | 20040202104913.G4513@ganymede.hub.org |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-www |
On Mon, 2 Feb 2004, Jeroen Ruigrok/asmodai wrote:
> -On [20040201 23:43], Marc G. Fournier (scrappy(at)postgresql(dot)org) wrote:
> > <META NAME="robots" CONTENT="nofollow, index, archive">
>
> According to http://www.robotstxt.org/wc/meta-user.html
> archive|noarchive does not exist.
>
> Where'd you find it?
Actually, that one was in the original .resource file, but a quick search
on google shows:
http://www.bauser.com/websnob/meta/robots.html
and
http://www.google.com/webmasters/faq.html#cached
the funny thing is that this one:
http://www.katpatuka.org/pub/doc/robotexclusion.html
refers to the NOARCHIVE, but puts to:
http://www.w3.org/Search/9605-Indexing-Workshop/ReportOutcomes/Spidering.txt
which doesn't include it ...
I love standards that everyone follows *roll eyes*
I'm gathering its somethign that some use (Google does, apparently), and
some don't ...
----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664
From | Date | Subject | |
---|---|---|---|
Next Message | Marc G. Fournier | 2004-02-02 14:56:07 | Re: Postgresql.org search engine. |
Previous Message | Dave Page | 2004-02-02 14:50:43 | Re: Archives cleaned up ... but not regenerated yet ... |