Re: META Tags on Archives

From: "Marc G(dot) Fournier" <scrappy(at)postgresql(dot)org>
To: Jeroen Ruigrok/asmodai <asmodai(at)wxs(dot)nl>
Cc: "Marc G(dot) Fournier" <scrappy(at)postgresql(dot)org>, Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>, pgsql-www(at)postgresql(dot)org
Subject: Re: META Tags on Archives
Date: 2004-02-02 14:52:57
Message-ID: 20040202104913.G4513@ganymede.hub.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-www

On Mon, 2 Feb 2004, Jeroen Ruigrok/asmodai wrote:

> -On [20040201 23:43], Marc G. Fournier (scrappy(at)postgresql(dot)org) wrote:
> > <META NAME="robots" CONTENT="nofollow, index, archive">
>
> According to http://www.robotstxt.org/wc/meta-user.html
> archive|noarchive does not exist.
>
> Where'd you find it?

Actually, that one was in the original .resource file, but a quick search
on google shows:

http://www.bauser.com/websnob/meta/robots.html

and

http://www.google.com/webmasters/faq.html#cached

the funny thing is that this one:

http://www.katpatuka.org/pub/doc/robotexclusion.html

refers to the NOARCHIVE, but puts to:

http://www.w3.org/Search/9605-Indexing-Workshop/ReportOutcomes/Spidering.txt

which doesn't include it ...

I love standards that everyone follows *roll eyes*

I'm gathering its somethign that some use (Google does, apparently), and
some don't ...

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664

In response to

Browse pgsql-www by date

  From Date Subject
Next Message Marc G. Fournier 2004-02-02 14:56:07 Re: Postgresql.org search engine.
Previous Message Dave Page 2004-02-02 14:50:43 Re: Archives cleaned up ... but not regenerated yet ...