| From: | Peter Eisentraut <peter(dot)eisentraut(at)2ndquadrant(dot)com> |
|---|---|
| To: | Magnus Hagander <magnus(at)hagander(dot)net>, Stephen Frost <sfrost(at)snowman(dot)net> |
| Cc: | Stefan Kaltenbrunner <stefan(at)kaltenbrunner(dot)cc>, Dave Page <dpage(at)pgadmin(dot)org>, "Jonathan S(dot) Katz" <jkatz(at)postgresql(dot)org>, PostgreSQL WWW <pgsql-www(at)postgresql(dot)org> |
| Subject: | Re: Authentication prompt for mbox downloads |
| Date: | 2020-04-02 20:42:28 |
| Message-ID: | 27801a77-d710-67ac-fa3a-928ed801f080@2ndquadrant.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-www |
On 2020-03-30 17:27, Magnus Hagander wrote:
> And regardless of where we provide them we still have the same
> problem. The*reason* we have that password there is to prevent
> automated scrapers from grabbing all that data. And that*does* work,
> if we look at the logs of downloads of them. Yes, custom made scrapers
> that want to grab that down (which is what it's designed for)
> sometimes do, but we get*very* few downloads from automated scrapers
> and crawlers.
Yeah, this thread is turning a literally one-line patch to refine an
otherwise perfectly working system into a major reengineering project.
--
Peter Eisentraut http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Martín Marqués | 2020-04-02 22:11:16 | Returning a memory issue when accessing an attachment from the mailing list |
| Previous Message | Dave Page | 2020-03-31 16:51:05 | Re: Domain registration for pgfoundry.org has expired |