RE: Archiving Data to Another DB?

From: "Kumar, Virendra" <Virendra(dot)Kumar(at)guycarp(dot)com>
To: Don Seiler <don(at)seiler(dot)us>, Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
Cc: "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: RE: Archiving Data to Another DB?
Date: 2018-04-11 18:59:16
Message-ID: 2e5cff1cdbbf4a98b4cbc3fac5dbdbff@USDFW11XG20CN01.mercer.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Does this apply to SELECT calls as well or only for DMLs.
I am planning to use postgres_fdw but if it is going by one row at a time there will be a lot of round trip and defeat the purpose.

Regards,
Virendra.

From: Don Seiler [mailto:don(at)seiler(dot)us]
Sent: Wednesday, April 11, 2018 2:53 PM
To: Adrian Klaver
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Archiving Data to Another DB?

On Wed, Apr 11, 2018 at 1:38 PM, Don Seiler <don(at)seiler(dot)us<mailto:don(at)seiler(dot)us>> wrote:

Yeah, I saw the same with a 132 row insert. Now imagine that with a monthly 50 million row insert or delete. :p Thanks for the confirmation!

I went back to look at the postgres logs on my dev server. These logs are rotated once they hit 2G in size. One typical log from the middle of my test last night hit that in 13 minutes and had over 5.2 million DELETE calls. There a quite a few logs like this. That would not be fun for the disk space on the log volume, either.

Don.
--
Don Seiler
www.seiler.us<http://www.seiler.us>

________________________________

This message is intended only for the use of the addressee and may contain
information that is PRIVILEGED AND CONFIDENTIAL.

If you are not the intended recipient, you are hereby notified that any
dissemination of this communication is strictly prohibited. If you have
received this communication in error, please erase all copies of the message
and its attachments and notify the sender immediately. Thank you.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2018-04-11 20:06:54 Re: Archiving Data to Another DB?
Previous Message Don Seiler 2018-04-11 18:52:58 Re: Archiving Data to Another DB?