Re: Advice on logging strategy

From: Mike Martin <redtux1(at)gmail(dot)com>
To: robjsargent(at)gmail(dot)com
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Advice on logging strategy
Date: 2018-10-11 11:06:56
Message-ID: CAOwYNKZbPtM1NQJRTdORM=CGbhTNMExQnibYO2vtoeeNs92dyQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I suppose the ideal would be to log the prepared statement once and detail
only if error rather than one per execution

On Thu, 11 Oct 2018 at 11:33, Rob Sargent <robjsargent(at)gmail(dot)com> wrote:

>
>
> > On Oct 11, 2018, at 4:26 AM, Mike Martin <redtux1(at)gmail(dot)com> wrote:
> >
> > I have a question on logging strategy
> >
> > I have loggin set to
> > log_statement = 'all' on a network database with logging set to csv so I
> can import it to a logging table
> >
> > However the database is populated via a nightly routine downloading data
> via REST APIusing prepared statements
> >
> > This results in enormous log files which take ages to import using copy
> becuase each execute statement is logged with the parameters chosen
> >
> > Is there any way around this?
> >
> > I cant find any way to filter dml statements
> >
> > thanks
> >
> Do you want all the log lines in you logging table?
> There was a thread yesterday (10.Oct.2018) on COPY which mention the
> possibility of multiple processes COPYing to same table.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Bryce Pepper 2018-10-11 13:33:03 RE: RHEL 7 (systemd) reboot
Previous Message Rob Sargent 2018-10-11 10:33:41 Re: Advice on logging strategy