From: | "Jim C(dot) Nasby" <jnasby(at)pervasive(dot)com> |
---|---|
To: | "Joshua D(dot) Drake" <jd(at)commandprompt(dot)com> |
Cc: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Mark Woodward <pgsql(at)mohawksoft(dot)com>, Zdenek Kotala <zdenek(dot)kotala(at)sun(dot)com>, Koichi Suzuki <suzuki(dot)koichi(at)oss(dot)ntt(dot)co(dot)jp>, pgsql-hackers(at)postgresql(dot)org |
Subject: | Re: How to avoid transaction ID wrap |
Date: | 2006-06-08 16:30:15 |
Message-ID: | 20060608163015.GR45331@pervasive.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
On Thu, Jun 08, 2006 at 09:13:33AM -0700, Joshua D. Drake wrote:
> Tom Lane wrote:
> >"Joshua D. Drake" <jd(at)commandprompt(dot)com> writes:
> >>I was recently involved in a project where we had to decrease the
> >>checkpoint_timeout . The problem was, that the database was performing
> >>so many transactions that if we waiting for 5 minutes, checkpoint would
> >>take entirely too long.
> >
> >Seems like the correct fix for that is to make the bgwriter more
> >aggressive. Narrowing the checkpoint spacing is a pretty horrid answer
> >because of the resulting increase in full-page-image WAL traffic.
>
> Well we did that as well. Here are the basic symptons:
>
> During normal processing which contained about 250 connections
> everything was fine. A checkpoint would start and connections would
> start piling up, sometimes breaking 1000.
>
> We narrowed that down to users having to wait longer for query execution
> so instead of just reusing connections new connections had to be
> initiated because the existing connections were busy.
>
> We tried many different parameters, and bgwriter did significantly help
> but the only "solution" was to make checkpoints happen at a much more
> aggressive time frame.
>
> Modify bgwriters settings and the checkpoint actually increased our
> velocity by about 70% by the time we were done. Bgwriter was definitely
> the largest chunk of that although other parameters combined outweighed
> it (effective_cache, shared_buffers etc...).
Did you try increasing the checkpoint interval, in the hopes that it
would allow the bgwritter enough extra time to get everything pushed
out?
--
Jim C. Nasby, Sr. Engineering Consultant jnasby(at)pervasive(dot)com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
From | Date | Subject | |
---|---|---|---|
Next Message | Alvaro Herrera | 2006-06-08 16:30:27 | Re: ADD/DROP INHERITS |
Previous Message | Jim C. Nasby | 2006-06-08 16:27:55 | Re: ADD/DROP INHERITS |