Re: poor performance with Context Switch Storm at TPC-W.

From: Katsuhiko Okano <okano(dot)katsuhiko(at)oss(dot)ntt(dot)co(dot)jp>
To: pgsql-hackers(at)postgresql(dot)org
Subject: Re: poor performance with Context Switch Storm at TPC-W.
Date: 2006-07-14 05:58:36
Message-ID: 200607141457.CFC04165.PBLJLPVTILUBOPu@oss.ntt.co.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-patches

Hi.

Alvaro Herrera wrote:

> Katsuhiko Okano wrote:
>
> > I suspected conflict of BufMappingLock.
> > but, collected results are seen,
> > occurrence of CSStorm and the increase of BufMappingLock counts
> > seem not to correspond.
> > Instead, SubtransControlLock and SubTrans were increasing.
> > I do not understand what in the cause of CSStorm.
>
> Please see this thread:
> http://archives.postgresql.org/pgsql-hackers/2005-11/msg01547.php
> (actually it's a single message AFAICT)
>
> This was applied on the 8.2dev code, so I'm surprised that 8.2dev
> behaves the same as 8.1.
>
> Does your problem have any relationship to what's described there?
>
Probably it is related.
There is no telling are a thing with the bad method of a lock and
whether it is bad that the number of LRU buffers is simply small.

> I also wondered whether the problem may be that the number of SLRU
> buffers we use for subtrans is too low. But the number was increased
> from the default 8 to 32 in 8.2dev as well. Maybe you could try
> increasing that even further; say 128 and see if the problem is still
> there. (src/include/access/subtrans.h, NUM_SUBTRANS_BUFFERS).
By PostgreSQL8.2, NUM_SUBTRANS_BUFFERS was changed into 128
and recompile and measured again.
NOT occurrence of CSStorm. The value of WIPS was about 400.
(but the value of WIPS fell about to 320 at intervals of 4 to 6 minutes.)

If the number of SLRU buffers is too low,
also in PostgreSQL8.1.4, if the number of buffers is increased
I think that the same result is brought.
(Although the buffer of CLOG or a multi-transaction also increases,
I think that effect is small)

Now, NUM_SLRU_BUFFERS is changed into 128 in PostgreSQL8.1.4
and is under measurement.

regards,
--------
Katsuhiko Okano
okano katsuhiko _at_ oss ntt co jp

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Charles Duffy 2006-07-14 06:29:14 Re: putting CHECK_FOR_INTERRUPTS in qsort_comparetup()
Previous Message Tom Lane 2006-07-14 05:53:17 Re: include compile problems

Browse pgsql-patches by date

  From Date Subject
Next Message Charles Duffy 2006-07-14 06:29:14 Re: putting CHECK_FOR_INTERRUPTS in qsort_comparetup()
Previous Message Tom Lane 2006-07-14 05:53:17 Re: include compile problems