From: | "k(dot)jamison(at)fujitsu(dot)com" <k(dot)jamison(at)fujitsu(dot)com> |
---|---|
To: | "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org> |
Cc: | Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, 'Robert Haas' <robertmhaas(at)gmail(dot)com> |
Subject: | RE: [Patch] Optimize dropping of relation buffers using dlist |
Date: | 2020-03-25 06:24:32 |
Message-ID: | OSBPR01MB3207ABBDDE90F4A5C1DCCB88EFCE0@OSBPR01MB3207.jpnprd01.prod.outlook.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Hi,
I know this might already be late at end of CommitFest, but attached
is the latest version of the patch. The previous version only includes buffer
invalidation improvement for VACUUM. The new patch adds the same
routine for TRUNCATE WAL replay.
In summary, this patch aims to improve the buffer invalidation process
of VACUUM and TRUNCATE. Although it may not be a common use
case, our customer uses these commands a lot. Recovery and WAL
replay of these commands can take time depending on the size of
database buffers. So this patch optimizes that using the newly-added
auxiliary cache and doubly-linked list on the shared memory, so that
we don't need to scan the shared buffers anymore.
As for the performance and how it affects the read-only workloads.
Using pgbench, I've kept the overload to a minimum, less than 1%.
I'll post follow-up results.
Although the additional hash table utilizes shared memory, there's
a significant performance gain for both TRUNCATE and VACUUM
from execution to recovery.
Regards,
Kirk Jamison
Attachment | Content-Type | Size |
---|---|---|
v7-Optimize-dropping-of-relation-buffers-using-dlist.patch | application/octet-stream | 28.1 KB |
From | Date | Subject | |
---|---|---|---|
Next Message | Amit Kapila | 2020-03-25 06:53:23 | Re: backup manifests |
Previous Message | Dilip Kumar | 2020-03-25 06:01:56 | Re: Index Skip Scan |