Author: Noah Misch Commit: Noah Misch Unlink less in SimpleLruTruncate(), as insurance against bugs. SimpleLruTruncate() has been unlinking every expendable file. In edge cases, it also deleted important files. The most recent commit fixed that. Given the history of this class of bugs evading detection, let's not trust that patch exclusively. Instead of unlinking segments representing up to 2^31 past XIDs, delete no more than half that much. The balance will stay in place; eventually, XID consumption will overwrite it. This could mitigate unknown SimpleLruTruncate() bugs and simplify manual remediation after one has overtaken wrap limits in single-user mode. Truncation behavior won't change at all until an SLRU is half full. Once it does change, a drawback is conflict with the following defense. TruncateMultiXact() skips truncation when unexpected files exist on disk, which this change deliberately makes more common. Hence, pg_multixact becomes more likely to persist in consuming its maximum storage. Also, this change may uncover bugs in SLRU page recycling by making that more common. For SLRUs outside of pg_multixact, maximum storage rises by 50%; for example, the CLOG maximum rises from 512 MiB to 768 MiB. Usage in pg_multixact may double. Back-patch to 9.5 (all supported versions). Reviewed by FIXME. Discussion: https://postgr.es/m/20200330052809.GB2324620@rfd.leadboat.com diff --git a/doc/src/sgml/maintenance.sgml b/doc/src/sgml/maintenance.sgml index 4d8ad75..c2a6961 100644 --- a/doc/src/sgml/maintenance.sgml +++ b/doc/src/sgml/maintenance.sgml @@ -405,6 +405,11 @@ in every database at least once every two billion transactions. + The reason that periodic vacuuming solves the problem is that VACUUM will mark rows as frozen, indicating that diff --git a/src/backend/access/transam/clog.c b/src/backend/access/transam/clog.c index 55bdac4..38aef74 100644 --- a/src/backend/access/transam/clog.c +++ b/src/backend/access/transam/clog.c @@ -53,7 +53,7 @@ * and CLOG segment numbering at * 0xFFFFFFFF/CLOG_XACTS_PER_PAGE/SLRU_PAGES_PER_SEGMENT. We need take no * explicit notice of that fact in this module, except when comparing segment - * and page numbers in TruncateCLOG (see CLOGPagePrecedes). + * and page numbers in TruncateCLOG (see CLOGPageDiff). */ /* We need two bits per xact, so four xacts fit in a byte */ @@ -90,7 +90,7 @@ static SlruCtlData XactCtlData; static int ZeroCLOGPage(int pageno, bool writeXlog); -static bool CLOGPagePrecedes(int page1, int page2); +static int32 CLOGPageDiff(int page1, int page2); static void WriteZeroPageXlogRec(int pageno); static void WriteTruncateXlogRec(int pageno, TransactionId oldestXact, Oid oldestXactDb); @@ -690,11 +690,11 @@ CLOGShmemSize(void) void CLOGShmemInit(void) { - XactCtl->PagePrecedes = CLOGPagePrecedes; + XactCtl->PageDiff = CLOGPageDiff; SimpleLruInit(XactCtl, "Xact", CLOGShmemBuffers(), CLOG_LSNS_PER_PAGE, XactSLRULock, "pg_xact", LWTRANCHE_XACT_BUFFER, SYNC_HANDLER_CLOG); - SlruPagePrecedesUnitTests(XactCtl, CLOG_XACTS_PER_PAGE); + SlruPageDiffUnitTests(XactCtl, CLOG_XACTS_PER_PAGE); } /* @@ -887,7 +887,7 @@ TruncateCLOG(TransactionId oldestXact, Oid oldestxid_datoid) cutoffPage = TransactionIdToPage(oldestXact); /* Check to see if there's any files that could be removed */ - if (!SlruScanDirectory(XactCtl, SlruScanDirCbReportPresence, &cutoffPage)) + if (!SlruScanDirectory(XactCtl, SlruScanDirCbWouldTruncate, &cutoffPage)) return; /* nothing to remove */ /* @@ -913,13 +913,14 @@ TruncateCLOG(TransactionId oldestXact, Oid oldestxid_datoid) /* - * Decide whether a CLOG page number is "older" for truncation purposes. + * Diff CLOG page numbers for truncation purposes. * - * We need to use comparison of TransactionIds here in order to do the right - * thing with wraparound XID arithmetic. However, TransactionIdPrecedes() - * would get weird about permanent xact IDs. So, offset both such that xid1, - * xid2, and xid + CLOG_XACTS_PER_PAGE - 1 are all normal XIDs; this offset is - * relevant to page 0 and to the page preceding page 0. + * To do the right thing with wraparound XID arithmetic, this mirrors + * TransactionIdPrecedes(). The Max() operation ensures we return a positive + * value when the wrap point may fall inside these pages. (When it does, some + * pairs of entries have a positive diff, and other pairs have a negative + * diff.) Only the predicate.c SLRU needs the Max() operation; to avoid + * having even more corner cases to understand, all XID-indexed SLRUs do it. * * The page containing oldestXact-2^31 is the important edge case. The * portion of that page equaling or following oldestXact-2^31 is expendable, @@ -927,22 +928,22 @@ TruncateCLOG(TransactionId oldestXact, Oid oldestxid_datoid) * the first XID of a page and segment, the entire page and segment is * expendable, and we could truncate the segment. Recognizing that case would * require making oldestXact, not just the page containing oldestXact, - * available to this callback. The benefit would be rare and small, so we - * don't optimize that edge case. + * available to this callback. slru.c wouldn't delete the page, anyway. */ -static bool -CLOGPagePrecedes(int page1, int page2) +static int32 +CLOGPageDiff(int page1, int page2) { TransactionId xid1; TransactionId xid2; + int32 diff_head; + int32 diff_tail; xid1 = ((TransactionId) page1) * CLOG_XACTS_PER_PAGE; - xid1 += FirstNormalTransactionId + 1; xid2 = ((TransactionId) page2) * CLOG_XACTS_PER_PAGE; - xid2 += FirstNormalTransactionId + 1; - return (TransactionIdPrecedes(xid1, xid2) && - TransactionIdPrecedes(xid1, xid2 + CLOG_XACTS_PER_PAGE - 1)); + diff_head = xid1 - xid2; + diff_tail = xid1 - (xid2 + CLOG_XACTS_PER_PAGE - 1); + return Max(diff_head, diff_tail); } diff --git a/src/backend/access/transam/commit_ts.c b/src/backend/access/transam/commit_ts.c index 8ffd48e..65afc8c 100644 --- a/src/backend/access/transam/commit_ts.c +++ b/src/backend/access/transam/commit_ts.c @@ -46,7 +46,7 @@ * 0xFFFFFFFF/COMMIT_TS_XACTS_PER_PAGE, and CommitTs segment numbering at * 0xFFFFFFFF/COMMIT_TS_XACTS_PER_PAGE/SLRU_PAGES_PER_SEGMENT. We need take no * explicit notice of that fact in this module, except when comparing segment - * and page numbers in TruncateCommitTs (see CommitTsPagePrecedes). + * and page numbers in TruncateCommitTs (see CommitTsPageDiff). */ /* @@ -109,7 +109,7 @@ static void TransactionIdSetCommitTs(TransactionId xid, TimestampTz ts, RepOriginId nodeid, int slotno); static void error_commit_ts_disabled(void); static int ZeroCommitTsPage(int pageno, bool writeXlog); -static bool CommitTsPagePrecedes(int page1, int page2); +static int32 CommitTsPageDiff(int page1, int page2); static void ActivateCommitTs(void); static void DeactivateCommitTs(void); static void WriteZeroPageXlogRec(int pageno); @@ -552,12 +552,12 @@ CommitTsShmemInit(void) { bool found; - CommitTsCtl->PagePrecedes = CommitTsPagePrecedes; + CommitTsCtl->PageDiff = CommitTsPageDiff; SimpleLruInit(CommitTsCtl, "CommitTs", CommitTsShmemBuffers(), 0, CommitTsSLRULock, "pg_commit_ts", LWTRANCHE_COMMITTS_BUFFER, SYNC_HANDLER_COMMIT_TS); - SlruPagePrecedesUnitTests(CommitTsCtl, COMMIT_TS_XACTS_PER_PAGE); + SlruPageDiffUnitTests(CommitTsCtl, COMMIT_TS_XACTS_PER_PAGE); commitTsShared = ShmemInitStruct("CommitTs shared", sizeof(CommitTimestampShared), @@ -875,7 +875,7 @@ TruncateCommitTs(TransactionId oldestXact) cutoffPage = TransactionIdToCTsPage(oldestXact); /* Check to see if there's any files that could be removed */ - if (!SlruScanDirectory(CommitTsCtl, SlruScanDirCbReportPresence, + if (!SlruScanDirectory(CommitTsCtl, SlruScanDirCbWouldTruncate, &cutoffPage)) return; /* nothing to remove */ @@ -928,8 +928,8 @@ AdvanceOldestCommitTsXid(TransactionId oldestXact) /* - * Decide whether a commitTS page number is "older" for truncation purposes. - * Analogous to CLOGPagePrecedes(). + * Diff commitTS page numbers for truncation purposes. Analogous to + * CLOGPageDiff(). * * At every supported BLCKSZ, (1 << 31) % COMMIT_TS_XACTS_PER_PAGE == 128. * This introduces differences compared to CLOG and the other SLRUs having (1 @@ -940,7 +940,7 @@ AdvanceOldestCommitTsXid(TransactionId oldestXact) * 128 entries of its page. Since this function doesn't know the location of * oldestXact within page2, it returns false for one page that actually is * expendable. This is a wider (yet still negligible) version of the - * truncation opportunity that CLOGPagePrecedes() cannot recognize. + * truncation opportunity that CLOGPageDiff() cannot recognize. * * For the sake of a worked example, number entries with decimal values such * that page1==1 entries range from 1.0 to 1.999. Let N+0.15 be the number of @@ -950,19 +950,20 @@ AdvanceOldestCommitTsXid(TransactionId oldestXact) * last entry of the oldestXact page. While page 2 is expendable at * oldestXact=N+2.1, it would be precious at oldestXact=N+2.9. */ -static bool -CommitTsPagePrecedes(int page1, int page2) +static int32 +CommitTsPageDiff(int page1, int page2) { TransactionId xid1; TransactionId xid2; + int32 diff_head; + int32 diff_tail; xid1 = ((TransactionId) page1) * COMMIT_TS_XACTS_PER_PAGE; - xid1 += FirstNormalTransactionId + 1; xid2 = ((TransactionId) page2) * COMMIT_TS_XACTS_PER_PAGE; - xid2 += FirstNormalTransactionId + 1; - return (TransactionIdPrecedes(xid1, xid2) && - TransactionIdPrecedes(xid1, xid2 + COMMIT_TS_XACTS_PER_PAGE - 1)); + diff_head = xid1 - xid2; + diff_tail = xid1 - (xid2 + COMMIT_TS_XACTS_PER_PAGE - 1); + return Max(diff_head, diff_tail); } diff --git a/src/backend/access/transam/multixact.c b/src/backend/access/transam/multixact.c index 7423110..4772aa0 100644 --- a/src/backend/access/transam/multixact.c +++ b/src/backend/access/transam/multixact.c @@ -102,7 +102,7 @@ * 0xFFFFFFFF/MULTIXACT_OFFSETS_PER_PAGE/SLRU_PAGES_PER_SEGMENT. We need * take no explicit notice of that fact in this module, except when comparing * segment and page numbers in TruncateMultiXact (see - * MultiXactOffsetPagePrecedes). + * MultiXactOffsetPageDiff). */ /* We need four bytes per offset */ @@ -355,8 +355,8 @@ static char *mxstatus_to_string(MultiXactStatus status); /* management of SLRU infrastructure */ static int ZeroMultiXactOffsetPage(int pageno, bool writeXlog); static int ZeroMultiXactMemberPage(int pageno, bool writeXlog); -static bool MultiXactOffsetPagePrecedes(int page1, int page2); -static bool MultiXactMemberPagePrecedes(int page1, int page2); +static int32 MultiXactOffsetPageDiff(int page1, int page2); +static int32 MultiXactMemberPageDiff(int page1, int page2); static bool MultiXactOffsetPrecedes(MultiXactOffset offset1, MultiXactOffset offset2); static void ExtendMultiXactOffset(MultiXactId multi); @@ -1844,15 +1844,15 @@ MultiXactShmemInit(void) debug_elog2(DEBUG2, "Shared Memory Init for MultiXact"); - MultiXactOffsetCtl->PagePrecedes = MultiXactOffsetPagePrecedes; - MultiXactMemberCtl->PagePrecedes = MultiXactMemberPagePrecedes; + MultiXactOffsetCtl->PageDiff = MultiXactOffsetPageDiff; + MultiXactMemberCtl->PageDiff = MultiXactMemberPageDiff; SimpleLruInit(MultiXactOffsetCtl, "MultiXactOffset", NUM_MULTIXACTOFFSET_BUFFERS, 0, MultiXactOffsetSLRULock, "pg_multixact/offsets", LWTRANCHE_MULTIXACTOFFSET_BUFFER, SYNC_HANDLER_MULTIXACT_OFFSET); - SlruPagePrecedesUnitTests(MultiXactOffsetCtl, MULTIXACT_OFFSETS_PER_PAGE); + SlruPageDiffUnitTests(MultiXactOffsetCtl, MULTIXACT_OFFSETS_PER_PAGE); SimpleLruInit(MultiXactMemberCtl, "MultiXactMember", NUM_MULTIXACTMEMBER_BUFFERS, 0, MultiXactMemberSLRULock, "pg_multixact/members", @@ -2867,7 +2867,7 @@ SlruScanDirCbFindEarliest(SlruCtl ctl, char *filename, int segpage, void *data) mxtruncinfo *trunc = (mxtruncinfo *) data; if (trunc->earliestExistingPage == -1 || - ctl->PagePrecedes(segpage, trunc->earliestExistingPage)) + ctl->PageDiff(segpage, trunc->earliestExistingPage)) { trunc->earliestExistingPage = segpage; } @@ -2986,11 +2986,12 @@ TruncateMultiXact(MultiXactId newOldestMulti, Oid newOldestMultiDB) * * When nextMXact is less than one segment away from multiWrapLimit, * SlruScanDirCbFindEarliest can find some early segment other than the - * actual earliest. (MultiXactOffsetPagePrecedes(EARLIEST, LATEST) - * returns false, because not all pairs of entries have the same answer.) - * That can also arise when an earlier truncation attempt failed unlink() - * or returned early from this function. The only consequence is - * returning early, which wastes space that we could have liberated. + * actual earliest. (MultiXactOffsetPageDiff(EARLIEST, LATEST) >= 0, + * because not all pairs of entries have the same answer.) That can also + * arise when an earlier truncation attempt failed unlink(), returned + * early from this function, or saw SlruWouldTruncateSegment() decline to + * delete the older half of the SLRU. The only consequence is returning + * early, which wastes space that we could have liberated. * * NB: It's also possible that the page that oldestMulti is on has already * been truncated away, and we crashed before updating oldestMulti. @@ -3106,44 +3107,42 @@ TruncateMultiXact(MultiXactId newOldestMulti, Oid newOldestMultiDB) } /* - * Decide whether a MultiXactOffset page number is "older" for truncation - * purposes. Analogous to CLOGPagePrecedes(). - * - * Offsetting the values is optional, because MultiXactIdPrecedes() has - * translational symmetry. + * Diff MultiXactOffset page numbers for truncation purposes. Analogous to + * CLOGPageDiff(). */ -static bool -MultiXactOffsetPagePrecedes(int page1, int page2) +static int32 +MultiXactOffsetPageDiff(int page1, int page2) { MultiXactId multi1; MultiXactId multi2; + int32 diff_head; + int32 diff_tail; multi1 = ((MultiXactId) page1) * MULTIXACT_OFFSETS_PER_PAGE; - multi1 += FirstMultiXactId + 1; multi2 = ((MultiXactId) page2) * MULTIXACT_OFFSETS_PER_PAGE; - multi2 += FirstMultiXactId + 1; - return (MultiXactIdPrecedes(multi1, multi2) && - MultiXactIdPrecedes(multi1, - multi2 + MULTIXACT_OFFSETS_PER_PAGE - 1)); + diff_head = multi1 - multi2; + diff_tail = multi1 - (multi2 + MULTIXACT_OFFSETS_PER_PAGE - 1); + return Max(diff_head, diff_tail); } /* - * Decide whether a MultiXactMember page number is "older" for truncation - * purposes. There is no "invalid offset number" so use the numbers verbatim. + * Diff MultiXactMember page numbers for truncation purposes. */ -static bool -MultiXactMemberPagePrecedes(int page1, int page2) +static int32 +MultiXactMemberPageDiff(int page1, int page2) { MultiXactOffset offset1; MultiXactOffset offset2; + int32 diff_head; + int32 diff_tail; offset1 = ((MultiXactOffset) page1) * MULTIXACT_MEMBERS_PER_PAGE; offset2 = ((MultiXactOffset) page2) * MULTIXACT_MEMBERS_PER_PAGE; - return (MultiXactOffsetPrecedes(offset1, offset2) && - MultiXactOffsetPrecedes(offset1, - offset2 + MULTIXACT_MEMBERS_PER_PAGE - 1)); + diff_head = offset1 - offset2; + diff_tail = offset1 - (offset2 + MULTIXACT_MEMBERS_PER_PAGE - 1); + return Max(diff_head, diff_tail); } /* diff --git a/src/backend/access/transam/slru.c b/src/backend/access/transam/slru.c index 014072f..d6097ab 100644 --- a/src/backend/access/transam/slru.c +++ b/src/backend/access/transam/slru.c @@ -260,7 +260,7 @@ SimpleLruInit(SlruCtl ctl, const char *name, int nslots, int nlsns, /* * Initialize the unshared control struct, including directory path. We - * assume caller set PagePrecedes. + * assume caller set PageDiff. */ ctl->shared = shared; ctl->sync_handler = sync_handler; @@ -1091,8 +1091,8 @@ SlruSelectLRUPage(SlruCtl ctl, int pageno) { if (this_delta > best_valid_delta || (this_delta == best_valid_delta && - ctl->PagePrecedes(this_page_number, - best_valid_page_number))) + ctl->PageDiff(this_page_number, + best_valid_page_number) < 0)) { bestvalidslot = slotno; best_valid_delta = this_delta; @@ -1103,8 +1103,8 @@ SlruSelectLRUPage(SlruCtl ctl, int pageno) { if (this_delta > best_invalid_delta || (this_delta == best_invalid_delta && - ctl->PagePrecedes(this_page_number, - best_invalid_page_number))) + ctl->PageDiff(this_page_number, + best_invalid_page_number) < 0)) { bestinvalidslot = slotno; best_invalid_delta = this_delta; @@ -1211,7 +1211,8 @@ SimpleLruWriteAll(SlruCtl ctl, bool allow_redirtied) } /* - * Remove all segments before the one holding the passed page number + * Remove some obsolete segments. As defense in depth, this deletes less than + * PageDiff() authorizes; see SlruWouldTruncateSegment(). * * All SLRUs prevent concurrent calls to this function, either with an LWLock * or by calling it only as part of a checkpoint. Mutual exclusion must begin @@ -1244,7 +1245,7 @@ restart:; * While we are holding the lock, make an important safety check: the * current endpoint page must not be eligible for removal. */ - if (ctl->PagePrecedes(shared->latest_page_number, cutoffPage)) + if (ctl->PageDiff(shared->latest_page_number, cutoffPage) < 0) { LWLockRelease(shared->ControlLock); ereport(LOG, @@ -1257,7 +1258,7 @@ restart:; { if (shared->page_status[slotno] == SLRU_PAGE_EMPTY) continue; - if (!ctl->PagePrecedes(shared->page_number[slotno], cutoffPage)) + if (ctl->PageDiff(shared->page_number[slotno], cutoffPage) >= 0) continue; /* @@ -1382,33 +1383,46 @@ restart: } /* - * Determine whether a segment is okay to delete. + * Determine whether to delete a segment. * * segpage is the first page of the segment, and cutoffPage is the oldest (in - * PagePrecedes order) page in the SLRU containing still-useful data. Since - * every core PagePrecedes callback implements "wrap around", check the + * PageDiff order) page in the SLRU containing still-useful data. Check the * segment's first and last pages: * * first=cutoff: no; cutoff falls inside this segment * first>=cutoff && last=cutoff && last>=cutoff: no; every page of this segment is too young + * + * The PageDiff specification requires us not to remove pages where the + * callback reports negative values close to INT_MIN. Our interpretation is + * to decline to delete segments containing a page P such that PageDiff(P, + * cutoffPage) is in [INT_MIN, INT_MIN/2]. */ static bool -SlruMayDeleteSegment(SlruCtl ctl, int segpage, int cutoffPage) +SlruWouldTruncateSegment(SlruCtl ctl, int segpage, int cutoffPage) { - int seg_last_page = segpage + SLRU_PAGES_PER_SEGMENT - 1; + int first_page_diff; Assert(segpage % SLRU_PAGES_PER_SEGMENT == 0); - return (ctl->PagePrecedes(segpage, cutoffPage) && - ctl->PagePrecedes(seg_last_page, cutoffPage)); + first_page_diff = ctl->PageDiff(segpage, cutoffPage); + if (first_page_diff < 0 && first_page_diff > INT_MIN / 2) + { + int seg_last_page = segpage + SLRU_PAGES_PER_SEGMENT - 1; + int last_page_diff = ctl->PageDiff(seg_last_page, cutoffPage); + + return last_page_diff < 0 && last_page_diff > INT_MIN / 2; + } + return false; } #ifdef USE_ASSERT_CHECKING static void -SlruPagePrecedesTestOffset(SlruCtl ctl, int per_page, uint32 offset) +SlruPageDiffTestOffset(SlruCtl ctl, int per_page, uint32 offset) { + int32 large_negative = INT_MIN / 1000 * 999, + large_positive = INT_MAX / 1000 * 999; TransactionId lhs, rhs; int newestPage, @@ -1432,19 +1446,27 @@ SlruPagePrecedesTestOffset(SlruCtl ctl, int per_page, uint32 offset) Assert(!TransactionIdPrecedes(rhs, lhs + 1)); Assert(!TransactionIdFollowsOrEquals(lhs, rhs)); Assert(!TransactionIdFollowsOrEquals(rhs, lhs)); - Assert(!ctl->PagePrecedes(lhs / per_page, lhs / per_page)); - Assert(!ctl->PagePrecedes(lhs / per_page, rhs / per_page)); - Assert(!ctl->PagePrecedes(rhs / per_page, lhs / per_page)); - Assert(!ctl->PagePrecedes((lhs - per_page) / per_page, rhs / per_page)); - Assert(ctl->PagePrecedes(rhs / per_page, (lhs - 3 * per_page) / per_page)); - Assert(ctl->PagePrecedes(rhs / per_page, (lhs - 2 * per_page) / per_page)); - Assert(ctl->PagePrecedes(rhs / per_page, (lhs - 1 * per_page) / per_page) - || (1U << 31) % per_page != 0); /* See CommitTsPagePrecedes() */ - Assert(ctl->PagePrecedes((lhs + 1 * per_page) / per_page, rhs / per_page) + Assert(ctl->PageDiff(lhs / per_page, lhs / per_page) == 0); + Assert(ctl->PageDiff(lhs / per_page, rhs / per_page) > large_positive); + Assert(ctl->PageDiff(rhs / per_page, lhs / per_page) > large_positive); + Assert(ctl->PageDiff((lhs - per_page) / per_page, rhs / per_page) > + large_positive); + Assert(ctl->PageDiff(rhs / per_page, (lhs - 3 * per_page) / per_page) < + large_negative); + Assert(ctl->PageDiff(rhs / per_page, (lhs - 2 * per_page) / per_page) < + large_negative); + Assert(ctl->PageDiff(rhs / per_page, (lhs - 1 * per_page) / per_page) < + large_negative + || (1U << 31) % per_page != 0); /* See CommitTsPageDiff() */ + Assert(ctl->PageDiff((lhs + 1 * per_page) / per_page, rhs / per_page) < + large_negative || (1U << 31) % per_page != 0); - Assert(ctl->PagePrecedes((lhs + 2 * per_page) / per_page, rhs / per_page)); - Assert(ctl->PagePrecedes((lhs + 3 * per_page) / per_page, rhs / per_page)); - Assert(!ctl->PagePrecedes(rhs / per_page, (lhs + per_page) / per_page)); + Assert(ctl->PageDiff((lhs + 2 * per_page) / per_page, rhs / per_page) < + large_negative); + Assert(ctl->PageDiff((lhs + 3 * per_page) / per_page, rhs / per_page) < + large_negative); + Assert(ctl->PageDiff(rhs / per_page, (lhs + per_page) / per_page) > + large_positive); /* * GetNewTransactionId() has assigned the last XID it can safely use, and @@ -1457,10 +1479,10 @@ SlruPagePrecedesTestOffset(SlruCtl ctl, int per_page, uint32 offset) oldestXact = newestXact + 1; oldestXact -= 1U << 31; oldestPage = oldestXact / per_page; - Assert(!SlruMayDeleteSegment(ctl, - (newestPage - - newestPage % SLRU_PAGES_PER_SEGMENT), - oldestPage)); + Assert(!SlruWouldTruncateSegment(ctl, + (newestPage - + newestPage % SLRU_PAGES_PER_SEGMENT), + oldestPage)); /* * GetNewTransactionId() has assigned the last XID it can safely use, and @@ -1473,42 +1495,44 @@ SlruPagePrecedesTestOffset(SlruCtl ctl, int per_page, uint32 offset) oldestXact = newestXact + 1; oldestXact -= 1U << 31; oldestPage = oldestXact / per_page; - Assert(!SlruMayDeleteSegment(ctl, - (newestPage - - newestPage % SLRU_PAGES_PER_SEGMENT), - oldestPage)); + Assert(!SlruWouldTruncateSegment(ctl, + (newestPage - + newestPage % SLRU_PAGES_PER_SEGMENT), + oldestPage)); } /* - * Unit-test a PagePrecedes function. + * Unit-test a PageDiff function. * * This assumes every uint32 >= FirstNormalTransactionId is a valid key. It * assumes each value occupies a contiguous, fixed-size region of SLRU bytes. * (MultiXactMemberCtl separates flags from XIDs. AsyncCtl has * variable-length entries, no keys, and no random access. These unit tests * do not apply to them.) + * + * This is stricter than the PageDiff API requires. */ void -SlruPagePrecedesUnitTests(SlruCtl ctl, int per_page) +SlruPageDiffUnitTests(SlruCtl ctl, int per_page) { /* Test first, middle and last entries of a page. */ - SlruPagePrecedesTestOffset(ctl, per_page, 0); - SlruPagePrecedesTestOffset(ctl, per_page, per_page / 2); - SlruPagePrecedesTestOffset(ctl, per_page, per_page - 1); + SlruPageDiffTestOffset(ctl, per_page, 0); + SlruPageDiffTestOffset(ctl, per_page, per_page / 2); + SlruPageDiffTestOffset(ctl, per_page, per_page - 1); } #endif /* * SlruScanDirectory callback - * This callback reports true if there's any segment wholly prior to the - * one containing the page passed as "data". + * This callback reports true if SimpleLruTruncate(ctl, *data) would + * unlink any segment. */ bool -SlruScanDirCbReportPresence(SlruCtl ctl, char *filename, int segpage, void *data) +SlruScanDirCbWouldTruncate(SlruCtl ctl, char *filename, int segpage, void *data) { int cutoffPage = *(int *) data; - if (SlruMayDeleteSegment(ctl, segpage, cutoffPage)) + if (SlruWouldTruncateSegment(ctl, segpage, cutoffPage)) return true; /* found one; don't iterate any more */ return false; /* keep going */ @@ -1523,7 +1547,7 @@ SlruScanDirCbDeleteCutoff(SlruCtl ctl, char *filename, int segpage, void *data) { int cutoffPage = *(int *) data; - if (SlruMayDeleteSegment(ctl, segpage, cutoffPage)) + if (SlruWouldTruncateSegment(ctl, segpage, cutoffPage)) SlruInternalDeleteSegment(ctl, filename); return false; /* keep going */ diff --git a/src/backend/access/transam/subtrans.c b/src/backend/access/transam/subtrans.c index c50490d..537862c 100644 --- a/src/backend/access/transam/subtrans.c +++ b/src/backend/access/transam/subtrans.c @@ -44,7 +44,7 @@ * 0xFFFFFFFF/SUBTRANS_XACTS_PER_PAGE, and segment numbering at * 0xFFFFFFFF/SUBTRANS_XACTS_PER_PAGE/SLRU_PAGES_PER_SEGMENT. We need take no * explicit notice of that fact in this module, except when comparing segment - * and page numbers in TruncateSUBTRANS (see SubTransPagePrecedes) and zeroing + * and page numbers in TruncateSUBTRANS (see SubTransPageDiff) and zeroing * them in StartupSUBTRANS. */ @@ -64,7 +64,7 @@ static SlruCtlData SubTransCtlData; static int ZeroSUBTRANSPage(int pageno); -static bool SubTransPagePrecedes(int page1, int page2); +static int32 SubTransPageDiff(int page1, int page2); /* @@ -190,11 +190,11 @@ SUBTRANSShmemSize(void) void SUBTRANSShmemInit(void) { - SubTransCtl->PagePrecedes = SubTransPagePrecedes; + SubTransCtl->PageDiff = SubTransPageDiff; SimpleLruInit(SubTransCtl, "Subtrans", NUM_SUBTRANS_BUFFERS, 0, SubtransSLRULock, "pg_subtrans", LWTRANCHE_SUBTRANS_BUFFER, SYNC_HANDLER_NONE); - SlruPagePrecedesUnitTests(SubTransCtl, SUBTRANS_XACTS_PER_PAGE); + SlruPageDiffUnitTests(SubTransCtl, SUBTRANS_XACTS_PER_PAGE); } /* @@ -355,20 +355,21 @@ TruncateSUBTRANS(TransactionId oldestXact) /* - * Decide whether a SUBTRANS page number is "older" for truncation purposes. - * Analogous to CLOGPagePrecedes(). + * Diff SUBTRANS page numbers for truncation purposes. Analogous to + * CLOGPageDiff(). */ -static bool -SubTransPagePrecedes(int page1, int page2) +static int32 +SubTransPageDiff(int page1, int page2) { TransactionId xid1; TransactionId xid2; + int32 diff_head; + int32 diff_tail; xid1 = ((TransactionId) page1) * SUBTRANS_XACTS_PER_PAGE; - xid1 += FirstNormalTransactionId + 1; xid2 = ((TransactionId) page2) * SUBTRANS_XACTS_PER_PAGE; - xid2 += FirstNormalTransactionId + 1; - return (TransactionIdPrecedes(xid1, xid2) && - TransactionIdPrecedes(xid1, xid2 + SUBTRANS_XACTS_PER_PAGE - 1)); + diff_head = xid1 - xid2; + diff_tail = xid1 - (xid2 + SUBTRANS_XACTS_PER_PAGE - 1); + return Max(diff_head, diff_tail); } diff --git a/src/backend/commands/async.c b/src/backend/commands/async.c index 9872129..9c6b82c 100644 --- a/src/backend/commands/async.c +++ b/src/backend/commands/async.c @@ -207,13 +207,13 @@ typedef struct QueuePosition /* choose logically smaller QueuePosition */ #define QUEUE_POS_MIN(x,y) \ - (asyncQueuePagePrecedes((x).page, (y).page) ? (x) : \ + (asyncQueuePageDiff((x).page, (y).page) < 0 ? (x) : \ (x).page != (y).page ? (y) : \ (x).offset < (y).offset ? (x) : (y)) /* choose logically larger QueuePosition */ #define QUEUE_POS_MAX(x,y) \ - (asyncQueuePagePrecedes((x).page, (y).page) ? (y) : \ + (asyncQueuePageDiff((x).page, (y).page) < 0 ? (y) : \ (x).page != (y).page ? (x) : \ (x).offset > (y).offset ? (x) : (y)) @@ -433,8 +433,7 @@ static bool backendTryAdvanceTail = false; bool Trace_notify = false; /* local function prototypes */ -static int asyncQueuePageDiff(int p, int q); -static bool asyncQueuePagePrecedes(int p, int q); +static int32 asyncQueuePageDiff(int p, int q); static void queue_listen(ListenActionKind action, const char *channel); static void Async_UnlistenOnExit(int code, Datum arg); static void Exec_ListenPreCommit(void); @@ -465,12 +464,16 @@ static void ClearPendingActionsAndNotifies(void); /* * Compute the difference between two queue page numbers (i.e., p - q), - * accounting for wraparound. + * accounting for wraparound. Since asyncQueueIsFull() blocks creation of a + * page that could precede any extant page, we need not assess entries within + * a page. */ -static int +static int32 asyncQueuePageDiff(int p, int q) { - int diff; + int diff_max = ((QUEUE_MAX_PAGE + 1) / 2) - 1, + diff; + int32 scale = INT_MAX / diff_max; /* * We have to compare modulo (QUEUE_MAX_PAGE+1)/2. Both inputs should be @@ -484,19 +487,24 @@ asyncQueuePageDiff(int p, int q) diff -= QUEUE_MAX_PAGE + 1; else if (diff < -((QUEUE_MAX_PAGE + 1) / 2)) diff += QUEUE_MAX_PAGE + 1; - return diff; + return diff * scale; } -/* - * Is p < q, accounting for wraparound? - * - * Since asyncQueueIsFull() blocks creation of a page that could precede any - * extant page, we need not assess entries within a page. - */ -static bool -asyncQueuePagePrecedes(int p, int q) +static void +asyncQueuePageDiffUnitTests(void) { - return asyncQueuePageDiff(p, q) < 0; + int32 large_negative = INT_MIN / 1000 * 999, + large_positive = INT_MAX / 1000 * 999; + int diff_min = -((QUEUE_MAX_PAGE + 1) / 2), + diff_max = ((QUEUE_MAX_PAGE + 1) / 2) - 1; + + Assert(asyncQueuePageDiff(diff_max, diff_max) == 0); + Assert(asyncQueuePageDiff(diff_max, 0) > large_positive); + Assert(asyncQueuePageDiff(diff_max + 1, 0) < large_negative); + Assert(asyncQueuePageDiff(0, QUEUE_MAX_PAGE + diff_min + 1) < + large_negative); + Assert(asyncQueuePageDiff(0, QUEUE_MAX_PAGE + diff_min + 2) > + large_positive); } /* @@ -557,10 +565,11 @@ AsyncShmemInit(void) /* * Set up SLRU management of the pg_notify data. */ - NotifyCtl->PagePrecedes = asyncQueuePagePrecedes; + NotifyCtl->PageDiff = asyncQueuePageDiff; SimpleLruInit(NotifyCtl, "Notify", NUM_NOTIFY_BUFFERS, 0, NotifySLRULock, "pg_notify", LWTRANCHE_NOTIFY_BUFFER, SYNC_HANDLER_NONE); + asyncQueuePageDiffUnitTests(); if (!found) { @@ -1365,7 +1374,7 @@ asyncQueueIsFull(void) nexthead = 0; /* wrap around */ boundary = QUEUE_POS_PAGE(QUEUE_TAIL); boundary -= boundary % SLRU_PAGES_PER_SEGMENT; - return asyncQueuePagePrecedes(nexthead, boundary); + return asyncQueuePageDiff(nexthead, boundary) < 0; } /* @@ -2203,7 +2212,7 @@ asyncQueueAdvanceTail(void) */ newtailpage = QUEUE_POS_PAGE(min); boundary = newtailpage - (newtailpage % SLRU_PAGES_PER_SEGMENT); - if (asyncQueuePagePrecedes(oldtailpage, boundary)) + if (asyncQueuePageDiff(oldtailpage, boundary) < 0) { /* * SimpleLruTruncate() will ask for NotifySLRULock but will also diff --git a/src/backend/storage/lmgr/predicate.c b/src/backend/storage/lmgr/predicate.c index 1b646a0..733ad93 100644 --- a/src/backend/storage/lmgr/predicate.c +++ b/src/backend/storage/lmgr/predicate.c @@ -438,7 +438,7 @@ static void SetPossibleUnsafeConflict(SERIALIZABLEXACT *roXact, SERIALIZABLEXACT static void ReleaseRWConflict(RWConflict conflict); static void FlagSxactUnsafe(SERIALIZABLEXACT *sxact); -static bool SerialPagePrecedesLogically(int page1, int page2); +static int32 SerialPageDiffLogically(int page1, int page2); static void SerialInit(void); static void SerialAdd(TransactionId xid, SerCommitSeqNo minConflictCommitSeqNo); static SerCommitSeqNo SerialGetMinConflictCommitSeqNo(TransactionId xid); @@ -784,26 +784,30 @@ FlagSxactUnsafe(SERIALIZABLEXACT *sxact) /*------------------------------------------------------------------------*/ /* - * Decide whether a Serial page number is "older" for truncation purposes. - * Analogous to CLOGPagePrecedes(). + * Diff Serial page numbers for truncation purposes. Analogous to + * CLOGPageDiff(). + * + * This must follow stricter rules than PageDiff demands, for the benefit of + * the call local to this file. */ -static bool -SerialPagePrecedesLogically(int page1, int page2) +static int32 +SerialPageDiffLogically(int page1, int page2) { TransactionId xid1; TransactionId xid2; + int32 diff_head; + int32 diff_tail; xid1 = ((TransactionId) page1) * SERIAL_ENTRIESPERPAGE; - xid1 += FirstNormalTransactionId + 1; xid2 = ((TransactionId) page2) * SERIAL_ENTRIESPERPAGE; - xid2 += FirstNormalTransactionId + 1; - return (TransactionIdPrecedes(xid1, xid2) && - TransactionIdPrecedes(xid1, xid2 + SERIAL_ENTRIESPERPAGE - 1)); + diff_head = xid1 - xid2; + diff_tail = xid1 - (xid2 + SERIAL_ENTRIESPERPAGE - 1); + return Max(diff_head, diff_tail); } static void -SerialPagePrecedesLogicallyUnitTests(void) +SerialPageDiffLogicallyUnitTests(void) { int per_page = SERIAL_ENTRIESPERPAGE, offset = per_page / 2; @@ -826,21 +830,21 @@ SerialPagePrecedesLogicallyUnitTests(void) * In this scenario, the SLRU headPage pertains to the last ~1000 XIDs * assigned. oldestXact finishes, ~2B XIDs having elapsed since it * started. Further transactions cause us to summarize oldestXact to - * tailPage. Function must return false so SerialAdd() doesn't zero - * tailPage (which may contain entries for other old, recently-finished - * XIDs) and half the SLRU. Reaching this requires burning ~2B XIDs in - * single-user mode, a negligible possibility. + * tailPage. Function must return non-negative so SerialAdd() doesn't + * zero tailPage (which may contain entries for other old, + * recently-finished XIDs) and half the SLRU. Reaching this requires + * burning ~2B XIDs in single-user mode, a negligible possibility. */ headPage = newestPage; targetPage = oldestPage; - Assert(!SerialPagePrecedesLogically(headPage, targetPage)); + Assert(SerialPageDiffLogically(headPage, targetPage) >= 0); /* * In this scenario, the SLRU headPage pertains to oldestXact. We're * summarizing an XID near newestXact. (Assume few other XIDs used * SERIALIZABLE, hence the minimal headPage advancement. Assume * oldestXact was long-running and only recently reached the SLRU.) - * Function must return true to make SerialAdd() create targetPage. + * Function must return negative to make SerialAdd() create targetPage. * * Today's implementation mishandles this case, but it doesn't matter * enough to fix. Verify that the defect affects just one page by @@ -851,9 +855,9 @@ SerialPagePrecedesLogicallyUnitTests(void) */ headPage = oldestPage; targetPage = newestPage; - Assert(SerialPagePrecedesLogically(headPage, targetPage - 1)); + Assert(SerialPageDiffLogically(headPage, targetPage - 1) < 0); #if 0 - Assert(SerialPagePrecedesLogically(headPage, targetPage)); + Assert(SerialPageDiffLogically(headPage, targetPage) < 0); #endif } @@ -868,12 +872,12 @@ SerialInit(void) /* * Set up SLRU management of the pg_serial data. */ - SerialSlruCtl->PagePrecedes = SerialPagePrecedesLogically; + SerialSlruCtl->PageDiff = SerialPageDiffLogically; SimpleLruInit(SerialSlruCtl, "Serial", NUM_SERIAL_BUFFERS, 0, SerialSLRULock, "pg_serial", LWTRANCHE_SERIAL_BUFFER, SYNC_HANDLER_NONE); - SerialPagePrecedesLogicallyUnitTests(); - SlruPagePrecedesUnitTests(SerialSlruCtl, SERIAL_ENTRIESPERPAGE); + SerialPageDiffLogicallyUnitTests(); + SlruPageDiffUnitTests(SerialSlruCtl, SERIAL_ENTRIESPERPAGE); /* * Create or attach to the SerialControl structure. @@ -935,8 +939,8 @@ SerialAdd(TransactionId xid, SerCommitSeqNo minConflictCommitSeqNo) else { firstZeroPage = SerialNextPage(serialControl->headPage); - isNewPage = SerialPagePrecedesLogically(serialControl->headPage, - targetPage); + isNewPage = SerialPageDiffLogically(serialControl->headPage, + targetPage) < 0; } if (!TransactionIdIsValid(serialControl->headXid) diff --git a/src/include/access/slru.h b/src/include/access/slru.h index 805dd2b..967ccd1 100644 --- a/src/include/access/slru.h +++ b/src/include/access/slru.h @@ -29,7 +29,7 @@ * xxxx is CLOG or SUBTRANS, respectively), and segment numbering at * 0xFFFFFFFF/xxxx_XACTS_PER_PAGE/SLRU_PAGES_PER_SEGMENT. We need * take no explicit notice of that fact in slru.c, except when comparing - * segment and page numbers in SimpleLruTruncate (see PagePrecedes()). + * segment and page numbers in SimpleLruTruncate (see PageDiff()). */ #define SLRU_PAGES_PER_SEGMENT 32 @@ -118,16 +118,18 @@ typedef struct SlruCtlData SyncRequestHandler sync_handler; /* - * Decide whether a page is "older" for truncation and as a hint for - * evicting pages in LRU order. Return true if every entry of the first - * argument is older than every entry of the second argument. Note that - * !PagePrecedes(a,b) && !PagePrecedes(b,a) need not imply a==b; it also - * arises when some entries are older and some are not. For SLRUs using - * SimpleLruTruncate(), this must use modular arithmetic. (For others, - * the behavior of this callback has no functional implications.) Use - * SlruPagePrecedesUnitTests() in SLRUs meeting its criteria. + * Compute distance between two page numbers, for truncation and as a hint + * for evicting pages in LRU order. Callbacks shall distribute return + * values uniformly in [INT_MIN,INT_MAX]. If PageDiff(P, oldest_needed) + * is negative but not close to INT_MIN, that implies data in page P is + * obsolete. The exception for values close to INT_MIN permits + * implementations to return such values for edge cases where the answer + * changes mid-page from INT_MIN to INT_MAX. Use SlruPageDiffUnitTests() + * in SLRUs meeting its criteria. For SLRUs using SimpleLruTruncate(), + * this must use modular arithmetic. (For others, the behavior of this + * callback has no functional implications.) */ - bool (*PagePrecedes) (int, int); + int32 (*PageDiff) (int, int); /* * Dir is set during SimpleLruInit and does not change thereafter. Since @@ -151,9 +153,9 @@ extern int SimpleLruReadPage_ReadOnly(SlruCtl ctl, int pageno, extern void SimpleLruWritePage(SlruCtl ctl, int slotno); extern void SimpleLruWriteAll(SlruCtl ctl, bool allow_redirtied); #ifdef USE_ASSERT_CHECKING -extern void SlruPagePrecedesUnitTests(SlruCtl ctl, int per_page); +extern void SlruPageDiffUnitTests(SlruCtl ctl, int per_page); #else -#define SlruPagePrecedesUnitTests(ctl, per_page) do {} while (0) +#define SlruPageDiffUnitTests(ctl, per_page) do {} while (0) #endif extern void SimpleLruTruncate(SlruCtl ctl, int cutoffPage); extern bool SimpleLruDoesPhysicalPageExist(SlruCtl ctl, int pageno); @@ -166,8 +168,8 @@ extern void SlruDeleteSegment(SlruCtl ctl, int segno); extern int SlruSyncFileTag(SlruCtl ctl, const FileTag *ftag, char *path); /* SlruScanDirectory public callbacks */ -extern bool SlruScanDirCbReportPresence(SlruCtl ctl, char *filename, - int segpage, void *data); +extern bool SlruScanDirCbWouldTruncate(SlruCtl ctl, char *filename, + int segpage, void *data); extern bool SlruScanDirCbDeleteAll(SlruCtl ctl, char *filename, int segpage, void *data);