From: | "Todd A(dot) Cook" <tcook(at)blackducksoftware(dot)com> |
---|---|
To: | Tomas Vondra <tomas(dot)vondra(at)2ndquadrant(dot)com>, <pgsql-bugs(at)postgresql(dot)org> |
Subject: | Re: BUG #14932: SELECT DISTINCT val FROM table gets stuck in an infinite loop |
Date: | 2018-01-25 22:31:34 |
Message-ID: | 5d764e7f-269f-7f6d-3885-88295dc9e03d@blackducksoftware.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-bugs |
On 11/27/17 14:17, Tomas Vondra wrote:
> Hi,
>
> On 11/27/2017 07:57 PM, tcook(at)blackducksoftware(dot)com wrote:
>> The following bug has been logged on the website:
>>
>> Bug reference: 14932
>> Logged by: Todd Cook
>> Email address: tcook(at)blackducksoftware(dot)com
>> PostgreSQL version: 10.1
>> Operating system: CentOS Linux release 7.4.1708 (Core)
>> Description:
>>
>> It hangs on a table with 167834 rows, though it works fine with only 167833
>> rows. When it hangs, CTRL-C does not interrupt it, and the backend has to
>> be killed to stop it.
>>
>
> Can you share the query and data, so that we can reproduce the issue?
>
> Based on the stack traces this smells like a bug in the simplehash,
> introduced in PostgreSQL 10. Perhaps somewhere in tuplehash_grow(),
> which gets triggered for 167834 rows (but not for 167833).
FWIW, changing the guts of hashint8() to
+ if (val >= INT32_MIN && val <= INT32_MAX)
+ return hash_uint32((uint32) val);
+ else
+ return hash_any((unsigned char *) &val, sizeof(val));
allows us to process a full-sized data set of around 900 million rows. However,
memory usage seemed to be rather excessive (we can only run 7 of these jobs in parallel
on a 128GB system before the OOM killer kicked in, rather than the usual 24); if there's
any interest, I can try to measure exactly how excessive.
-- todd
From | Date | Subject | |
---|---|---|---|
Next Message | PG Bug reporting form | 2018-01-26 07:49:32 | BUG #15032: Segmentation fault when running a particular query |
Previous Message | DevinGriffin | 2018-01-25 21:57:12 | postgis 2.4.3 Issue |