From: | Shanker Singh <ssingh(at)iii(dot)com> |
---|---|
To: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "rod(at)iol(dot)ie" <rod(at)iol(dot)ie> |
Cc: | "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>, "Shanker Singh" <ssingh(at)iii(dot)com> |
Subject: | Re: parallel dump fails to dump large tables |
Date: | 2015-02-14 17:41:24 |
Message-ID: | 961471F4049EF94EAD4D0165318BD88162590269@Corp-MBXE3.iii.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
If I exclude the large tables(>30GB) in the parallel dump it does succeed and normal dump also succeeds. So I am not sure if the network is at fault. Is there any other option that might help to make parallel dump usable for large tables?
thanks
shanker
-----Original Message-----
From: Tom Lane [mailto:tgl(at)sss(dot)pgh(dot)pa(dot)us]
Sent: Saturday, February 14, 2015 9:00 AM
To: rod(at)iol(dot)ie
Cc: Shanker Singh; pgsql-general(at)postgresql(dot)org
Subject: Re: [GENERAL] parallel dump fails to dump large tables
"Raymond O'Donnell" <rod(at)iol(dot)ie> writes:
> On 14/02/2015 15:42, Shanker Singh wrote:
>> Hi,
>> I am having problem using parallel pg_dump feature in postgres
>> release 9.4. The size of the table is large(54GB). The dump fails
>> with the
>> error: "pg_dump: [parallel archiver] a worker process died
>> unexpectedly". After this error the pg_dump aborts. The error log
>> file gets the following message:
>>
>> 2015-02-09 15:22:04 PST [8636]: [2-1]
>> user=pdroot,db=iii,appname=pg_dump
>> STATEMENT: COPY iiirecord.varfield (id, field_type_tag, marc_tag,
>> marc_ind1, marc_ind2, field_content, field_group_id, occ_num,
>> record_id) TO stdout;
>> 2015-02-09 15:22:04 PST [8636]: [3-1]
>> user=pdroot,db=iii,appname=pg_dump
>> FATAL: connection to client lost
> There's your problem - something went wrong with the network.
I'm wondering about SSL renegotiation failures as a possible cause of the disconnect --- that would explain why it only happens on large tables.
regards, tom lane
From | Date | Subject | |
---|---|---|---|
Next Message | Eugene Dzhurinsky | 2015-02-14 21:54:47 | Import large data set into a table and resolve duplicates? |
Previous Message | Eugene Dzhurinsky | 2015-02-14 17:37:44 | Import large data set into a table and resolve duplicates? |