Re: COPY v. java performance comparison

From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
To: Rob Sargent <robjsargent(at)gmail(dot)com>, pgsql-general(at)postgresql(dot)org
Subject: Re: COPY v. java performance comparison
Date: 2014-04-03 02:40:31
Message-ID: 533CCA1F.1020406@aklaver.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 04/02/2014 05:30 PM, Rob Sargent wrote:
> On 04/02/2014 06:06 PM, Adrian Klaver wrote:
>> On 04/02/2014 02:27 PM, Rob Sargent wrote:
>>> On 04/02/2014 03:11 PM, Adrian Klaver wrote:
>>>> On 04/02/2014 02:04 PM, Rob Sargent wrote:
>>>>> On 04/02/2014 02:36 PM, Adrian Klaver wrote:
>>>>>> On 04/02/2014 01:14 PM, Rob Sargent wrote:
>>>>>>> On 04/02/2014 01:56 PM, Steve Atkins wrote:
>>
>>>>
>>>> Have you tried moving the input file to the same disk as the server,
>>>> to factor out the controller?
>>>>
>>> I labour under the delusion that it is through the controller one reads
>>> and writes and that there might be some slight advantage to not doing
>>> both against one drive if avoidable. Wrong again?
>>
>> Well there is one way to find out:)
>>
>> Might try with something less then the whole file to get come up an
>> approximate row/sec rate.
>>
>>>
>>
> Well things slow down over time, and lots of "too frequent"s:
>
> Have done 500 batches in 24219 ms
> Have done 1000 batches in 52362 ms
> Have done 1500 batches in 82256 ms
> Have done 2000 batches in 113754 ms
> Have done 2500 batches in 149637 ms
> Have done 3000 batches in 211314 ms
> Have done 3500 batches in 301989 ms
> Have done 4000 batches in 430817 ms
> Have done 4500 batches in 596043 ms
> Have done 5000 batches in 804250 ms
>
> where a batch is 500,000 lines. This on the java side of course.

This is drive to drive or on single drive?

>
>
>
>

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Amit Langote 2014-04-03 03:31:51 Table Rewrite During ALTER TABLE ... ADD COLUMN ... DEFAULT NULL
Previous Message David Boreham 2014-04-03 00:48:19 Re: SSD Drives