From: | Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com> |
---|---|
To: | Rob Sargent <robjsargent(at)gmail(dot)com>, pgsql-general(at)postgresql(dot)org |
Subject: | Re: COPY v. java performance comparison |
Date: | 2014-04-03 02:40:31 |
Message-ID: | 533CCA1F.1020406@aklaver.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
On 04/02/2014 05:30 PM, Rob Sargent wrote:
> On 04/02/2014 06:06 PM, Adrian Klaver wrote:
>> On 04/02/2014 02:27 PM, Rob Sargent wrote:
>>> On 04/02/2014 03:11 PM, Adrian Klaver wrote:
>>>> On 04/02/2014 02:04 PM, Rob Sargent wrote:
>>>>> On 04/02/2014 02:36 PM, Adrian Klaver wrote:
>>>>>> On 04/02/2014 01:14 PM, Rob Sargent wrote:
>>>>>>> On 04/02/2014 01:56 PM, Steve Atkins wrote:
>>
>>>>
>>>> Have you tried moving the input file to the same disk as the server,
>>>> to factor out the controller?
>>>>
>>> I labour under the delusion that it is through the controller one reads
>>> and writes and that there might be some slight advantage to not doing
>>> both against one drive if avoidable. Wrong again?
>>
>> Well there is one way to find out:)
>>
>> Might try with something less then the whole file to get come up an
>> approximate row/sec rate.
>>
>>>
>>
> Well things slow down over time, and lots of "too frequent"s:
>
> Have done 500 batches in 24219 ms
> Have done 1000 batches in 52362 ms
> Have done 1500 batches in 82256 ms
> Have done 2000 batches in 113754 ms
> Have done 2500 batches in 149637 ms
> Have done 3000 batches in 211314 ms
> Have done 3500 batches in 301989 ms
> Have done 4000 batches in 430817 ms
> Have done 4500 batches in 596043 ms
> Have done 5000 batches in 804250 ms
>
> where a batch is 500,000 lines. This on the java side of course.
This is drive to drive or on single drive?
>
>
>
>
--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com
From | Date | Subject | |
---|---|---|---|
Next Message | Amit Langote | 2014-04-03 03:31:51 | Table Rewrite During ALTER TABLE ... ADD COLUMN ... DEFAULT NULL |
Previous Message | David Boreham | 2014-04-03 00:48:19 | Re: SSD Drives |