From: | François Beausoleil <francois(at)teksol(dot)info> |
---|---|
To: | Merlin Moncure <mmoncure(at)gmail(dot)com> |
Cc: | pgsql-general(at)postgresql(dot)org |
Subject: | Re: COPY and indices? |
Date: | 2012-03-13 14:57:06 |
Message-ID: | D78A93782734437B94C4D972CC9C3080@ftml.net |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-general |
Le mardi 13 mars 2012 à 10:48, Merlin Moncure a écrit :
> 2012/3/12 François Beausoleil <francois(at)teksol(dot)info (mailto:francois(at)teksol(dot)info)>:
> > Currently, I can sustain 30-40 writes per second on a Rackspace VPS. I know it's not the ideal solution, but that's what I'm working with. Following vmstat, the server is spending 30 to 40% of it's time in iowait. I don't have measurements as to what files are touched, and I'd welcome suggestions to measure the time PostgreSQL actually spends writing indices vs data.
> > >
> >
> >
>
>
> you're almost certainly blocking on fsync. A real quick'n'dirty way
> to confirm this (although it wont be as fast as COPY) would be to wrap
> your inserts in a transaction. VMs tend to have really horrible
> storage latency which can hurt postgres performance. Another option
> would be to relax your commit policy (for example by flipping
> synchronous_commit) if that fits within your safety requirements.
>
I already applied the tricks you have here: I have a transaction, and synchronous_commit is off. I also have checkpoint_segments set to 96, and 10 minutes.
I'll go with the COPY, since I can live with the batched requirements just fine.
Bye!
François
From | Date | Subject | |
---|---|---|---|
Next Message | Scott Marlowe | 2012-03-13 15:15:53 | Re: COPY and indices? |
Previous Message | Merlin Moncure | 2012-03-13 14:48:43 | Re: COPY and indices? |