From: | Dave Cramer <pg(at)fastcrypt(dot)com> |
---|---|
To: | Enrico Olivelli - Diennea <enrico(dot)olivelli(at)diennea(dot)com> |
Cc: | "pgsql-jdbc(at)postgresql(dot)org" <pgsql-jdbc(at)postgresql(dot)org> |
Subject: | Re: Disk buffering of resultsets |
Date: | 2014-09-21 01:41:29 |
Message-ID: | CADK3HH+_CMpspoWo821XLA4S6My8GL3S81ywEeF6Q1cin3QYCw@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-jdbc |
Enrico,
Patches are welcome. Please do !
Dave Cramer
dave.cramer(at)credativ(dot)ca
http://www.credativ.ca
On 19 September 2014 06:44, Enrico Olivelli - Diennea <
enrico(dot)olivelli(at)diennea(dot)com> wrote:
> Hi,
>
> we are moving from Oracle to PostgreSQL and we hit a serious problem.
>
> When executing a query with a large result set your driver loads each
> record in memory and this is a blocking problem for us.
>
>
>
> The work-around is to use server-side cursors (
> http://jdbc.postgresql.org/documentation/head/query.html) but in order to
> do this we have to change autocommit mode of the transaction and this will
> change transaction semantics of out code.
>
> Many JDBC drivers provide some swap-to-disk function in oredr to deal with
> huge result sets
>
> Something like “if we are loading in RAM more than X MBs than swap on disk”
>
> or “if we are loading in RAM more than X rows than swap on disk” (more
> simple to implement)
>
>
>
> We can contribute with some patch
>
>
>
> Thank you
>
>
>
>
>
>
>
>
>
> *Enrico Olivelli*
> Software Development Manager @Diennea
> Tel.: (+39) 0546 066100 - Int. 925
> Viale G.Marconi 30/14 - 48018 Faenza (RA)
>
> MagNews - E-mail Marketing Solutions
> http://www.magnews.it
> Diennea - Digital Marketing Solutions
> http://www.diennea.com
>
>
>
>
>
> ------------------------------
> Rimani aggiornato sul mondo dell’email marketing e del digital marketing:
> visita il nostro blog! http://blog.magnews.it
>
From | Date | Subject | |
---|---|---|---|
Next Message | Lussier, Denis | 2014-09-21 03:24:29 | Re: Disk buffering of resultsets |
Previous Message | Gili | 2014-09-20 20:27:56 | Re: Patch to allow setting schema/search_path in the connectionURL |