Re: C++, Postgres , libpqxx huge query

From: Andres Freund <andres(at)2ndquadrant(dot)com>
To: alexandros_e <alexandros(dot)ef(at)gmail(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: C++, Postgres , libpqxx huge query
Date: 2014-05-04 10:24:47
Message-ID: 20140504102447.GL12715@awork2.anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi,

On 2014-05-04 01:57:43 -0700, alexandros_e wrote:
> I have to execute an SQL query to Postgres by the following code. The query
> returns a huge number of rows (40M or more) and has 4 integer fields: When I
> use a workstation with 32Gb everything works but on a 16Gb workstation the
> query is very slow (due to swapping I guess). Is there any way to tell the
> C++ to load rows at batches, without waiting the entire dataset? With Java I
> never had these issues before, due to the probably better JDBC driver.

Try looking into either using a serverside cursor or COPY.

Greetings,

Andres Freund

--
Andres Freund http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2014-05-04 14:30:12 Re: Server continuously enters to recovery mode.
Previous Message Alban Hertroys 2014-05-04 09:59:06 Re: C++, Postgres , libpqxx huge query