Re: Large Result and Memory Limit

From: "Scott Marlowe" <scott(dot)marlowe(at)gmail(dot)com>
To: "Mike Ginsburg" <mginsburg(at)collaborativefusion(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Large Result and Memory Limit
Date: 2007-10-04 20:24:04
Message-ID: dcc563d10710041324t780e4624y36dc1711b32222ff@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 10/4/07, Mike Ginsburg <mginsburg(at)collaborativefusion(dot)com> wrote:

> export it. Memory limit is a major concern, but the query for one row
> returns a result set too large and PHP fails.

If this is true, and one single db row makes php exceed its memory
limit just by returning it, you've done something very very in your
design.

You'd proably be better served using either a plain text file system
to store these things, or large objects in postgresql.

But if you're stuffing ~8 megs worth of csv text data into a single
row* you're probably not using a very relational layout of your data.
And you're losing all the advantages (checking your data for
consistency and such) that a relational db could give you.

* Note that I'm assuming a few things up there. 1: php uses about 2:1
memory to store data it's holding, roughly. If you're set to 16 Meg
max, I'm assuming your return set is 8Meg or larger.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Mike Ginsburg 2007-10-04 20:44:35 Re: Large Result and Memory Limit
Previous Message Alvaro Herrera 2007-10-04 20:22:45 Re: Large Result and Memory Limit