Re: BUG #8578: loading a 33G (compressed) pg_dump into a fresh host and db instance crashes a postgresql process

From: Robert Nix <robert(at)urban4m(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-bugs(at)postgresql(dot)org
Subject: Re: BUG #8578: loading a 33G (compressed) pg_dump into a fresh host and db instance crashes a postgresql process
Date: 2013-11-06 03:05:05
Message-ID: CAC2EkfNg1Sq29HSd+fnaqZZ0erFvxQ40H5cn904PZNpw5cOLwQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

re: *work_mem. They are the defaults. In fact, i only changed
checkpoint_segments to 64 because of too frequent checkpointing. All others
are still the defaults.

re: PostGIS. Yes, the table has 3 geometries. Most of the database is
tables with geometries and some are far larger than that one and most of
the largest will have been loaded before that one.

It's running again after changing the sysctl setting and i'm monitoring
memory. Will keep you posted.

Thanks

On Tue, Nov 5, 2013 at 9:20 PM, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:

> Robert Nix <robert(at)urban4m(dot)com> writes:
> > Thanks for the quick response, Tom. Sure enough. I found the OOM message
> in
> > syslog. And thanks for the link. I'll try those suggestions. Just out of
> > curiosity, will using psql -f alter the behavior, in this case, with
> > respect to memory?
>
> No, since the memory consumption was happening on the server side.
>
> It is somewhat of interest why you're apparently getting a memory leak on
> the server side, though. Maybe you were using an unsafely large work_mem
> or maintenance_work_mem setting? I've also seen some reports lately
> suggesting that PostGIS might cause intra-query memory leaks, which might
> explain this if data_partitions.zone_municipality_demog_houston contains
> any PostGIS data types.
>
> regards, tom lane
>

--
.nix

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message suri 2013-11-06 07:22:17
Previous Message Tom Lane 2013-11-06 02:20:24 Re: BUG #8578: loading a 33G (compressed) pg_dump into a fresh host and db instance crashes a postgresql process