large number of connected connections to postgres database (v8.0)

From: Fei Liu <fei(dot)liu(at)aepnetworks(dot)com>
To: pgsql-performance(at)postgresql(dot)org, Fei Liu <fei(dot)liu(at)aepnetworks(dot)com>
Subject: large number of connected connections to postgres database (v8.0)
Date: 2007-07-17 18:51:05
Message-ID: 469D0F99.1030002@aepnetworks.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

It appears my multi-thread application (100 connections every 5 seconds)
is stalled when working with postgresql database server. I have limited
number of connections in my connection pool to postgresql to 20. At the
begining, connection is allocated and released from connection pool as
postgres serves data request. The pool can recover from exhaustion. But
very quickly (after about 400 client requests), it seems postgres server
stops serving and connection to postgres server is not released any more
resulting a resource exhausting for clients.

Anyone have experience with the performance aspect of this?

Fei
unix 3 [ ] STREAM CONNECTED 1693655
31976/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693654
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693653
31975/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693652
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693651
31974/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693650
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693649
31973/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693648
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693647
31972/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693646
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693645
31971/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693644
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693641
31969/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693640
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693639
31968/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693638
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693637
31967/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693636
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693585
31941/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693584
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693583
31940/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693582
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693581
31939/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693580
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693579
31938/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693578
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693577
31937/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693576
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693575
31936/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693574
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693573
31935/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693572
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693571
31934/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693570
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693427
31851/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693426
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693425
31777/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693424
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693419
31764/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693418
31740/ns_ge_classif

unix 3 [ ] STREAM CONNECTED 1693655
31976/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693654
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693653
31975/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693652
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693651
31974/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693650
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693649
31973/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693648
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693647
31972/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693646
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693645
31971/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693644
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693641
31969/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693640
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693639
31968/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693638
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693637
31967/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693636
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693585
31941/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693584
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693583
31940/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693582
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693581
31939/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693580
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693579
31938/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693578
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693577
31937/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693576
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693575
31936/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693574
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693573
31935/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693572
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693571
31934/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693570
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693427
31851/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693426
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693425
31777/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693424
31740/ns_ge_classif
unix 3 [ ] STREAM CONNECTED 1693419
31764/postgres: pos /tmp/.s.PGSQL.5583
unix 3 [ ] STREAM CONNECTED 1693418
31740/ns_ge_classif

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Thomas Finneid 2007-07-17 19:38:59 insert vs select into performance
Previous Message PFC 2007-07-17 18:04:28 Re: Postgres configuration for 64 CPUs, 128 GB RAM...