Re: [8.0.0] out of memory on large UPDATE

On Thu, 11 Aug 2005, Marc G. Fournier wrote:

> On Thu, 11 Aug 2005, Tom Lane wrote:
>
>> "Marc G. Fournier" <scrappy(at)postgresql(dot)org> writes:
>>> On Thu, 11 Aug 2005, Tom Lane wrote:
>>>> If you've got any AFTER UPDATE triggers on that table, you could be
>>>> running out of memory for the pending-triggers list.
>>
>>> Nope, only have a BEFORE UPDATE, or would that be similar except for at
>>> which point it runs out of memory?
>>
>> Nope, BEFORE UPDATE shouldn't result in any permanent memory
>> accumulation.
>>
>> An out-of-memory error should result in a long report in the postmaster
>> log about how many bytes in each memory context --- can you post that?
>
> This is all I'm seeing in the logs:
>
> # grep "\[653\]" pgsql
> Aug 11 08:45:47 pgsql80 pg[653]: [34-1] ERROR: out of memory
> Aug 11 08:45:47 pgsql80 pg[653]: [34-2] DETAIL: Failed on request of size
> 32.

'k, does this help any?

TopMemoryContext: 40960 total in 4 blocks; 8632 free (10 chunks); 32328 used
SPI Plan: 3072 total in 2 blocks; 1728 free (0 chunks); 1344 used
TopTransactionContext: 534765568 total in 74 blocks; 2144 free (68 chunks); 534763424 used
ExecutorState: 8192 total in 1 blocks; 7648 free (3 chunks); 544 used
MessageContext: 57344 total in 3 blocks; 30312 free (11 chunks); 27032 used
PortalMemory: 8192 total in 1 blocks; 8040 free (0 chunks); 152 used
PortalHeapMemory: 1024 total in 1 blocks; 896 free (0 chunks); 128 used
ExecutorState: 122880 total in 4 blocks; 98912 free (127 chunks); 23968 used
ExprContext: 8192 total in 1 blocks; 7656 free (0 chunks); 536 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
CacheMemoryContext: 516096 total in 6 blocks; 134272 free (3 chunks); 381824 used
xa_url_tuid_idx: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
xa_url_spiderlite_signature_check_idx: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
xa_url_priority_idx: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
urls_status: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
urls_logger_status: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
url_url: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
xa_url_id_pk: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_index_indrelid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_attrdef_adrelid_adnum_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_type_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_type_typname_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_statistic_relid_att_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_shadow_usesysid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_rewrite_rel_rulename_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_proc_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_proc_proname_args_nsp_index: 1024 total in 1 blocks; 712 free (0 chunks); 312 used
pg_operator_oprname_l_r_n_index: 1024 total in 1 blocks; 712 free (0 chunks); 312 used
pg_namespace_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_namespace_nspname_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_language_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_language_name_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_inherits_relid_seqno_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_group_sysid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_group_name_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_conversion_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_conversion_name_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_conversion_default_index: 1024 total in 1 blocks; 712 free (0 chunks); 312 used
pg_opclass_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_opclass_am_name_nsp_index: 1024 total in 1 blocks; 776 free (0 chunks); 248 used
pg_cast_source_target_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_attribute_relid_attnam_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_amop_opr_opc_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_aggregate_fnoid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_shadow_usename_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_trigger_tgrelid_tgname_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_operator_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_amproc_opc_proc_index: 1024 total in 1 blocks; 776 free (0 chunks); 248 used
pg_amop_opc_strat_index: 1024 total in 1 blocks; 776 free (0 chunks); 248 used
pg_index_indexrelid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_attribute_relid_attnum_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
pg_class_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
pg_amproc_opc_proc_index: 1024 total in 1 blocks; 776 free (0 chunks); 248 used
pg_amop_opc_strat_index: 1024 total in 1 blocks; 776 free (0 chunks); 248 used
pg_class_relname_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
MdSmgr: 8192 total in 1 blocks; 5968 free (0 chunks); 2224 used
DynaHash: 8192 total in 1 blocks; 6088 free (0 chunks); 2104 used
Type information cache: 8192 total in 1 blocks; 2008 free (0 chunks); 6184 used
PLpgSQL function cache: 24576 total in 2 blocks; 14280 free (7 chunks); 10296 used
CFuncHash: 8192 total in 1 blocks; 5080 free (0 chunks); 3112 used
Operator class cache: 8192 totalin 1 blocks; 5080 free (0 chunks); 3112 used
smgr relation table: 8192 total in 1 blocks; 1984 free (0 chunks); 6208 used
Portal hash: 8192 total in 1 blocks; 2008 free (0 chunks); 6184 used
Relcache by OID: 8192 total in 1 blocks; 3520 free (0 chunks); 4672 used
Relcache by name: 24576 total in 2 blocks; 13240 free (5 chunks); 11336 used
LockTable (locallock hash): 8192 total in 1 blocks; 4056 free (0 chunks); 4136 used
ErrorContext: 8192 total in 1 blocks; 8176 free (4 chunks); 16 used

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664