| From: | "Tsunakawa, Takayuki" <tsunakawa(dot)takay(at)jp(dot)fujitsu(dot)com> |
|---|---|
| To: | 'Alvaro Herrera' <alvherre(at)alvh(dot)no-ip(dot)org>, Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp> |
| Cc: | "andres(at)anarazel(dot)de" <andres(at)anarazel(dot)de>, "robertmhaas(at)gmail(dot)com" <robertmhaas(at)gmail(dot)com>, "tgl(at)sss(dot)pgh(dot)pa(dot)us" <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "michael(dot)paquier(at)gmail(dot)com" <michael(dot)paquier(at)gmail(dot)com>, "david(at)pgmasters(dot)net" <david(at)pgmasters(dot)net>, "Jim(dot)Nasby(at)bluetreble(dot)com" <Jim(dot)Nasby(at)bluetreble(dot)com>, "craig(at)2ndquadrant(dot)com" <craig(at)2ndquadrant(dot)com>, "pgsql-hackers(at)postgresql(dot)org" <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | RE: Protect syscache from bloating with negative cache entries |
| Date: | 2018-03-08 00:28:04 |
| Message-ID: | 0A3221C70F24FB45833433255569204D1F8FF0D9@G01JPEXMBYT05 |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
From: Alvaro Herrera [mailto:alvherre(at)alvh(dot)no-ip(dot)org]
> The thing that comes to mind when reading this patch is that some time ago
> we made fun of other database software, "they are so complicated to configure,
> they have some magical settings that few people understand how to set".
> Postgres was so much better because it was simple to set up, no magic crap.
> But now it becomes apparent that that only was so because Postgres sucked,
> ie., we hadn't yet gotten to the point where we
> *needed* to introduce settings like that. Now we finally are?
Yes. We are now facing the problem of too much memory use by PostgreSQL, where about some applications randomly access about 200,000 tables. It is estimated based on a small experiment that each backend will use several to ten GBs of local memory for CacheMemoryContext. The total memory use will become over 1 TB when the expected maximum connections are used.
I haven't looked at this patch, but does it evict all kinds of entries in CacheMemoryContext, ie. relcache, plancache, etc?
Regards
Takayuki Tsunakawa
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Masahiko Sawada | 2018-03-08 00:42:13 | Re: [HACKERS] Subscription code improvements |
| Previous Message | Tomas Vondra | 2018-03-07 23:49:39 | Re: [HACKERS] [PATCH] Incremental sort |