Autovacuum after bulk data insert(millions!)

From: Günce Kaya <guncekaya14(at)gmail(dot)com>
To: pgsql-admin(at)postgresql(dot)org
Subject: Autovacuum after bulk data insert(millions!)
Date: 2017-10-17 06:59:42
Message-ID: CAAV2-mXmqCYn3Q56rpk65cXABFv8TqX7fVPoN_BQhNnynL38YQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Hi all,

We have a database that is used for CRM. During day there are many process
like bulk loading large amounts of data(not thousand like millions!). And
all day we observe auto vacuum in server status. It takes long time. I'm
curious what happens if we disable autovacuum for a database that process
bulk insert? After insert data a table, what autovacuum will do for that
table?

I've read some article like; *"The autovacuum process takes care of several
maintenance chores inside your database that you really need. Generally, if
you think you need to turn regular vacuuming off because it's taking too
much time or resources, that means you're doing it wrong. The answer to
almost all vacuuming problems is to vacuum more often, not less, so that
each individual vacuum operation has less to clean up.*
*However, it's acceptable to disable autovacuum for short periods of time,
for instance when bulk loading large amounts of data."*

The reason why I'm asking, millions of data is inserting to CRM database
all day. What is your advice for that scenario? Should I disable autovacuum
during bulk process or disable autovacuum totally and autovacuum tables in
a some period?

Regards,
Gunce Kaya

Linkedin <https://tr.linkedin.com/in/guncekaya> - Twitter
<https://twitter.com/gguncesi> - Blog
<http://www.guncekaya.blogspot.com.tr/>

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Fabrízio de Royes Mello 2017-10-17 11:16:49 Re: Autovacuum after bulk data insert(millions!)
Previous Message Payal Singh 2017-10-16 18:04:29 Re: .pgpass not working ( centos7, pgagent_96 )