From: | Melvin Davidson <melvin6925(at)gmail(dot)com> |
---|---|
To: | Alanoly Andrews <alanolya(at)invera(dot)com> |
Cc: | Vincent Veyron <vv(dot)lists(at)wanadoo(dot)fr>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>, "pgsql-admin(at)postgresql(dot)org" <pgsql-admin(at)postgresql(dot)org> |
Subject: | Re: [GENERAL] How to exclude blobs (large objects) from being loaded by pg_restore? |
Date: | 2015-05-02 15:03:27 |
Message-ID: | CANu8Fizmjibfe_WseC-E33fX=gSiaYoY60rvS=kb+DK4poc6iA@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-admin pgsql-general |
I'm not exactly positive, but I believe pg_extractor has an exclude type
option that might fit your requirement. You can download it here:
https://github.com/omniti-labs/pg_extractor
Also note that this is a Python program, so you might even be able to hack
some change into it to do what you need.
Good luck, and may the bytes be with you.
On Sat, May 2, 2015 at 10:27 AM, Alanoly Andrews <alanolya(at)invera(dot)com>
wrote:
> Thanks Vincent. But as I have already mentioned, excluding tables from the
> dump isn't an option. I want to keep the dump complete, but exclude a table
> (or more) from the restore. The procedure I have outlined does work well
> with any table except the ones which have a "large object " column.
>
> Alanoly.
>
> Sent from my iPhone
>
> > On May 2, 2015, at 9:39 AM, Vincent Veyron <vv(dot)lists(at)wanadoo(dot)fr> wrote:
> >
> > On Fri, 1 May 2015 14:12:08 +0000
> > Alanoly Andrews <alanolya(at)invera(dot)com> wrote:
> >
> >> Hello,
> >>
> >> We have a database that has been unloaded using pg_dump. This database
> has a table with a field defined as "lo". When restoring this database to
> another system, we want to avoid loading this particular table as it is
> very large (about 8GB of blob data) and is not needed on the target system.
> I tried the following:
> >> 1. Create a list of all the tables in the pg_dump file using the
> -l option of pg_restore
> >> 2. Edit out the lines corresponding to the said table (with the
> "lo" column)
> >> 3. Run the pg_restore with the -L option to use the edited list of
> tables.
> >
> > use the -T option of pg_dump?
> >
> > http://www.postgresql.org/docs/9.4/static/app-pgdump.html
> >
> > -T table
> > --exclude-table=table
> >
> > Do not dump any tables matching the table pattern.
> >
> >
> >> I have found that what this does is to exclude only the non-lo fields
> of the table. So after the load, the table itself is not visible in the
> target system. But the actual blob data does get loaded since they are
> contained in the pg_largeobject system table. This table does not occur in
> the listing produced in step 1 above and so cannot be edited out. Besides
> it is a system table and should not be excluded anyway.
> >>
> >> I'd appreciate some input on how I can get the blob data of a specific
> table to be excluded from a pg_restore. This is an operation that we need
> to do on a monthly basis. We do not want to exclude the blobs from the dump
> itself (since the whole database is to be preserved as a monthly record),
> but only from the restore.
> >>
> >> Postgres 9.1.4 on AIX.
> >>
> >> Thanks.
> >>
> >> Alanoly Andrews.
> >> Invera Inc.
> >> Montreal, Canada.
> >>
> >>
> >>
> >>
> >>
> >>
> >> ________________________________
> >>
> >> If you no longer wish to receive any of our emails, click on
> UNSUBSCRIBE.<mailto:unsubscribe(at)invera(dot)com?subject=***Unsubscribe***>
> This e-mail may be privileged and/or confidential, and the sender does not
> waive any related rights and obligations. Any distribution, use or copying
> of this e-mail or the information it contains by other than an intended
> recipient is unauthorized. If you received this e-mail in error, please
> advise me (by return e-mail or otherwise) immediately.
> >>
> >>
> >>
> >>
> >> Si vous ne d?sirez plus recevoir de nos courriels, veuillez appuyer sur
> D?SABONNEMENT.<mailto:unsubscribe(at)invera(dot)com?subject=***Unsubscribe***>
> Ce courriel est confidentiel et prot?g?. L'exp?diteur ne renonce pas aux
> droits et obligations qui s'y rapportent. Toute diffusion, utilisation ou
> copie de ce message ou des renseignements qu'il contient par une personne
> autre que le (les) destinataire(s) d?sign?(s) est interdite. Si vous
> recevez ce courriel par erreur, veuillez m'en aviser imm?diatement, par
> retour de courriel ou par un autre moyen.
> >
> >
> > --
> > Salutations, Vincent Veyron
> >
> > https://legalcase.libremen.com/
> > Legal case, contract and insurance claim management software
>
> ________________________________
>
> If you no longer wish to receive any of our emails, click on
> UNSUBSCRIBE.<mailto:unsubscribe(at)invera(dot)com?subject=***Unsubscribe***>
> This e-mail may be privileged and/or confidential, and the sender does not
> waive any related rights and obligations. Any distribution, use or copying
> of this e-mail or the information it contains by other than an intended
> recipient is unauthorized. If you received this e-mail in error, please
> advise me (by return e-mail or otherwise) immediately.
>
> Si vous ne désirez plus recevoir de nos courriels, veuillez appuyer sur
> DÉSABONNEMENT.<mailto:unsubscribe(at)invera(dot)com?subject=***Unsubscribe***>
> Ce courriel est confidentiel et protégé. L'expéditeur ne renonce pas aux
> droits et obligations qui s'y rapportent. Toute diffusion, utilisation ou
> copie de ce message ou des renseignements qu'il contient par une personne
> autre que le (les) destinataire(s) désigné(s) est interdite. Si vous
> recevez ce courriel par erreur, veuillez m'en aviser immédiatement, par
> retour de courriel ou par un autre moyen.
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
>
--
*Melvin Davidson*
I reserve the right to fantasize. Whether or not you
wish to share my fantasy is entirely up to you.
From | Date | Subject | |
---|---|---|---|
Next Message | Daniel Verite | 2015-05-02 17:57:17 | Re: [GENERAL] How to exclude blobs (large objects) from being loaded by pg_restore? |
Previous Message | Alanoly Andrews | 2015-05-02 14:27:37 | Re: [GENERAL] How to exclude blobs (large objects) from being loaded by pg_restore? |
From | Date | Subject | |
---|---|---|---|
Next Message | Paul Jungwirth | 2015-05-02 15:55:22 | Re: Success story full text search |
Previous Message | Alanoly Andrews | 2015-05-02 14:27:37 | Re: [GENERAL] How to exclude blobs (large objects) from being loaded by pg_restore? |