Re: speed up full table scan using psql

From: Lian Jiang <jiangok2006(at)gmail(dot)com>
To: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
Cc: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: speed up full table scan using psql
Date: 2023-05-31 20:57:39
Message-ID: CA+aY8X4Wn2KBDYsqspPOoWUybsB1Jh6yfBVChMSHxVkuRVm3VQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

The command is: psql $db_url -c "copy (select row_to_json(x_tmp_uniq) from
public.mytable x_tmp_uniq) to stdout"
postgres version: 14.7
Does this mean COPY and java CopyManager may not help since my psql command
already uses copy?

Regarding pg_dump, it does not support json format which means extra work
is needed to convert the supported format to jsonl (or parquet) so that
they can be imported into snowflake. Still exploring but want to call it
out early. Maybe 'custom' format can be parquet?

Thanks
Lian

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2023-05-31 21:43:09 Re: speed up full table scan using psql
Previous Message Henrik Peinar (nodeSWAT.com) 2023-05-31 20:45:20 Re: Help needed to understand query planner regression with incremental sort