| From: | Fujii Masao <masao(dot)fujii(at)oss(dot)nttdata(dot)com> |
|---|---|
| To: | Pgsql Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Enhance file_fdw to report processed and skipped tuples in COPY progress |
| Date: | 2024-10-03 09:23:43 |
| Message-ID: | 2ffa9bfa-41f6-4180-a32a-2c693ec1eeed@oss.nttdata.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
Hi,
Currently, file_fdw updates several columns in the pg_stat_progress_copy view,
like relid and bytes_processed, but it doesn't track tuples_processed or
tuples_skipped. Monitoring these would be particularly useful when handling
large data sets via file_fdw, as it helps track the progress of scan.
The attached patch updates file_fdw to add support for reporting
the number of tuples processed and skipped (due to on_error = 'ignore')
in the pg_stat_progress_copy view. What are your thoughts?
Regards,
--
Fujii Masao
Advanced Computing Technology Center
Research and Development Headquarters
NTT DATA CORPORATION
| Attachment | Content-Type | Size |
|---|---|---|
| v1-0001-file_fdw-Report-tuples-processed-and-skipped-for-.patch | text/plain | 2.6 KB |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Alexey Orlov | 2024-10-03 09:32:59 | Re: Patch: Show queries of processes holding a lock |
| Previous Message | David Steele | 2024-10-03 09:11:14 | Re: Return pg_control from pg_backup_stop(). |