Re: Can COPY skip a header line?

From: Johan Wehtje <joweht(at)tpgi(dot)com(dot)au>
To: pgsql-general <pgsql-general(at)postgresql(dot)org>
Cc: Adam Witney <awitney(at)sghms(dot)ac(dot)uk>, Martijn van Oosterhout <kleptog(at)svana(dot)org>
Subject: Re: Can COPY skip a header line?
Date: 2004-11-21 05:47:17
Message-ID: 41A02BE5.4000008@tpgi.com.au
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

MS SQL Server has a BULK INSERT command that can take a parameter "Start
Row" so that you can skip as many Rows as you want.
this is also available using the command line bcp utility. This would be
a nice feature for Postgresql to have , and I can't see it on any of the
to do lists, unless it is already implemented well enough in third party
utility or contrib. I shelled out a fair bit to get hold of EMS Hi Tech
Postgres Manager bundle, and whilst there is a lot to like about it
generally, at least part of the reason was because of the improved bulk
insert tools.

Adam Witney wrote:

>Hi Martijn,
>
>Can I get PHP to remove the first row without reading the whole file in? If
>there was a way where PHP would just chop the first row off that would be
>ideal...
>
>Thanks
>
>adam
>
>
>
>>Wouldn't it be easier to have PHP remove the first row?
>>
>>And PHP has to be there because Apache is sending all the data to it.
>>
>>Hope this helps,
>>
>>On Fri, Nov 19, 2004 at 03:43:18PM +0000, Adam Witney wrote:
>>
>>
>>>Following on from my question yesterday... Can COPY then be made to skip a
>>>header line (the first line of the file say)?
>>>
>>>The problem is this... I need to allow a user to upload a data file through
>>>a web browser (PHP driven). This is then processed and the selected file
>>>columns mapped to fields in a database, and then the data file uploaded. I
>>>can do this fine with small files.... But if I get above a 1000 rows it
>>>takes so long it time out.
>>>
>>>I can upload a 10,000 row equivalent file using COPY from psql in 2 seconds,
>>>so the time is down to the PHP processing (really all it does is send itto
>>>pg_put_Line)
>>>
>>>I liked Toms idea to create a temporary table, but I need to be able to get
>>>rid of the header row then... Is there anyway of avoiding getting PHP
>>>involved in the file processing?
>>>
>>>Any ideas?
>>>
>>>Thanks
>>>
>>>Adam
>>>
>>>
>>>--
>>>This message has been scanned for viruses and
>>>dangerous content by MailScanner, and is
>>>believed to be clean.
>>>
>>>
>>>---------------------------(end of broadcast)---------------------------
>>>TIP 1: subscribe and unsubscribe commands go to majordomo(at)postgresql(dot)org
>>>
>>>
>
>
>
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Net Virtual Mailing Lists 2004-11-21 07:27:11 Re: Join between databases or (???)
Previous Message Michael Fuhr 2004-11-21 05:31:24 Re: Join between databases or (???)