Re: Importing tab delimited text file using phpPgAdmin 5.1 GUI

From: <s400t(at)yahoo(dot)co(dot)jp>
To: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>, rob stone <floriparob(at)gmail(dot)com>, "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Importing tab delimited text file using phpPgAdmin 5.1 GUI
Date: 2018-12-07 17:04:38
Message-ID: 683172210.269176.1544202278516.JavaMail.yahoo@mail.yahoo.co.jp
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

I didn't specify any schema, so it was created in public schema.The error message also says "public"...//------------------------------------------------------------------ERROR: column "rec_id" of relation "spec" does not existLINE 1: INSERT INTO "public"."spec" ("rec_id","title_c...//------------------------------------------------------------------
Output of the \d spec:

                 Table "public.spec"           Column           |          Type           | Modifiers ----------------------------+-------------------------+----------- rec_id                     | character varying(32)   | not null title_category             | character varying(255)  |  doctype                    | character varying(255)  |  ... goes on like this for other columns.
What are you trying to see in the output of \d spec?
I don't understand what you mean by the import code is trying to insert in to wrong version of the table.I visually checked the left side "menu like" structure of the phpPgAdmin- there is no other table of that name.
You mentioned that quoted identifiers are not the issue.This prompted me to test the process in a table with a few columns and ascii characters.Immediately it was clear that quoted identifiers were not to blame.
I found that I got that error when I change encoding of the tab delimited file to UTF-8. Because my data contains non-ascii characters, if I don't use UTF-8, I get this error.
ERROR: invalid byte sequence for encoding "UTF8": 0x82
... and I read somewhere that if I open the text file in notpad and save it with UTF-8 encoding, I can get rid of the error. (When inserting using pyDev (psycopg2)/Eclipse, that does get rid of the error...
That's why I changed encoding.
And now I am stuck with this error.
But at least, now I am not blaming phpPgAdmin :)Thanks for the lead. 
BTW, both server and client encoding of my pg db are UTF8.
testdb=# SHOW SERVER_ENCODING; server_encoding ----------------- UTF8(1 row)
testdb=# SHOW CLIENT_ENCODING; client_encoding ----------------- UTF8(1 row)
testdb=#

----- Original Message -----
From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
To: s400t(at)yahoo(dot)co(dot)jp; rob stone <floriparob(at)gmail(dot)com>; "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Date: 2018/12/7, Fri 23:47
Subject: Re: Importing tab delimited text file using phpPgAdmin 5.1 GUI

On 12/7/18 12:28 AM, s400t(at)yahoo(dot)co(dot)jp wrote:
> Hello Adrian, Rob!
>
> Thank you for the comments.
>
> Oh, yes, I forgot to mention that I am using Postgresql version 9.6.
> I had read somewhere that last supported version was 9.3 or something,
> could be 9.2 as you say.
>
> I wanted to use phpPgAdmin, that's why I went back to 9.6 even if I had
> installed ver. 10 first.
> But if the phpPgAdmin quotes identifiers by defaults, I will need to
> look for some other ways.

I don't think the quoted identifiers are the issue. I am suspecting that
the import code may be trying to INSERT into the wrong version of the
table. Some questions:

1) Which schema did you create spec in?

2) In psql what does \d spec show?

>
> Strictly speaking, I don't need to use the phpPgAdmin, but I am trying
> to find a GUI way to upload a file quickly (the file has thousands of
> records.)
>
> Now, I am using pyDev in Eclipse to insert records, but I need to use a
> web-based click and upload.

?
https://www.pgadmin.org/

>
> If I could find a php version of my python code that would be great!
> My Python code:
>
> cur = conn.cursor()
>
> with io.open(fileName,'r',encoding='utf8') as f:
>      next(f)  # Skip header row.
>      cur.copy_from(f, tableName, sep='\t')
> conn.commit()
> cur.close()
> f.close()
>
>
> I have found PHP samples for line by line read and insert, but that will
> be too slow for me.
>
> Cheers!
>
>
>
>    ----- Original Message -----
>    *From:* rob stone <floriparob(at)gmail(dot)com>
>    *To:* Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>; s400t(at)yahoo(dot)co(dot)jp;
>    "pgsql-general(at)lists(dot)postgresql(dot)org"
>    <pgsql-general(at)lists(dot)postgresql(dot)org>
>    *Date:* 2018/12/7, Fri 16:47
>    *Subject:* Re: Importing tab delimited text file using phpPgAdmin
>    5.1 GUI
>
>    Hello,
>
>    On Thu, 2018-12-06 at 21:29 -0800, Adrian Klaver wrote:
>      > On 12/6/18 7:54 PM, s400t(at)yahoo(dot)co(dot)jp <mailto:s400t(at)yahoo(dot)co(dot)jp>
>    wrote:
>      >
>      > Most GUI tools I am familiar with quote identifiers by default.
>      > > How/where can I tell the phpPgAdmin not to add that extra "" around
>      > > the
>      > > field name?
>      >
>      > I don't know. I have been under the impression that phpPgAdmin was
>      > no
>      > longer maintained/in use.
>      >
>      > You might have more luck here:
>      >
>      > https://sourceforge.net/p/phppgadmin/discussion/115884
>      >
>      > >
>      > > Thanks for reading and suggestions.
>      >
>      >
>
>    If you look at phppgadmin on sourceforge, the tarball files are all
>    dated April 15th., 2013.
>    It appears to have stalled at Postgres version 9.2.
>    I doubt if it will run on versions 10 or 11.
>
>    Cheers,
>    Rob
>
>
>
>
>
>

--
Adrian Klaver
adrian(dot)klaver(at)aklaver(dot)com


In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Ron 2018-12-07 17:14:37 Re: psql profiles?
Previous Message Matt Zagrabelny 2018-12-07 16:45:55 Re: psql profiles?