Re: COPY doesn't works when containing ' ' or ' ' characters on db

From: "Oliver Elphick" <olly(at)lfix(dot)co(dot)uk>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Jaume Teixi <teixi(at)6tems(dot)com>, pgsql-hackers(at)postgresql(dot)org, pgsql-admin(at)postgresql(dot)org, "Richard T(dot) Robino" <rickspam(at)wavedivision(dot)com>, Stefan Huber <schweinsaug(at)crosswinds(dot)net>
Subject: Re: COPY doesn't works when containing ' ' or ' ' characters on db
Date: 2001-02-27 15:38:15
Message-ID: 200102271538.f1RFcFw09744@linda.lfix.co.uk
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin pgsql-hackers

Tom Lane wrote:
>Jaume Teixi <teixi(at)6tems(dot)com> writes:
>> I finally percated that when data contains '' or '' it's impossible to
>> parse trought:
>
>> COPY products FROM '/var/lib/postgres/dadesi.txt' USING DELIMITERS '|' \g
>
>> it causes:
>
>> SELECT edicion FROM products;
>> edicion
>> -----------------
>> Espaa|Nacional <-------puts on the same cell either there's an '|' in
>> the middle!!!
>
>Very odd. What LOCALE and multibyte encodings are you using, if any?
>This seems like it must be a multibyte issue, but I can't guess what.
>
>Also, which Postgres version are you running? If you said, I missed it.

I think this happens when the front-end encoding is SQL_ASCII and the
database is using UNICODE. Then, there are misunderstandings between
front-end and back-end, so that a single character with the eighth bit
set may be sent by the front-end and interpreted by the back-end as the
first half of a UNICODE two-byte character.

--
Oliver Elphick Oliver(dot)Elphick(at)lfix(dot)co(dot)uk
Isle of Wight http://www.lfix.co.uk/oliver
PGP: 1024R/32B8FAA1: 97 EA 1D 47 72 3F 28 47 6B 7E 39 CC 56 E4 C1 47
GPG: 1024D/3E1D0C1C: CA12 09E0 E8D5 8870 5839 932A 614D 4C34 3E1D 0C1C
========================================
"If we confess our sins, he is faithful and just to
forgive us our sins, and to cleanse us from all
unrighteousness." I John 1:9

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Bruce Momjian 2001-02-27 16:18:14 Re: CHAR vs VARCHAR
Previous Message Jeff Duffy 2001-02-27 15:00:03 Re: indexing

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2001-02-27 15:45:49 Re: Idea for reducing planning time
Previous Message Peter Eisentraut 2001-02-27 15:24:02 Re: A patch for xlog.c