Re: ascii to utf-8

From: Tom Hart <tomhart(at)coopfed(dot)org>
To: Tommy Gildseth <tommy(dot)gildseth(at)usit(dot)uio(dot)no>
Cc: Postgres General List <pgsql-general(at)postgresql(dot)org>
Subject: Re: ascii to utf-8
Date: 2008-01-23 22:53:56
Message-ID: 4797C584.1080904@coopfed.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Tommy Gildseth wrote:
> Tom Hart wrote:
>> Hello everybody. I hope your week's going well so far.
>>
>> I built our data mine in postgreSQL around 3 months ago and I've been
>> working with it since. Postgres is great and I'm really enjoying it,
>> but I've hit a bit of a hitch. Originally (and against pgAdmin's good
>> advice, duh!) I set up the database to use ASCII encoding. However we
>> have a large base of Spanish speaking members and services, and we
>> need utf-8
> ...snip snip
>>
>> pg_restore: [archiver (db)] COPY failed: ERROR: invalid byte
>> sequence for encoding "UTF8": 0xc52f
>> HINT: This error can also happen if the byte sequence does not match
>> the encoding expected by the server, which is controlled by
>> "client_encoding".
>> CONTEXT: COPY transaction, line 209487
>> WARNING: errors ignored on restore: 1
>>
>
> Try editing your dump-file and change the line which reads "SET
> client_encoding = 'SQL_ASCII';" to "SET client_encoding = 'LATIN1';"
>
Ok, so I figured out that head -n -10 and tail -n +10 are not the same
thing, and I've got a decent file now. However when I try the restore I
get this

pg_restore.exe -i -h 192.168.1.xxx -p 5432 -U foobar -d warehouse_utf8
-a -t "transaction" -v "O:\foo\bar\fixed.backup"
pg_restore: [archiver] out of memory

Process returned exit code 1.

I tried upping some of the memory settings in postgresql.conf. The
server has ~2gb of RAM unused, and the file is ~65mb. Anybody have any
ideas?

Also, it's taking around an hour and a half for a message to go from my
computer to being posted on the list. Is there a problem with the
mailing list software?

Thanks again for any assistance you can give me.

--
Tom Hart
IT Specialist
Cooperative Federal
723 Westcott St.
Syracuse, NY 13210
(315) 471-1116 ext. 202
(315) 476-0567 (fax)

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tom Hart 2008-01-23 23:19:46 [Fwd: Re: retry: converting ASCII to UTF-8]
Previous Message pepone.onrez 2008-01-23 22:53:27 Re: Best practices for protect applications agains Sql injection.