Re: Tsearch2 and Unicode?

From: Dawid Kuroczko <qnex42(at)gmail(dot)com>
To: Pgsql General <pgsql-general(at)postgresql(dot)org>
Subject: Re: Tsearch2 and Unicode?
Date: 2004-11-18 11:17:01
Message-ID: 758d5e7f04111803176e7b1a5@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Thu, 18 Nov 2004 11:08:38 +0100, Markus Wollny
<markus(dot)wollny(at)computec(dot)de> wrote:
> Oleg, what exactly do you mean by "tsearch2 doesn't support unicode yet"?
> It does seem to work fine in my database, it seems:
> ./pg_controldata [mycluster] gives me
> pg_control version number: 72
> [...]
> LC_COLLATE: de_DE.UTF-8
> LC_CTYPE: de_DE.UTF-8

Correct me if I am wrong, but I think that UTF-8 is almost identical
to ISO-8859-1 in binary form to ISO-8859-1. I mean, UTF-8 is
ISO-8859-1 plus multibyte characters from other charsets.

If I am correct, there is no difference for Tsearch2 between UTF-8
and ISO-8859-1, so German locales work fine. As for ISO-8859-2
and similar this will not be the case since there are multibyte
characters.

Oh, and a side-question -- is there any facility to "strip" charsets
like ISO-8859-2 down to ASCII (not SQL_ASCII, I mean ASCII, only
latin characters without accents, etc.)? I think it would be useful
for me, since I intend to search through mail-like messages and
many people are lazy (or accustomed to...) and don't use special
chars but only their ASCII non-accented counterparts...

Regards,
Dawid

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Dominic Mitchell 2004-11-18 13:34:23 Re: Tsearch2 and Unicode?
Previous Message Mike Richards 2004-11-18 10:39:12 A couple serious errors