Re: UTF16 surrogate pairs in UTF8 encoding

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Peter Eisentraut <peter_e(at)gmx(dot)net>
Cc: pgsql-hackers(at)postgreSQL(dot)org
Subject: Re: UTF16 surrogate pairs in UTF8 encoding
Date: 2010-08-22 19:15:04
Message-ID: 20836.1282504504@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Peter Eisentraut <peter_e(at)gmx(dot)net> writes:
> On sn, 2010-08-22 at 14:29 -0400, Tom Lane wrote:
>> I just noticed that we are now advertising the ability to insert UTF16
>> surrogate pairs in strings and identifiers (see section 4.1.2.2 in
>> current docs, in particular). Is this really wise? I thought that
>> surrogate pairs were specifically prohibited in UTF8 strings, because
>> of the security hazards implicit in having more than one way to
>> represent the same code point.

> We combine the surrogate pair components to a single code point and
> encode that in UTF-8. We don't encode the components separately; that
> would be wrong.

Oh, OK. Should the docs make that a bit clearer?

regards, tom lane

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Peter Eisentraut 2010-08-22 19:18:05 Re: security label support, part.2
Previous Message Peter Eisentraut 2010-08-22 19:12:44 Re: UTF16 surrogate pairs in UTF8 encoding