Re: Numeric 508 datatype

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Simon Riggs <simon(at)2ndquadrant(dot)com>, pgsql-patches(at)postgresql(dot)org
Subject: Re: Numeric 508 datatype
Date: 2005-12-02 18:03:26
Message-ID: 200512021803.jB2I3QH23903@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-patches

Tom Lane wrote:
> Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us> writes:
> > So we are really decreasing the specified precision from 1000 to 508,
> > and the computational precision from 4096 to 508.
>
> The internal computational precision isn't any less, the limit is only
> on the result of a function (ie, partial results within one of the
> numeric.c routines could still exceed 10^508). Not sure how much that
> distinction matters though.

Agreed.

> > Is there any plan to
> > fix the silent overflow problem? Is that in the patch? I don't see it.
>
> It will get fixed before application ;-)
>
> I haven't reviewed the patch yet; I think the gating factor at this
> point is whether anyone protests losing dynamic range in NUMERIC,
> and we ought to go ahead and ask that. After that we can look at the
> code more closely.

I am confused by your use of the term "dynamic" range. From what you
say above that we are just moving from 1000 to 508 for storage, and that
computational range would still be 4096?

--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 359-1001
+ If your life is a hard drive, | 13 Roberts Road
+ Christ can be your backup. | Newtown Square, Pennsylvania 19073

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Gary Horton 2005-12-02 18:08:40 createuser ignores stdin in 8.1.0?
Previous Message Rodrigo Gonzalez 2005-12-02 18:02:47 Re: Slow COUNT

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2005-12-02 18:21:05 Re: Numeric 508 datatype
Previous Message Tom Lane 2005-12-02 17:43:28 Re: Numeric 508 datatype

Browse pgsql-patches by date

  From Date Subject
Next Message Julio César Elizondo 2005-12-02 18:19:49 unsuscribe pgsql-patches
Previous Message Julio César Elizondo 2005-12-02 17:50:29 unsuscribe patches