Re: [BUGS] numerics lose scale and precision in views of unions

From: Stephen Frost <sfrost(at)snowman(dot)net>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: "Brian C(dot) DeRocher" <brian(dot)derocher(at)mitretek(dot)org>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: [BUGS] numerics lose scale and precision in views of unions
Date: 2006-08-10 02:22:15
Message-ID: 20060810022215.GP20016@kenobi.snowman.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs pgsql-hackers

* Tom Lane (tgl(at)sss(dot)pgh(dot)pa(dot)us) wrote:
> Stephen Frost <sfrost(at)snowman(dot)net> writes:
> > Sounds good to me. I'd like to talk a bit about the expected behavior
> > of a numeric hash function. This is the current behavior:
>
> You're hijacking the thread, tsk tsk.

Yeah, but Brian sits across the hall from me at work... :)

> Yeah, because numeric_cmp says that 1.0 and 1.00 are equal (what else
> could it say? "less" and "greater" are surely wrong). So you need to

It could say "not equal" pretty reasonably as the scale is
different. With all due respect, it seems to me that we track the scale
for the very reason that it may be different for different numbers.
Unless the SQL spec says differently or we get complaints from people
I'm all for keeping the current semantics though.

> ensure that dscale is not included in the hash calculation. The
> comments in numeric.h claim that you should not need to worry about
> leading or trailing zeroes, but it sounds like you do need to worry
> about differing weights for zero. Might be easiest and safest to use
> only nonzero digit words in the hash calculation.

Makes sense to me.

Thanks!

Stephen

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Tom Lane 2006-08-10 03:35:48 Re: [BUGS] numerics lose scale and precision in views of unions
Previous Message Tom Lane 2006-08-10 00:12:17 Re: [BUGS] numerics lose scale and precision in views of unions

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2006-08-10 02:39:49 Re: [HACKERS] pgsql: Move "#define inline __inline"
Previous Message Satoshi Nagayasu 2006-08-10 02:14:18 Re: pgstattuple extension for indexes