| From: | Dean Rasheed <dean(dot)a(dot)rasheed(at)gmail(dot)com> |
|---|---|
| To: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> |
| Cc: | PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: Bug in numeric multiplication |
| Date: | 2015-09-21 15:21:10 |
| Message-ID: | CAEZATCWys0N9PVQUA27iUjw0rDauAm35nwGHJ7PKFacxtXnFiQ@mail.gmail.com |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-hackers |
On 21 September 2015 at 16:09, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> wrote:
> I wrote:
>> Dean Rasheed <dean(dot)a(dot)rasheed(at)gmail(dot)com> writes:
>>> The problem then arises in the final carry propagation pass. During
>>> this phase of the computation, the carry from one digit (which can be
>>> a shade under INT_MAX / NBASE) is added to the next digit, and that's
>>> where the overflow happens.
>
>> Nice catch! I think the comment could use a little more work, but I'll
>> adjust it and push.
>
> After trying to rework the comment to explain what maxdig really meant
> after your changes, I came to the conclusion that it'd be better to do
> it as per attached. Does this look sane to you?
>
Yes that looks better. It's still the same amount of extra headroom
(21), but I think it's clearer your way.
Regards,
Dean
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Dmitry Dolgov | 2015-09-21 16:13:05 | Re: jsonb_set array append hack? |
| Previous Message | Tom Lane | 2015-09-21 15:09:14 | Re: Bug in numeric multiplication |