| From: | John R Pierce <pierce(at)hogranch(dot)com> |
|---|---|
| To: | pgsql-general(at)postgresql(dot)org |
| Subject: | Re: Floating point error |
| Date: | 2013-02-25 02:26:33 |
| Message-ID: | 512ACBD9.4030700@hogranch.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-general pgsql-hackers |
On 2/24/2013 6:20 PM, John R Pierce wrote:
> On 2/24/2013 6:13 PM, Tom Duffey wrote:
>> - The Java app on production shows "10.3884573" while the test app
>> shows "10.3885"
>
> 'real' is single precision, which is only about 6 digits of decimal
> accuracy. if your java variables were double precision, you probably
> should have used double in postgres too.
>
> 0.1 decimal is a repeating fraction in binary.
ooops, missed my third point. if precise decimal numbers are
important, use a decimal data type, which is NUMERIC in SQL (I'm not
familiar enough with Java to know if it has a BCD or other decimal type).
--
john r pierce 37N 122W
somewhere on the middle of the left coast
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Edson Richter | 2013-02-25 02:40:01 | Re: Floating point error |
| Previous Message | John R Pierce | 2013-02-25 02:20:11 | Re: Floating point error |
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Edson Richter | 2013-02-25 02:40:01 | Re: Floating point error |
| Previous Message | John R Pierce | 2013-02-25 02:20:11 | Re: Floating point error |