Re: Is it reasonable to store double[] arrays of 30K elements

From: AlexK <alkuzo(at)gmail(dot)com>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: Is it reasonable to store double[] arrays of 30K elements
Date: 2014-02-15 20:52:24
Message-ID: CAC31dZ3DWL60f2sFhGFxpuuaZ2aRXuiFWMYyGDk7cekmg-NTaQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Hi Pavel,

1. I believe we have lots of memory. How much is needed to read one array
of 30K float number?
2. What do we need to avoid possible repeated detost, and what it is?
3. We are not going to update individual elements of the arrays. We might
occasionally replace the whole thing. When we benchmarked, we did not
notice slowness. Can you explain how to reproduce slowness?

TIA!

On Fri, Feb 14, 2014 at 11:03 PM, Pavel Stehule [via PostgreSQL] <
ml-node+s1045698n5792144h78(at)n5(dot)nabble(dot)com> wrote:

> Hello
>
>
> I worked with 80K float fields without any problem.
>
> There are possible issues:
>
> * needs lot of memory for detoast - it can be problem with more parallel
> queries
> * there is a risk of possible repeated detost - some unhappy usage in
> plpgsql can be slow - it is solvable, but you have to identify this issue
> * any update of large array is slow - so these arrays are good for write
> once data
>
> Regards
>
> Pavel
>
>
> 2014-02-14 23:07 GMT+01:00 lup <[hidden email]<http://user/SendEmail.jtp?type=node&node=5792144&i=0>
> >:
>
>> Would 10K elements of float[3] make any difference in terms of read/write
>> performance?
>> Or 240K byte array?
>>
>> Or are these all functionally the same issue for the server? If so,
>> intriguing possibilities abound. :)
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://postgresql.1045698.n5.nabble.com/Is-it-reasonable-to-store-double-arrays-of-30K-elements-tp5790562p5792099.html
>> Sent from the PostgreSQL - general mailing list archive at Nabble.com.
>>
>>
>> --
>> Sent via pgsql-general mailing list ([hidden email]<http://user/SendEmail.jtp?type=node&node=5792144&i=1>
>> )
>> To make changes to your subscription:
>> http://www.postgresql.org/mailpref/pgsql-general
>>
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://postgresql.1045698.n5.nabble.com/Is-it-reasonable-to-store-double-arrays-of-30K-elements-tp5790562p5792144.html
> To unsubscribe from Is it reasonable to store double[] arrays of 30K
> elements, click here<http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5790562&code=YWxrdXpvQGdtYWlsLmNvbXw1NzkwNTYyfC03ODIwNTcyNw==>
> .
> NAML<http://postgresql.1045698.n5.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>

--
View this message in context: http://postgresql.1045698.n5.nabble.com/Is-it-reasonable-to-store-double-arrays-of-30K-elements-tp5790562p5792236.html
Sent from the PostgreSQL - general mailing list archive at Nabble.com.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Pavel Stehule 2014-02-15 21:11:58 Re: Is it reasonable to store double[] arrays of 30K elements
Previous Message Antman, Jason (CMG-Atlanta) 2014-02-15 18:49:32 Re: Restore postgresql data directory to tablespace on new host? Or swap tablespaces?