Re: Big wide datasets

From: "Jean-Yves F(dot) Barbier" <12ukwn(at)gmail(dot)com>
To: pgsql-novice(at)postgresql(dot)org
Subject: Re: Big wide datasets
Date: 2011-12-08 13:24:44
Message-ID: 20111208142444.3184bcf8@anubis.defcon1
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-novice

On Thu, 8 Dec 2011 13:05:19 +0000
Michael Lush <mjlush(at)gmail(dot)com> wrote:

> I have dataset with ~10000 columns and ~200000 rows (GWAS data (1)) in the
> form
> sample1, A T, A A, G C, ....
> sampel2, A C, C T, A A, ....
>
> I'd like to take subsets of both columns and rows for analysis

Why do you want to write the subsets to a table instead of reading
1/1, analyse and save the result?
This way you avoid the huge temp table which don't seem necessary.

BTW just in case, in python there's large libraries dedicated to
genetics.

--
BOFH excuse #99:
SIMM crosstalk.

In response to

Browse pgsql-novice by date

  From Date Subject
Next Message Robert D. Schnabel 2011-12-08 13:39:16 Re: Big wide datasets
Previous Message Michael Lush 2011-12-08 13:05:19 Big wide datasets