Re: Storing thousands of csv files in postgresql

From: Ion Alberdi <ion(dot)alberdi(at)pricemoov(dot)com>
To: Marcos Pegoraro <marcos(at)f10(dot)com(dot)br>
Cc: Erik Brandsberg <erik(at)heimdalldata(dot)com>, pgsql-sql <pgsql-sql(at)lists(dot)postgresql(dot)org>
Subject: Re: Storing thousands of csv files in postgresql
Date: 2022-02-15 20:43:42
Message-ID: CANbgw4Akzgf5Nzd5k6oir-JOXEqH9tyNgi40ESaNRJ1ps_2KYw@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

Hi Marcos,

>All those thousands of CSV files have a completely unknown structure ?
Exactly

Le mar. 15 févr. 2022 à 21:28, Marcos Pegoraro <marcos(at)f10(dot)com(dot)br> a écrit :

> I'm going to challenge that the question is not one for Postgres, but you
>> should be asking "What filesystem is best suited to having many files in
>> the same directory" and let the technology deal with the problem. Postgres
>> is just dependent on the filesystem for this behavior. And to that answer,
>> I believe, is XFS.
>>
>> He didn't say how many different schemas will have.
> All those thousands of CSV files have a completely unknown structure ?
> Or you'll have just dozens or hundreds of structures ?
>
> Marcos
>

In response to

Browse pgsql-sql by date

  From Date Subject
Next Message Steve Midgley 2022-02-15 20:58:34 Re: Storing thousands of csv files in postgresql
Previous Message Erik Brandsberg 2022-02-15 20:42:58 Re: Storing thousands of csv files in postgresql