Re: Storing thousands of csv files in postgresql

From: Marcos Pegoraro <marcos(at)f10(dot)com(dot)br>
To: Erik Brandsberg <erik(at)heimdalldata(dot)com>
Cc: Ion Alberdi <ion(dot)alberdi(at)pricemoov(dot)com>, pgsql-sql <pgsql-sql(at)lists(dot)postgresql(dot)org>
Subject: Re: Storing thousands of csv files in postgresql
Date: 2022-02-15 20:27:31
Message-ID: CAB-JLwbpFtUe7nU-nrpBY0g5oBJEta4DiQaEO_1mm6Kzn_WVnA@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-sql

>
> I'm going to challenge that the question is not one for Postgres, but you
> should be asking "What filesystem is best suited to having many files in
> the same directory" and let the technology deal with the problem. Postgres
> is just dependent on the filesystem for this behavior. And to that answer,
> I believe, is XFS.
>
> He didn't say how many different schemas will have.
All those thousands of CSV files have a completely unknown structure ?
Or you'll have just dozens or hundreds of structures ?

Marcos

In response to

Responses

Browse pgsql-sql by date

  From Date Subject
Next Message Ion Alberdi 2022-02-15 20:40:20 Re: Storing thousands of csv files in postgresql
Previous Message Erik Brandsberg 2022-02-15 20:11:09 Re: Storing thousands of csv files in postgresql