Re: How to insert data from a text file

On Thu, Jun 18, 2009 at 1:51 PM, Mike <1100100(at)gmail(dot)com> wrote:

> Background:
>
> Thousands of folders and files filled with client data on the linux
> samba server.
> Searching for data is difficult due to ever-changing directory
> structures and naming schemes.
>
> Example (exaggerating to make a point):
>
> /air/water/vegetable/animal/broccoli/potato/crabby_client.doc
> /animal/broccoli/air/vegetable/poise_and_honor.pdf
>
> It goes on for about 650,000 files
>
> I used the following command to gather all file and directory names.
> "/abc" is the main directory on the linux samba server where all
> company data is located:
>
> root(at)acme:/# ls -Ralh /abc > /home/mike/file_output.txt
>
> file_output.txt is 33 megs. and lists approximately 650,000 file names
> and their directory paths.
>
> I want to pull all the file name info. and directory path info. from
> "file_output.txt" and place each file name into a postgresql database
> along with the related file location information.
> The ultimate goal is to be able to make an alpha-numeric query and be
> presented with matching file names and their location on the samba
> server.
>
> How do I pull the data from "file_output.txt" and place it into the
> postgres database?
>
> Any guidance and pointed RTFM declarations greatly appreciated.
>

With 650k lines, you can use python, perl, java, etc. to insert the records;
pick you language of choice. Alternatively, you can use the psql client and
its \copy command.

Just an aside, but on linux, have you looked into using either the find
command or locate, or even google desktop?

Sean