Re: Semi-unable to add new records to table--primary key needed?

From: "Boylan, Ross" <Ross(dot)Boylan(at)ucsf(dot)edu>
To: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>, Ron <ronljohnsonjr(at)gmail(dot)com>, "pgsql-general(at)lists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>
Subject: Re: Semi-unable to add new records to table--primary key needed?
Date: 2019-12-22 19:59:07
Message-ID: BYAPR05MB573627502612B1A2EE3CC33D872F0@BYAPR05MB5736.namprd05.prod.outlook.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

> From: Adrian Klaver <adrian(dot)klaver(at)aklaver(dot)com>
> Sent: Sunday, December 22, 2019 10:35 AM
.....
> Alright this is the part where I got confused. I think what is going on is:

>1) The immediate change is going to be to Access 2016 on Windows 10 64
keeping the data in Access files(.accdb)

> 2) The long term plan is to move the data from the Access files to a
stand alone SQL server, presumably Postgres. You are looking for
assistance in converting Access tables and relationships to Postgres.

> 3) At some point the GUI will point to the data in the server instead of
in the Access files.

> Is any of the above correct?

Basically, yes.
1) The current file is in the older Access .mdb format, and will stay that way for the immediate conversion to Win 10/Access 2016.
2) I'd like to go to Postgres medium term. I have converted the Access data to Postgres via an Access/VBA program that writes out SQL files. It clearly needs some work.
I think I may have everything I need to tweak it.
3) Basically yes, though in detail the GUI and the code behind it directly use "linked tables" that are local to the front end. These linked tables are the Access equivalent of symlinks to a particular table on a particular database. They will use the PG ODBC driver to do the talking. The app uses those linked tables now, but the link simply points to the backend file on the disk.

One other issue came up in testing: searches against the Access backend are case insensitive, while searches against the PG backend are case-sensitive. It would be nice to make them case-insensitive, and I've been reading about PG collation options to do so.

Case-sensitivity is completely distinct from all the other issues I've discussed. The sense was also that the problem/difference was not a show-stopper. Current behavior is that if you search for id abc123 it will retrieve an id stored as ABC123. With the PG backend, searching on abc123 retrieves nothing.

> More below.

>>> 3) Have you looked at the Relations tab in Access to see what if any relationships are there?
....
>
>> Yes, but the export program doesn't :) The relations tab documents many, but not all, of the relations in the database. The relations are also a little tricky because sometimes the lack of a relation should not be considered disqualifying for a specimen. Simple example: freezer type is an id to be looked up in a small table of freezer type ids and their names. If the freezer type is missing or nonsense, we may still want the sample. That can be expressed as a left join; the "Access SQL is not SQL" problems centered on left joins.

>Postgres is going to be stricter about this. Access has the concept of
suggested relationships that are not enforced:

>https://urldefense.proofpoint.com/v2/url?u=https-3A__support.office.com_en-2Dus_article_Guide-2Dto-2Dtable-2Drelationships-2D30446197-2D4fbe-2D457b-2Db992-2D2f6fb812b58f&d=DwIDaQ&c=iORugZls2LlYyCAZRB3XLg&r=nh70E5-mX2XsDe5lrDDMt_ZRqqGMcdTmTrRLvNmttYA&m=qa1d513KOtyWtV0u2K81rduJ0TiRaucF3gbnjVTESkc&s=F10pVnItttte6dDN-4R4t13xDrJr8zAoIp63mrYNMh0&e=

Thanks for the pointer. I'm not sure if we're using any of those suggested relationships, but we're definitely using relationships that one infers only by looking at the SQL code. In other words, queries link tables by fields that are not mentioned on the relationships tab.

......

> Postgres Foreign Key relationships either exist or they don't. Now you
can employee 'cheats' with you own triggers, but that is another subject.

>As to your freezer example:

>create table freezer_info(freezer_id int PRIMARY KEY);
>create table sample_tbl(sample_id serial PRIMARY KEY, freezer_fk int
>REFERENCES freezer_info ON UPDATE CASCADE);

The direct translation of our current app would be to omit the foreign key relation in the table definition, but to have queries that include a left join from sample_tbl to freezer_info.

That raises one other question: what is the relation between the relations expressed on the server via FOREIGN KEY declarations and relations known to Access? At first blush, they are completely different. In Access a relation is an object that lives on the front-end, while the server relations obviously live on the server. I don't know if Access, perhaps via the ODBC spec, does anything to guarantee their consistency. Clearly since Access relations can have "suggested relations" which have no backend equivalent, the 2 sets of relations cannot in general be mirror images.

Identifying and enforcing all foreign key relations, is something I'm planning to defer til after the migration to PG. There is a noticeable amount of funky stuff in the data, which could use some housekeeping regardless of platform. The cleanup is not likely to be simple.

One of the long-run benefits of using a database server is that it should limit the possibilities for funkiness by enforcing referential integrity and properly cleaning up after incomplete operations, instead of leaving pieces of them in the database. But we can't enforce referential integrity until our data exhibit it! And the transactional integrity probably depends more on proper coding on the front-end app than the choice of backend; file-based Access backends do support transactions.

Ross

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Adrian Klaver 2019-12-22 22:23:45 Re: Semi-unable to add new records to table--primary key needed?
Previous Message Jeff Janes 2019-12-22 19:21:32 unanalyze a foreign table