RE: PostgreSQL and big data - FDW

From: ROS Didier <didier(dot)ros(at)edf(dot)fr>
To: "bruce(at)momjian(dot)us" <bruce(at)momjian(dot)us>
Cc: "pgsql-hackers(at)lists(dot)postgresql(dot)org" <pgsql-hackers(at)lists(dot)postgresql(dot)org>
Subject: RE: PostgreSQL and big data - FDW
Date: 2020-06-24 12:39:38
Message-ID: fc11afb82c064ac6a192cc48c9d1bc3e@NOEINTPEXMU001.NEOPROD.EDF.FR
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi Bruce

In the following link : https://www.enterprisedb.com/blog/connecting-hadoop-and-edb-postgres-shrink-big-data-challenges
We can see :
"Support for various authentication methods (i.e. Kerberos, NOSASL, etc.)"

So HDFS_FDW support kerberos authentication . how to be sure of that ?
Could EDB make a clear statement on this point?

If so, how to implement this method ? is there any document on this subject ?

Thanks in advance.
Best Regards

Didier ROS
didier(dot)ros(at)edf(dot)fr
Tél. : +33 6 49 51 11 88

-----Message d'origine-----
De : bruce(at)momjian(dot)us [mailto:bruce(at)momjian(dot)us]
Envoyé : mercredi 24 juin 2020 11:13
À : ROS Didier <didier(dot)ros(at)edf(dot)fr>
Cc : pgsql-hackers(at)lists(dot)postgresql(dot)org
Objet : Re: PostgreSQL and big data - FDW

On Wed, Jun 24, 2020 at 09:05:30AM +0000, ROS Didier wrote:
> Hi
>
> I would like to use a Foreign Data Wrapper (FDW) to connect to a
> HADOOP cluster which uses KERBEROS authentication.
>
> is it possible to achieve this ? which FDW should be used ?

Well, I would use the Hadoop FDW:

https://github.com/EnterpriseDB/hdfs_fdw

and it only supports these authentication methods:

Authentication Support

The FDW supports NOSASL and LDAP authentication modes. In order to use
NOSASL do not specify any OPTIONS while creating user mapping. For LDAP
username and password must be specified in OPTIONS while creating user mapping.

Not every FDW supports every Postgres server authentication method.

--
Bruce Momjian <bruce(at)momjian(dot)us> https://momjian.us
EnterpriseDB https://enterprisedb.com

The usefulness of a cup is in its emptiness, Bruce Lee

Ce message et toutes les pièces jointes (ci-après le 'Message') sont établis à l'intention exclusive des destinataires et les informations qui y figurent sont strictement confidentielles. Toute utilisation de ce Message non conforme à sa destination, toute diffusion ou toute publication totale ou partielle, est interdite sauf autorisation expresse.

Si vous n'êtes pas le destinataire de ce Message, il vous est interdit de le copier, de le faire suivre, de le divulguer ou d'en utiliser tout ou partie. Si vous avez reçu ce Message par erreur, merci de le supprimer de votre système, ainsi que toutes ses copies, et de n'en garder aucune trace sur quelque support que ce soit. Nous vous remercions également d'en avertir immédiatement l'expéditeur par retour du message.

Il est impossible de garantir que les communications par messagerie électronique arrivent en temps utile, sont sécurisées ou dénuées de toute erreur ou virus.
____________________________________________________

This message and any attachments (the 'Message') are intended solely for the addressees. The information contained in this Message is confidential. Any use of information contained in this Message not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval.

If you are not the addressee, you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return message.

E-mail communication cannot be guaranteed to be timely secure, error or virus-free.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Amit Kapila 2020-06-24 12:49:46 Re: min_safe_lsn column in pg_replication_slots view
Previous Message Justin Pryzby 2020-06-24 12:38:43 Re: Default setting for enable_hashagg_disk