Spark thrift server ldap

[mickymiek]

Hi everyone

We're using the spark thrift server with spark 3.0.1.

We're using it to query hive with jdbc queries using ldap authentication,
and it seems that the LdapAuthenticationProviderImpl.java provided by spark
thrift server is way outdated
(https://github.com/apache/spark/blob/v3.0.1/sql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/LdapAuthenticationProviderImpl.java)
we traced it back to the 1.2 release of hive
(https://github.com/apache/hive/blob/branch-1.2/service/src/java/org/apache/hive/service/auth/LdapAuthenticationProviderImpl.java)

It causes some issues because it lacks some features, for instance because
of the version of hive the thrift server provides, we can't use options like
"hive.server2.authentication.ldap.guidKey", which is really needed in our
case.

Is there a good reason the hive part of thrift server isn't up to date?
If not, we would be happy to contribute on this subject.

Thanks a lot




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

[Pavel Solomin]

Hello!

Can anyone give some attention this question about LDAP please?

Me an my colleague have faced similar issues trying to setting up LDAP for
ThriftServer, and actually ended up patching Hive Service code and shading
Spark's LdapAuthenticationProviderImpl.java with our own custom jar, passed
in `spark.driver.extraClassPath`.

We are up for proposing a patch for Spark ThriftServer codebase. For such a
patch, does it make sense to import LdapAuthenticationProviderImpl.java from
Hive code? We are not sure what were the reasons for Spark codebase to shade
Hive's `org.apache.hive.service` in the first place.

Thank you!



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]