Anyone knows how to build and spark on jdk9?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Anyone knows how to build and spark on jdk9?

Zhang, Liyun

Hi all:

1.       I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278.  This means now spark can build or run successfully on JDK9 ?

 

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

Reply | Threaded
Open this post in threaded view
|

RE: Anyone knows how to build and spark on jdk9?

Zhang, Liyun

Thanks your suggestion, seems that scala 2.12.4 support jdk9

 

Scala 2.12.4 is now available.

Our benchmarks show a further reduction in compile times since 2.12.3 of 5-10%.

Improved Java 9 friendliness, with more to come!

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

 

 

 

 

From: Reynold Xin [mailto:[hidden email]]
Sent: Friday, October 27, 2017 10:26 AM
To: Zhang, Liyun <[hidden email]>; [hidden email]; [hidden email]
Subject: Re: Anyone knows how to build and spark on jdk9?

 

It probably depends on the Scala version we use in Spark supporting Java 9 first. 

 

On Thu, Oct 26, 2017 at 7:22 PM Zhang, Liyun <[hidden email]> wrote:

Hi all:

1.       I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278.  This means now spark can build or run successfully on JDK9 ?

 

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

Reply | Threaded
Open this post in threaded view
|

Re: Anyone knows how to build and spark on jdk9?

Jörn Franke
Scala 2.12 is not yet supported on Spark - this means also not JDK9:

If you look at the Oracle support then jdk 9 is anyway only supported for 6 months. JDK 8 is Lts (5 years) JDK 18.3 will be only 6 months and JDK 18.9 is lts (5 years).

I do not think Spark should support non-lts releases. Especially for JDK9 I do not see a strong technical need, but maybe I am overlooking something. Of course http2 etc would be nice for the web interfaces, but currently not very urgent. 

On 27. Oct 2017, at 04:44, Zhang, Liyun <[hidden email]> wrote:

Thanks your suggestion, seems that scala 2.12.4 support jdk9

 

Scala 2.12.4 is now available.

Our benchmarks show a further reduction in compile times since 2.12.3 of 5-10%.

Improved Java 9 friendliness, with more to come!

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

 

 

 

 

From: Reynold Xin [[hidden email]]
Sent: Friday, October 27, 2017 10:26 AM
To: Zhang, Liyun <[hidden email]>; [hidden email]; [hidden email]
Subject: Re: Anyone knows how to build and spark on jdk9?

 

It probably depends on the Scala version we use in Spark supporting Java 9 first. 

 

On Thu, Oct 26, 2017 at 7:22 PM Zhang, Liyun <[hidden email]> wrote:

Hi all:

1.       I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278.  This means now spark can build or run successfully on JDK9 ?

 

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

jgp
Reply | Threaded
Open this post in threaded view
|

Re: Anyone knows how to build and spark on jdk9?

jgp
In reply to this post by Zhang, Liyun
May I ask what is the use case? Although it is a very interesting question, but I would be concerned about going further than a proof of concept. A lot of the enterprises I see and visit are barely on Java8, so starting to talk JDK 9 might be a slight overkill but if you have a good story, I’m all for it!

jg


On Oct 27, 2017, at 03:44, Zhang, Liyun <[hidden email]> wrote:

Thanks your suggestion, seems that scala 2.12.4 support jdk9

 

Scala 2.12.4 is now available.

Our benchmarks show a further reduction in compile times since 2.12.3 of 5-10%.

Improved Java 9 friendliness, with more to come!

 

Best Regards

Kelly Zhang/Zhang,Liyun

 

 

 

 

 

From: Reynold Xin [[hidden email]]
Sent: Friday, October 27, 2017 10:26 AM
To: Zhang, Liyun <[hidden email]>; [hidden email]; [hidden email]
Subject: Re: Anyone knows how to build and spark on jdk9?

 

It probably depends on the Scala version we use in Spark supporting Java 9 first. 

 

On Thu, Oct 26, 2017 at 7:22 PM Zhang, Liyun <[hidden email]> wrote:

Hi all:

1.       I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278.  This means now spark can build or run successfully on JDK9 ?

 

 

Best Regards

Kelly Zhang/Zhang,Liyun