Apache Spark is not building in Mac/Java 8

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Apache Spark is not building in Mac/Java 8

N.Venkata Naga Ravi

Hi,


I am tyring to build Apache Spark with Java 8 in my Mac system ( OS X 10.8.5) , but getting following exception.
Please help on resolving it.


dhcp-173-39-68-28:spark-0.9.1 neravi$ java -version
java version "1.8.0"
Java(TM) SE Runtime Environment (build 1.8.0-b132)
Java HotSpot(TM) 64-Bit Server VM (build 25.0-b70, mixed mode)
dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken

[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? r
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q


Thanks,
Ravi
Reply | Threaded
Open this post in threaded view
|

Re: Apache Spark is not building in Mac/Java 8

Prashant Sharma
you will need to change sbt version to 13.2. I think spark 0.9.1 was released with sbt 13 ? Incase not then it may not work with java 8. Just wait for 1.0 release or give 1.0 release candidate a try !

Prashant Sharma


On Fri, May 2, 2014 at 3:56 PM, N.Venkata Naga Ravi <[hidden email]> wrote:

Hi,


I am tyring to build Apache Spark with Java 8 in my Mac system ( OS X 10.8.5) , but getting following exception.
Please help on resolving it.


dhcp-173-39-68-28:spark-0.9.1 neravi$ java -version
java version "1.8.0"
Java(TM) SE Runtime Environment (build 1.8.0-b132)
Java HotSpot(TM) 64-Bit Server VM (build 25.0-b70, mixed mode)
dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken

[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? r
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q


Thanks,
Ravi

Reply | Threaded
Open this post in threaded view
|

RE: Apache Spark is not building in Mac/Java 8

N.Venkata Naga Ravi
Thanks for your quick replay.

I tried with fresh installation, it downloads sbt 0.12.4 only (please check below logs). So it is not working. Can you tell where this 1.0 release candidate located which i can try?

dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Attempting to fetch sbt
######################################################################## 100.0%
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Updating {file:/Applications/spark-0.9.1/project/project/}default-f15d5a...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q
dhcp-173-39-68-28:spark-0.9.1 neravi$ ls
CHANGES.txt        assembly        core            docs            extras            pom.xml            sbin            yarn
LICENSE            bagel            data            ec2            graphx            project            sbt
NOTICE            bin            dev            examples        make-distribution.sh    python            streaming
README.md        conf            docker            external        mllib            repl            tools
dhcp-173-39-68-28:spark-0.9.1 neravi$ cd sbt/
dhcp-173-39-68-28:sbt neravi$ ls
sbt            sbt-launch-0.12.4.jar



From: [hidden email]
Date: Fri, 2 May 2014 16:02:48 +0530
Subject: Re: Apache Spark is not building in Mac/Java 8
To: [hidden email]

you will need to change sbt version to 13.2. I think spark 0.9.1 was released with sbt 13 ? Incase not then it may not work with java 8. Just wait for 1.0 release or give 1.0 release candidate a try !

Prashant Sharma


On Fri, May 2, 2014 at 3:56 PM, N.Venkata Naga Ravi <[hidden email]> wrote:

Hi,


I am tyring to build Apache Spark with Java 8 in my Mac system ( OS X 10.8.5) , but getting following exception.
Please help on resolving it.


dhcp-173-39-68-28:spark-0.9.1 neravi$ java -version
java version "1.8.0"
Java(TM) SE Runtime Environment (build 1.8.0-b132)
Java HotSpot(TM) 64-Bit Server VM (build 25.0-b70, mixed mode)
dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? r
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q


Thanks,
Ravi

Reply | Threaded
Open this post in threaded view
|

Re: Apache Spark is not building in Mac/Java 8

Prashant Sharma
I have pasted the link in my previous post.

Prashant Sharma


On Fri, May 2, 2014 at 4:15 PM, N.Venkata Naga Ravi <[hidden email]> wrote:
Thanks for your quick replay.

I tried with fresh installation, it downloads sbt 0.12.4 only (please check below logs). So it is not working. Can you tell where this 1.0 release candidate located which i can try?


dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Attempting to fetch sbt
######################################################################## 100.0%

Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Updating {file:/Applications/spark-0.9.1/project/project/}default-f15d5a...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.

[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q
dhcp-173-39-68-28:spark-0.9.1 neravi$ ls
CHANGES.txt        assembly        core            docs            extras            pom.xml            sbin            yarn
LICENSE            bagel            data            ec2            graphx            project            sbt
NOTICE            bin            dev            examples        make-distribution.sh    python            streaming
README.md        conf            docker            external        mllib            repl            tools
dhcp-173-39-68-28:spark-0.9.1 neravi$ cd sbt/
dhcp-173-39-68-28:sbt neravi$ ls
sbt            sbt-launch-0.12.4.jar



From: [hidden email]
Date: Fri, 2 May 2014 16:02:48 +0530
Subject: Re: Apache Spark is not building in Mac/Java 8
To: [hidden email]

you will need to change sbt version to 13.2. I think spark 0.9.1 was released with sbt 13 ? Incase not then it may not work with java 8. Just wait for 1.0 release or give 1.0 release candidate a try !

Prashant Sharma


On Fri, May 2, 2014 at 3:56 PM, N.Venkata Naga Ravi <[hidden email]> wrote:

Hi,


I am tyring to build Apache Spark with Java 8 in my Mac system ( OS X 10.8.5) , but getting following exception.
Please help on resolving it.


dhcp-173-39-68-28:spark-0.9.1 neravi$ java -version
java version "1.8.0"
Java(TM) SE Runtime Environment (build 1.8.0-b132)
Java HotSpot(TM) 64-Bit Server VM (build 25.0-b70, mixed mode)
dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? r
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q


Thanks,
Ravi


Reply | Threaded
Open this post in threaded view
|

RE: Apache Spark is not building in Mac/Java 8

N.Venkata Naga Ravi
Thanks Prashant . The 1.0 RC version is working fine in my system.
Let me explore further and get back you.

Thanks Again,
Ravi


From: [hidden email]
Date: Fri, 2 May 2014 16:22:40 +0530
Subject: Re: Apache Spark is not building in Mac/Java 8
To: [hidden email]

I have pasted the link in my previous post.

Prashant Sharma


On Fri, May 2, 2014 at 4:15 PM, N.Venkata Naga Ravi <[hidden email]> wrote:
Thanks for your quick replay.

I tried with fresh installation, it downloads sbt 0.12.4 only (please check below logs). So it is not working. Can you tell where this 1.0 release candidate located which i can try?


dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Attempting to fetch sbt
######################################################################## 100.0%

Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Updating {file:/Applications/spark-0.9.1/project/project/}default-f15d5a...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.

[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q
dhcp-173-39-68-28:spark-0.9.1 neravi$ ls
CHANGES.txt        assembly        core            docs            extras            pom.xml            sbin            yarn
LICENSE            bagel            data            ec2            graphx            project            sbt
NOTICE            bin            dev            examples        make-distribution.sh    python            streaming
README.md        conf            docker            external        mllib            repl            tools
dhcp-173-39-68-28:spark-0.9.1 neravi$ cd sbt/
dhcp-173-39-68-28:sbt neravi$ ls
sbt            sbt-launch-0.12.4.jar



From: [hidden email]
Date: Fri, 2 May 2014 16:02:48 +0530
Subject: Re: Apache Spark is not building in Mac/Java 8
To: [hidden email]

you will need to change sbt version to 13.2. I think spark 0.9.1 was released with sbt 13 ? Incase not then it may not work with java 8. Just wait for 1.0 release or give 1.0 release candidate a try !

Prashant Sharma


On Fri, May 2, 2014 at 3:56 PM, N.Venkata Naga Ravi <[hidden email]> wrote:

Hi,


I am tyring to build Apache Spark with Java 8 in my Mac system ( OS X 10.8.5) , but getting following exception.
Please help on resolving it.


dhcp-173-39-68-28:spark-0.9.1 neravi$ java -version
java version "1.8.0"
Java(TM) SE Runtime Environment (build 1.8.0-b132)
Java HotSpot(TM) 64-Bit Server VM (build 25.0-b70, mixed mode)
dhcp-173-39-68-28:spark-0.9.1 neravi$ ./sbt/sbt assembly
Launching sbt from sbt/sbt-launch-0.12.4.jar
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=350m; support was removed in 8.0
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? r
[info] Loading project definition from /Applications/spark-0.9.1/project/project
[info] Compiling 1 Scala source to /Applications/spark-0.9.1/project/project/target/scala-2.9.2/sbt-0.12/classes...
[error] error while loading CharSequence, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/lang/CharSequence.class)' is broken
[error] (bad constant pool tag 18 at byte 10)
[error] error while loading Comparator, class file '/Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/lib/rt.jar(java/util/Comparator.class)' is broken
[error] (bad constant pool tag 18 at byte 20)
[error] two errors found
[error] (compile:compile) Compilation failed
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? q


Thanks,
Ravi